Run in container Total memory is 8388608KB Starting ocp-server: /usr/lib/jvm/java-1.8.0/bin/java -server -XX:+UseG1GC -Xms5734m -Xmx5734m -Xss512k -XX:+PrintCommandLineFlags -XX:MetaspaceSize=1024m -XX:MaxMetaspaceSize=1024m -XX:+PrintAdaptiveSizePolicy -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -Xloggc:/home/admin/ocp-server/bin/../log/gc.log -XX:+UseGCLogFileRotation -XX:GCLogFileSize=50M -XX:NumberOfGCLogFiles=2 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -Dfile.encoding=UTF-8 -jar /home/admin/ocp-server/bin/../lib/ocp-server-4.0.0-20220930.jar -XX:CompressedClassSpaceSize=1065353216 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:GCLogFileSize=52428800 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -XX:InitialHeapSize=6012534784 -XX:MaxHeapSize=6012534784 -XX:MaxMetaspaceSize=1073741824 -XX:MetaspaceSize=1073741824 -XX:NumberOfGCLogFiles=2 -XX:+PrintAdaptiveSizePolicy -XX:+PrintCommandLineFlags -XX:+PrintGC -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ThreadStackSize=512 -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseGCLogFileRotation ___ ___ / _ \ __ ___ __ _ _ _ | _ ) __ _ ___ ___ | (_) | / _| / -_) / _` | | ' \ | _ \ / _` | (_-< / -_) \___/ \__| \___| \__,_| |_||_| |___/ \__,_| /__/ \___| :: Spring Boot :: (v2.3.9.RELEASE) :: OCP Server :: (v4.0.0-20220930) 2022-12-08 11:57:54.106 INFO 42 --- [ main] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 11:57:55.989 INFO 42 --- [ main] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 11:57:56.464 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : The following profiles are active: composite,default 2022-12-08 11:58:25.775 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 11:58:27.196 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 1332ms. Found 3 JPA repository interfaces. 2022-12-08 11:58:27.270 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 11:58:29.571 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 2300ms. Found 16 JPA repository interfaces. 2022-12-08 11:58:29.576 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 11:58:45.442 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 15865ms. Found 99 JPA repository interfaces. 2022-12-08 11:58:53.826 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmEventHistoryRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmEventHistoryRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:53.828 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmGroupAlarmTypeRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmGroupAlarmTypeRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:53.829 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmDetectRuleRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmDetectRuleRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:53.831 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmMetricMetaRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmMetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:54.325 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricGroupRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricGroupRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:54.328 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricObCollectConfigRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricObCollectConfigRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:54.329 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricClassRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricClassRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:54.330 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricMetaRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:55.080 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'sqlAggregateDataRepository' and 'com.alipay.ocp.core.monitordb.alarm.SqlAggregateDataRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:55.082 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obClusterSystemEventRepository' and 'com.alipay.ocp.core.monitordb.ob.ObClusterSystemEventRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:55.083 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obTenantMiniCompactionRepository' and 'com.alipay.ocp.core.monitordb.ob.ObTenantMiniCompactionRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 11:58:57.893 INFO 42 --- [main,,] o.s.cloud.context.scope.GenericScope : BeanFactory id=22bf410e-9c42-33ee-903b-47d732131f72 2022-12-08 11:59:02.303 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler@773c0293' of type [org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 11:59:02.307 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'localSecurityConfiguration.MethodSecurityConfiguration' of type [com.alipay.ocp.server.config.security.LocalSecurityConfiguration$MethodSecurityConfiguration$$EnhancerBySpringCGLIB$$49b04551] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 11:59:02.453 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Method-level access control enabled. 2022-12-08 11:59:02.475 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'methodSecurityMetadataSource' of type [org.springframework.security.access.method.DelegatingMethodSecurityMetadataSource] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 11:59:08.217 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 11:59:10.008 INFO 42 --- [main,,] org.hibernate.Version : HHH000412: Hibernate ORM core version 5.4.28.Final 2022-12-08 11:59:12.666 INFO 42 --- [main,,] o.hibernate.annotations.common.Version : HCANN000001: Hibernate Commons Annotations {5.1.2.Final} 2022-12-08 11:59:23.487 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-1,metadb-connect-pool} inited 2022-12-08 11:59:23.849 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 11:59:27.980 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 11:59:27.982 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 11:59:27.984 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 11:59:32.757 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000038: Composite-id class does not override equals(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 11:59:32.759 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000039: Composite-id class does not override hashCode(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 11:59:45.585 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 11:59:45.735 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 11:59:55.522 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8080 (http) 2022-12-08 11:59:55.665 INFO 42 --- [main,,] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2022-12-08 11:59:55.668 INFO 42 --- [main,,] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.43] 2022-12-08 11:59:56.760 INFO 42 --- [main,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2022-12-08 11:59:56.761 INFO 42 --- [main,,] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 120009 ms 2022-12-08 12:00:05.618 INFO 42 --- [main,,] c.a.o.service.maz.OcpMultiAzoneService : OCP multi-azone not enabled 2022-12-08 12:00:05.630 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set username=monitor_user@monitor_tenant#obcluster 2022-12-08 12:00:05.632 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set url=jdbc:oceanbase://192.168.28.54:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true 2022-12-08 12:00:05.632 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set driver class=com.oceanbase.jdbc.Driver 2022-12-08 12:00:05.850 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 12:00:09.709 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-2,monitordb-connect-pool} inited 2022-12-08 12:00:09.711 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:00:11.987 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 12:00:11.989 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 12:00:23.756 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/meta 2022-12-08 12:00:24.753 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Finish migration, location=migration/meta 2022-12-08 12:00:24.755 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/monitor 2022-12-08 12:00:24.758 INFO 42 --- [main,,] com.alipay.ocp.core.util.ResourceUtils : Cannot find any file in location: migration/monitor 2022-12-08 12:00:24.760 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Migration schemas is empty. 2022-12-08 12:01:08.934 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 24913 ms to scan 31 urls, producing 672 keys and 5542 values 2022-12-08 12:01:28.064 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 18715 ms to scan 31 urls, producing 73 keys and 4708 values 2022-12-08 12:01:28.147 INFO 42 --- [main,,] c.a.o.server.analyzer.OcpStartUpChecker : audit event is disable 2022-12-08 12:01:31.008 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : ocp-monitor bean configuration done 2022-12-08 12:01:43.284 INFO 42 --- [main,,] c.a.ocp.server.config.BeanConfiguration : begin set auto discover false. 2022-12-08 12:01:43.333 INFO 42 --- [main,,] c.a.ocp.server.config.BeanConfiguration : set auto discover false success. 2022-12-08 12:01:49.241 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Validate and set keys, publicKey=, valid=false 2022-12-08 12:01:49.807 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Generate new rsa key, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCmKEJV3mbaJH2oW7yTVE1NiJWrXzMS8SnAlPUTiZVZm5Lb/00BUhwEhiOsVyihLHkAZRTfgmmyxpBoOZkFsAUmD5Gkc1b9tdgH/cImSbxnsdssxYE28miDmXthxJhqadHkdqOqMOAQictyWUHRiOFryzIFz0dUew/lSdZult/OoQIDAQAB 2022-12-08 12:01:50.668 INFO 42 --- [main,,] c.a.o.service.property.PropertyService : Updated property, key=ocp.login.encryption.public-key, previousValue=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCmKEJV3mbaJH2oW7yTVE1NiJWrXzMS8SnAlPUTiZVZm5Lb/00BUhwEhiOsVyihLHkAZRTfgmmyxpBoOZkFsAUmD5Gkc1b9tdgH/cImSbxnsdssxYE28miDmXthxJhqadHkdqOqMOAQictyWUHRiOFryzIFz0dUew/lSdZult/OoQIDAQAB, updatedValue=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCmKEJV3mbaJH2oW7yTVE1NiJWrXzMS8SnAlPUTiZVZm5Lb/00BUhwEhiOsVyihLHkAZRTfgmmyxpBoOZkFsAUmD5Gkc1b9tdgH/cImSbxnsdssxYE28miDmXthxJhqadHkdqOqMOAQictyWUHRiOFryzIFz0dUew/lSdZult/OoQIDAQAB 2022-12-08 12:01:50.833 INFO 42 --- [main,,] c.a.o.service.property.PropertyService : Updated property, key=ocp.login.encryption.private-key, previousValue=MIICdgIBADANBgkqhkiG9w0BAQEFAASCAmAwggJcAgEAAoGBAKYoQlXeZtokfahbvJNUTU2IlatfMxLxKcCU9ROJlVmbktv/TQFSHASGI6xXKKEseQBlFN+CabLGkGg5mQWwBSYPkaRzVv212Af9wiZJvGex2yzFgTbyaIOZe2HEmGpp0eR2o6ow4BCJy3JZQdGI4WvLMgXPR1R7D+VJ1m6W386hAgMBAAECgYBckSs7qXaFazTyOYFaVunmGwS+/391uxM2rgXHB6xDyq9LjvS4mqTvREfVeI0zFZKnzKiPSJlYNtU2q3f7ui9zOe4fbDLwp6OzQPWtR14GLpxqPqEZo0zA9Nl+Yisjd7J8xCvTWikty3JnzdtIY62J8JNrhgPd22H+8grA01XCUQJBANQzDYobgFlXUE7v9u9yaLAZl/qkeO2qBl6YcOXgpybNOkk9+hhhyrFEWrRBQeC+qJqOVuQ4IfFoXr5FcIO9xAUCQQDIdERP9OJRLTXUqb2PtUwtzke8G4PeX7uZ0fiiWfbcd5MKn2O5v72FrWp6QksFSQNqUjjTdm/YY3Y40ViCcd7tAkEAlC42hTvhLAJKBWWS9fDZ5CdrNs8F10lE+2fOZuizMOhdjGnoLICVr6ZBBOERJOVfDdbaHLKKGW89wfbxtD2fFQJAbF+vryrOUOUIfXlnqxJxpTIpRmH54XgQjREgQ2YwOPHM5alW2U34wRUIxCCjPrBC0HCzmGAoB+1+NSm5mIzH4QJAU/XRX1JTmVSfyL1qh4Xmor5CqLp/IryoObGbx1amKq/D7HXMD3J+WnYupIrrgROAyeK23GsoIWTGAP18pyqOZA==, updatedValue=MIICdgIBADANBgkqhkiG9w0BAQEFAASCAmAwggJcAgEAAoGBAKYoQlXeZtokfahbvJNUTU2IlatfMxLxKcCU9ROJlVmbktv/TQFSHASGI6xXKKEseQBlFN+CabLGkGg5mQWwBSYPkaRzVv212Af9wiZJvGex2yzFgTbyaIOZe2HEmGpp0eR2o6ow4BCJy3JZQdGI4WvLMgXPR1R7D+VJ1m6W386hAgMBAAECgYBckSs7qXaFazTyOYFaVunmGwS+/391uxM2rgXHB6xDyq9LjvS4mqTvREfVeI0zFZKnzKiPSJlYNtU2q3f7ui9zOe4fbDLwp6OzQPWtR14GLpxqPqEZo0zA9Nl+Yisjd7J8xCvTWikty3JnzdtIY62J8JNrhgPd22H+8grA01XCUQJBANQzDYobgFlXUE7v9u9yaLAZl/qkeO2qBl6YcOXgpybNOkk9+hhhyrFEWrRBQeC+qJqOVuQ4IfFoXr5FcIO9xAUCQQDIdERP9OJRLTXUqb2PtUwtzke8G4PeX7uZ0fiiWfbcd5MKn2O5v72FrWp6QksFSQNqUjjTdm/YY3Y40ViCcd7tAkEAlC42hTvhLAJKBWWS9fDZ5CdrNs8F10lE+2fOZuizMOhdjGnoLICVr6ZBBOERJOVfDdbaHLKKGW89wfbxtD2fFQJAbF+vryrOUOUIfXlnqxJxpTIpRmH54XgQjREgQ2YwOPHM5alW2U34wRUIxCCjPrBC0HCzmGAoB+1+NSm5mIzH4QJAU/XRX1JTmVSfyL1qh4Xmor5CqLp/IryoObGbx1amKq/D7HXMD3J+WnYupIrrgROAyeK23GsoIWTGAP18pyqOZA== 2022-12-08 12:01:50.835 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Refresh and set keys, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCmKEJV3mbaJH2oW7yTVE1NiJWrXzMS8SnAlPUTiZVZm5Lb/00BUhwEhiOsVyihLHkAZRTfgmmyxpBoOZkFsAUmD5Gkc1b9tdgH/cImSbxnsdssxYE28miDmXthxJhqadHkdqOqMOAQictyWUHRiOFryzIFz0dUew/lSdZult/OoQIDAQAB 2022-12-08 12:01:53.190 INFO 42 --- [main,,] c.a.o.s.s.operator.LocalFileOperator : FileStorageService init, fileDirPath=/home/admin/data/files 2022-12-08 12:02:09.285 INFO 42 --- [main,,] com.alipay.ocp.core.util.BeanUtils : BeanUtils initialized 2022-12-08 12:02:17.072 INFO 42 --- [main,,] c.a.o.s.a.c.AlarmConfigurationManager : defaultTimeZone not set, use system default, zoneId=Asia/Shanghai 2022-12-08 12:02:19.563 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_daily, createTime=1670471712 2022-12-08 12:02:19.672 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_hour, createTime=1670471710 2022-12-08 12:02:19.769 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Init consumer, consumerInfo=ShardingConsumerEntity(id=2, module=metric-collect, name=192.168.28.62:8080-1, state=NEW, enabled=true, heartbeatTime=2022-12-08T12:02:17.269+08:00, createTime=null) 2022-12-08 12:02:19.777 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Init consumer, consumerInfo=ShardingConsumerEntity(id=1, module=metric-collect, name=192.168.28.62:8080-0, state=NEW, enabled=true, heartbeatTime=2022-12-08T12:02:17.269+08:00, createTime=null) 2022-12-08 12:02:19.783 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_second, createTime=1670471708 2022-12-08 12:02:30.976 INFO 42 --- [main,,] c.a.o.s.a.core.silence.GlobalSilencer : enabled alarm types changed, previous=, current=ob_server_sstable_percent_over_threshold,ob_host_task_timeout,ob_tenant_long_trans_exist,ob_host_net_send_percent_over_threshold,host_agent_goroutine_count_over_threshold,backup_storage_capacity_over_threshold,os_tsar_traffic_drop,tenant_active_memstore_percent_over_threshold,ob_host_data_disk_percent_over_threshold,os_tsar_cpu_util_full,tenant_cpu_percent_over_threshold,ob_tenant_exists_expired_xa_trans,monitor_exporter_unavaliable,ob_tenant_compaction_error,os_tsar_cpu_util_hwm,ob_cluster_exists_inactive_server,os_tsar_traffic_error,ob_host_load1_per_cpu_over_threshold,ob_cluster_operation_info,ob_cluster_frozen_version_delta_over_threshold,ob_cluster_merge_error,no_enough_exporter,backup_storage_capacity_timeout_or_interrupted,ob_tenant_large_trans_exist,inc_backup_delay,host_unavailable,ob_host_mem_percent_over_threshold,os_observer_not_exist,system_obproxy_unavailable,ocp_remote_server_time_diff_too_large,host_ntp_service_not_exist,ob_tenant_expired_trans_exist,host_disk_readonly,node_file_root_usage,os_kernel_io_hang,ob_tenant_task_timeout,same_alarm_rule_detect_too_many_targets,os_tsar_sda_ioawait,ob_log_alarm,os_tsar_traffic_overload,ob_cluster_sync_delay_time_too_long,os_tsar_nvme_ioawait,tenant_memstore_percent_over_threshold,ob_cluster_merge_timeout,ob_zone_sstable_percent_over_threshold,obproxy_cannot_connected,partition_create_failed,node_file_inode_usage,obproxy_process_dead,ob_cluster_rs_not_same,os_tsar_cpu_sys_abnormal,ob_cluster_exists_index_fail_table,ob_tenant_operation_info,host_ntp_offset_too_large,os_nic_1000m_hwm,ob_cluster_no_frozen,ob_host_cpu_percent_over_threshold,ob_cpu_percent_over_threshold,base_backup_too_long_time_no_one_success_task,oms_migrate_delay_over_threshold,vpc_connect_failed,ob_host_disk_readonly,ob_host_net_recv_percent_over_threshold,os_cpu_irq_error,ob_host_connection_percent_over_threshold,ob_cluster_status_check_failed,ocp_local_obproxy_proxyro_user_password_not_same,ob_tenant_no_compaction,host_agent_res_memory_over_threshold,host_agent_open_fd_count_over_threshold,ob_cluster_no_merge,backup_storage_capacity_retry_times_exceeded,obproxyd_process_dead,ob_tenant_log_disk_usage_high,ob_cluster_sync_failed,ob_tenant_no_frozen,ob_tenant500_mem_hold_over_threshold,os_observer_fd_usage,backup_process_dead,ob_cannot_connected,ob_host_tcp_retrans_percent_over_threshold,ob_host_log_disk_percent_over_threshold,ob_host_install_disk_percent_over_threshold,ic_server_connect_failed,os_nic_1000m_full,ob_tenant500_mem_hold_percent_over_threshold,base_backup_fail,os_observer_core_dump,ob_cluster_inspection_not_passed,obagent_dead,ob_host_partition_count_over_threshold 2022-12-08 12:02:34.137 INFO 42 --- [main,,] c.a.o.c.t.e.coordinator.TaskCoordinator : Start task coordinator 2022-12-08 12:02:41.158 INFO 42 --- [main,,] c.a.o.s.a.service.OcpAlarmSearchService : total load alarm history size: 0 2022-12-08 12:02:41.159 INFO 42 --- [main,,] c.a.o.s.a.service.OcpAlarmSearchService : init alarm search done 2022-12-08 12:02:48.838 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2022-12-08 12:02:49.123 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2022-12-08 12:02:49.209 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 12:02:49.242 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 12:02:50.130 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2022-12-08 12:02:50.273 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2022-12-08 12:02:50.293 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 12:02:50.299 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 12:02:50.302 INFO 42 --- [main,,] c.o.o.b.i.c.BackupConfiguration : init backup agent meta cfg 2022-12-08 12:02:50.447 INFO 42 --- [main,,] c.a.o.c.t.e.m.TaskDefinitionManagerImpl : Create task, req=CreateTaskRequest(name=Detect alarms on schedule, creatorId=200, groupId=2, scheduleType=SCHEDULE, scheduleRule=0 */1 * * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, templateName=BackupScheduleAlarmTemplateFactory, comments=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}, enable=true) 2022-12-08 12:02:51.073 INFO 42 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : Backup init, create system schedule task, task=TaskDefinition{id=1000002, name=Detect alarms on schedule, creatorId=200, templateName=BackupScheduleAlarmTemplateFactory, scheduleType=SCHEDULE, scheduleRule=0 */1 * * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, nextRunTime=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}}. 2022-12-08 12:02:51.082 INFO 42 --- [main,,] c.a.o.c.t.e.m.TaskDefinitionManagerImpl : Create task, req=CreateTaskRequest(name=Clean expired log files on schedule, creatorId=200, groupId=2, scheduleType=SCHEDULE, scheduleRule=0 0 0 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, templateName=BackupScheduleCleanLogTemplateFactory, comments=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}, enable=true) 2022-12-08 12:02:51.144 INFO 42 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : Backup init, create system schedule task, task=TaskDefinition{id=1000003, name=Clean expired log files on schedule, creatorId=200, templateName=BackupScheduleCleanLogTemplateFactory, scheduleType=SCHEDULE, scheduleRule=0 0 0 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, nextRunTime=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}}. 2022-12-08 12:02:51.372 INFO 42 --- [main,,] c.a.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key global_lock_com.oceanbase.ocp.backup.internal.task.backupocptaskmanager 2022-12-08 12:02:51.404 INFO 42 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : upgradeFromOldAgentToNewService start. 2022-12-08 12:02:51.446 INFO 42 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : serviceInfos=[], allMachineList=[] 2022-12-08 12:02:51.487 INFO 42 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : register backup schedules success 2022-12-08 12:02:57.443 INFO 42 --- [main,,] .a.o.s.m.c.MonitorDataRolloverProperties : Monitor retention conf is {ob_cluster_system_event=31, ocp_metric_data_1=8, ocp_metric_data_60=31, metric_hour_data=1098, metric_daily_data=1098} 2022-12-08 12:02:57.876 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Metadb, table=profile_credential_sharing 2022-12-08 12:02:57.877 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_cluster_system_event 2022-12-08 12:02:57.878 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_1 2022-12-08 12:02:57.879 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_60 2022-12-08 12:02:57.879 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_hour_data 2022-12-08 12:02:57.880 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_daily_data 2022-12-08 12:02:57.881 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_second 2022-12-08 12:02:57.881 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_minute 2022-12-08 12:02:57.882 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_hour 2022-12-08 12:02:57.883 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_daily 2022-12-08 12:02:57.883 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=sql_aggregate_data 2022-12-08 12:02:57.884 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_partition_stats_compressed 2022-12-08 12:02:57.885 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_tenant_mini_compaction_info 2022-12-08 12:02:57.885 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_0 2022-12-08 12:02:57.886 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_1 2022-12-08 12:02:57.887 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_2 2022-12-08 12:02:57.887 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat 2022-12-08 12:02:57.888 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sqltext 2022-12-08 12:02:57.888 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0 2022-12-08 12:02:57.889 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan 2022-12-08 12:02:57.889 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_explain 2022-12-08 12:02:57.890 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_sample 2022-12-08 12:02:57.890 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis_task 2022-12-08 12:02:57.891 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis 2022-12-08 12:02:57.892 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_active_session_stat_0 2022-12-08 12:02:57.892 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_snapshot 2022-12-08 12:02:57.893 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cluster 2022-12-08 12:02:57.893 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_tenant 2022-12-08 12:02:57.894 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_server 2022-12-08 12:02:57.894 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_replica 2022-12-08 12:02:57.894 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sysstat 2022-12-08 12:02:57.895 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_row_lock 2022-12-08 12:02:57.895 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_latch 2022-12-08 12:02:57.896 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cache 2022-12-08 12:02:57.897 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_parameter 2022-12-08 12:02:57.897 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_rpc 2022-12-08 12:02:57.898 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_packet 2022-12-08 12:02:57.903 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_clog 2022-12-08 12:02:57.904 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_location_cache 2022-12-08 12:02:57.905 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_gts 2022-12-08 12:02:57.905 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_system_event 2022-12-08 12:02:57.906 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_plan_monitor 2022-12-08 12:02:57.906 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_trans_stat_0 2022-12-08 12:02:57.927 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167004] Submitting initial worker 2022-12-08 12:02:58.091 INFO 42 --- [main,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService updater scheduler started on 192.168.28.62:8080 2022-12-08 12:02:58.136 INFO 42 --- [main,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : Init, apiConnectTimeoutMillis:1000, apiReadTimeoutMillis:1000, taskSchedulePeriodSec:3 2022-12-08 12:02:59.354 WARN 42 --- [pool-3-thread-1,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2022-12-08 12:02:59.355 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2022-12-08 12:03:00.012 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_minute, createTime=1670471710 2022-12-08 12:03:00.282 INFO 42 --- [main,,] c.o.o.b.i.m.s.StorageExporterServiceImpl : collectEnabled=true,periodMinutes=180, register backup exporter. 2022-12-08 12:03:00.297 INFO 42 --- [main,,] c.a.o.c.t.e.m.TaskDefinitionManagerImpl : Create task, req=CreateTaskRequest(name=Collect backup files size on schedule, creatorId=200, groupId=2, scheduleType=SCHEDULE, scheduleRule=0 0 */3 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, templateName=BackupScheduleCollectTemplateFactory, comments=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}, enable=true) 2022-12-08 12:03:00.405 INFO 42 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : Backup init, create system schedule task, task=TaskDefinition{id=1000004, name=Collect backup files size on schedule, creatorId=200, templateName=BackupScheduleCollectTemplateFactory, scheduleType=SCHEDULE, scheduleRule=0 0 */3 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, nextRunTime=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}}. 2022-12-08 12:03:00.730 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : scheduleEnabled=true 2022-12-08 12:03:00.935 INFO 42 --- [main,,] c.a.o.s.a.service.TaskRepositoryService : create task success, task=TaskInfo(id=1, uuid=1b5fa8db-4c8f-4f48-89fa-b7878569b70f, taskType=AlarmDetect, target=null, parameters=null, intervalSeconds=10, status=WAITING, executorName=192.168.28.62:42, createAt=null, startAt=null, endAt=null, heartbeatAt=null, result=null) 2022-12-08 12:03:00.936 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : create task done, taskType=AlarmDetect, expectCount=1, createCount=1 2022-12-08 12:03:00.951 INFO 42 --- [main,,] c.a.o.s.a.service.TaskRepositoryService : create task success, task=TaskInfo(id=2, uuid=5f13908a-dd7e-4807-b3e0-26648e685c4d, taskType=AlarmProcess, target=null, parameters=null, intervalSeconds=10, status=WAITING, executorName=192.168.28.62:42, createAt=null, startAt=null, endAt=null, heartbeatAt=null, result=null) 2022-12-08 12:03:00.951 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : create task done, taskType=AlarmProcess, expectCount=1, createCount=1 2022-12-08 12:03:00.952 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : initialize global tasks done 2022-12-08 12:03:00.952 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : initialize done 2022-12-08 12:03:02.395 WARN 42 --- [pool-3-thread-1,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:02.396 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2022-12-08 12:03:03.015 WARN 42 --- [main,,] JpaBaseConfiguration$JpaWebConfiguration : spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning 2022-12-08 12:03:03.098 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:03:03.120 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:03.200 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:03.209 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service MC_MANAGER, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:03.236 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:03:03.246 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PERF_SQL_ROLLUP, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:03.277 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:03:03.294 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service CMDB_SYNCER, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:03.317 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:03.328 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service TASK_MANAGER, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:03.352 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:03:03.361 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:03.388 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:03:03.399 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:03.425 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:03:03.444 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:05.106 INFO 42 --- [main,,] c.a.o.s.o.ob.ObMetricCollectService : ObMetricCollectService init, aggConfigList:[{"aggFunc":"max","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_cpu_percent","targetMetric":"ob_tenant_server_max_cpu_used_percentage"},{"aggFunc":"max","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_memory_percent","targetMetric":"ob_tenant_server_max_memory_used_percentage"},{"aggFunc":"avg","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_cpu_percent","targetMetric":"ob_tenant_server_avg_cpu_used_percentage"},{"aggFunc":"avg","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_memory_percent","targetMetric":"ob_tenant_server_avg_memory_used_percentage"}] 2022-12-08 12:03:05.449 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 gets the leadership... 2022-12-08 12:03:07.172 INFO 42 --- [main,,] .o.s.m.o.c.ClusterSystemEventServiceImpl : Init eventTemplateCache: 172 cache entries, 172 elements. 2022-12-08 12:03:07.402 INFO 42 --- [main,,] c.a.o.s.a.c.AlarmConfiguration : alarm configuration set from system properties 2022-12-08 12:03:07.625 INFO 42 --- [main,,] c.a.o.s.a.c.n.NotificationSender : NotificationSender init, scriptDirectoryPath=/home/admin/ocp-server/alarm-channel-script 2022-12-08 12:03:07.911 INFO 42 --- [main,,] c.a.o.s.a.c.d.metrics.AlarmMetricsQuery : createMetricMetaMapping done, metasCount=88 2022-12-08 12:03:08.450 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:08.516 INFO 42 --- [main,,] c.a.o.s.a.c.d.metrics.SqlMetricsQuery : createMetricMetaMapping done, metasCount=88 2022-12-08 12:03:08.562 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:11.563 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:11.578 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:13.236 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:13.334 INFO 42 --- [part-initial-worker,,] c.a.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2022-12-08 12:03:13.338 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2022-12-08 12:03:13.352 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:03:13.382 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:13.388 INFO 42 --- [main,,] c.a.o.s.alarm.schedule.AlarmSchedules : AlarmSchedules construct done 2022-12-08 12:03:13.402 INFO 42 --- [part-initial-worker,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=proxy, clusterName=obcluster, obClusterId=null, tenantName=meta_tenant, username=meta_user, address=192.168.28.54, port=2883, database=meta_database) 2022-12-08 12:03:13.403 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=meta_user, tenantName=meta_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=meta_database) 2022-12-08 12:03:13.481 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:03:13.498 INFO 42 --- [obsdk-init-thread-1,,3bb67fd06f22] com.alibaba.druid.pool.DruidDataSource : {dataSource-3,ob-connector-datasource_proxy_obcluster_null_meta_tenant_meta_user_192.168.28.54_2883} inited 2022-12-08 12:03:13.499 INFO 42 --- [obsdk-init-thread-1,,3bb67fd06f22] c.a.o.c.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=meta_user, tenantName=meta_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=meta_database) 2022-12-08 12:03:13.500 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2022-12-08 12:03:13.509 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:13.527 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:13.534 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 12:03:13.536 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize alarmDetectMetricExecutor 2022-12-08 12:03:13.540 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 'alarmDetectMetricExecutor' 2022-12-08 12:03:13.540 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:13.545 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2022-12-08 12:03:13.574 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:13.575 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:13.578 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:03:13.588 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:13.589 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:13.593 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2022-12-08 12:03:13.609 INFO 42 --- [main,,] o.s.s.concurrent.ThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 12:03:13.610 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize alarmTaskExecutor 2022-12-08 12:03:13.611 INFO 42 --- [main,,] o.s.s.concurrent.ThreadPoolTaskExecutor : Initializing ExecutorService 'alarmTaskExecutor' 2022-12-08 12:03:13.623 INFO 42 --- [main,,] c.a.o.s.a.utils.task.AlarmTaskManager : alarm task manager construct done, executorName=192.168.28.62:42 2022-12-08 12:03:13.692 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : OcpMonitorManager init start... 2022-12-08 12:03:13.703 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472240, interval=60 2022-12-08 12:03:13.707 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670475600, interval=3600 2022-12-08 12:03:13.712 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472240, interval=60 2022-12-08 12:03:13.715 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670475600, interval=3600 2022-12-08 12:03:13.725 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : OcpMonitorManager init success. 2022-12-08 12:03:13.849 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1669910400 2022-12-08 12:03:13.858 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:13.859 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:13.864 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 12:03:14.082 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 12:03:14.083 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize notificationSendExecutor 2022-12-08 12:03:14.085 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 'notificationSendExecutor' 2022-12-08 12:03:14.401 INFO 42 --- [main,,] c.a.o.s.dataclean.TableCleaningService : Successfully init all table cleaning configurations: {"cleanTaskInstance":{"batchIntervalMillis":0,"batchSize":0,"condition":"create_time <= date_sub(now(), interval 30 day) and type = \"SYS_SCHEDULED\"","priority":1,"tableName":"task_instance"},"cleanSubTaskInstance":{"batchIntervalMillis":0,"batchSize":0,"condition":"task_id in (select id from task_instance where create_time <= date_sub(now(), interval 30 day) and type = \"SYS_SCHEDULED\")","priority":0,"tableName":"subtask_instance"}} 2022-12-08 12:03:14.580 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:14.586 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:15.373 INFO 42 --- [main,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updater scheduler started on 192.168.28.62:8080 2022-12-08 12:03:15.713 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.print.sql = true 2022-12-08 12:03:15.716 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set sqlLogEnabled=true 2022-12-08 12:03:15.724 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.max-idle.seconds = 3600 2022-12-08 12:03:15.742 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set maxIdleSeconds=3600 2022-12-08 12:03:15.750 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.cleanup.period.seconds = 300 2022-12-08 12:03:15.750 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set cleanPeriod=300 2022-12-08 12:03:15.757 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.operation.global.timeout.millis = 300000 2022-12-08 12:03:15.757 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set ddlGlobalTimeoutMillis=300000 2022-12-08 12:03:15.765 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.timeout.millis = 3000 2022-12-08 12:03:15.770 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set initTimeoutMillis=3000 2022-12-08 12:03:15.777 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.slow.query.threshold.millis = 1000 2022-12-08 12:03:15.778 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set slowQueryThresholdMillis=1000 2022-12-08 12:03:15.785 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.holder.capacity = 100 2022-12-08 12:03:15.793 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set cacheSize=100 2022-12-08 12:03:15.801 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.read.timeout.millis = 1800000 2022-12-08 12:03:15.802 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketReadTimeoutMillis=1800000 2022-12-08 12:03:15.809 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.executor.thread-count = 16 2022-12-08 12:03:15.811 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketInitThreadCount=16 2022-12-08 12:03:15.819 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.connect.timeout.millis = 2000 2022-12-08 12:03:15.820 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketConnectTimeoutMillis=2000 2022-12-08 12:03:15.896 INFO 42 --- [main,,] c.a.o.service.maz.OcpAzoneDaemonService : Multi azone daemon not enabled 2022-12-08 12:03:16.133 INFO 42 --- [main,,] c.a.o.s.s.BuiltInFilesInitializeLoader : Load lib files, localBuiltInDir=/home/admin/ocp-server/lib 2022-12-08 12:03:16.135 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Remove built-in file:pos.py 2022-12-08 12:03:16.354 ERROR 42 --- [main,,] com.alipay.ocp.core.util.ExceptionUtils : Checked Exception: com.alipay.ocp.core.exception.IllegalArgumentException occurred with code error.file.meta.not.found, and args [built-in, pos.py] 2022-12-08 12:03:16.355 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Script:pos.py not exist. 2022-12-08 12:03:16.359 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Load built-in file:pos.py 2022-12-08 12:03:16.685 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2822, sql=alter table `profile_credential_sharing` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 12:03:16.711 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:16.712 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:16.716 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 12:03:16.943 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1669996800 2022-12-08 12:03:16.948 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:16.949 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:16.952 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 12:03:17.051 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=built-in, name=pos.py, objectId=1 2022-12-08 12:03:17.588 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:17.596 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:17.613 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:17.614 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:17.618 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 12:03:17.639 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670083200 2022-12-08 12:03:17.645 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:17.646 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:17.653 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 12:03:17.744 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=1, name=pos.py 2022-12-08 12:03:17.745 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Remove built-in file:obproxyd.sh 2022-12-08 12:03:17.771 ERROR 42 --- [main,,] com.alipay.ocp.core.util.ExceptionUtils : Checked Exception: com.alipay.ocp.core.exception.IllegalArgumentException occurred with code error.file.meta.not.found, and args [built-in, obproxyd.sh] 2022-12-08 12:03:17.772 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Script:obproxyd.sh not exist. 2022-12-08 12:03:17.774 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Load built-in file:obproxyd.sh 2022-12-08 12:03:17.979 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=built-in, name=obproxyd.sh, objectId=2 2022-12-08 12:03:18.277 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:03:18.357 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:18.358 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:18.361 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 12:03:18.376 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670169600 2022-12-08 12:03:18.380 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:18.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:18.386 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 12:03:18.899 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=2, name=obproxyd.sh 2022-12-08 12:03:18.970 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:libaio-0.3.112-1.el8.x86_64.rpm 2022-12-08 12:03:19.745 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=sys-package, name=libaio-0.3.112-1.el8.x86_64.rpm, objectId=3 2022-12-08 12:03:19.905 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1519, sql=alter table `profile_credential_sharing` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 12:03:19.911 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:19.912 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:19.915 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 12:03:19.929 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670256000 2022-12-08 12:03:19.933 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:19.934 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:19.938 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 12:03:20.376 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:03:20.597 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:20.687 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=3, name=libaio-0.3.112-1.el8.x86_64.rpm 2022-12-08 12:03:20.688 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:20.966 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:t-oceanbase-ocp-agent-4.0.0-20221104145832.alios7.aarch64.rpm 2022-12-08 12:03:21.222 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1284, sql=alter table `profile_credential_sharing` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 12:03:21.226 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:21.227 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:21.230 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 12:03:21.245 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670342400 2022-12-08 12:03:21.249 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:21.249 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:21.252 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 12:03:21.266 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=sys-package, name=t-oceanbase-ocp-agent-4.0.0-20221104145832.alios7.aarch64.rpm, objectId=4 2022-12-08 12:03:21.764 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:21.765 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:21.770 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 12:03:21.788 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670428800 2022-12-08 12:03:21.792 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:21.793 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:21.797 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 12:03:22.738 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:22.740 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:22.750 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 12:03:22.785 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670515200 2022-12-08 12:03:22.790 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:22.791 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:22.799 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 12:03:23.352 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:23.426 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:03:23.482 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:23.689 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:23.697 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:23.791 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:03:24.014 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1215, sql=alter table `profile_credential_sharing` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 12:03:24.018 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:24.019 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:24.023 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 12:03:24.042 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670601600 2022-12-08 12:03:24.046 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:24.047 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:24.050 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 12:03:24.740 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:24.741 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:24.746 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 12:03:24.765 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670688000 2022-12-08 12:03:24.769 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:24.770 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:24.773 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 12:03:25.373 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:25.374 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:25.380 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 12:03:25.408 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2022-12-08 12:03:25.409 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2022-12-08 12:03:25.410 INFO 42 --- [part-initial-worker,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=proxy, clusterName=obcluster, obClusterId=null, tenantName=monitor_tenant, username=monitor_user, address=192.168.28.54, port=2883, database=monitor_database) 2022-12-08 12:03:25.410 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=monitor_user, tenantName=monitor_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=monitor_database) 2022-12-08 12:03:25.479 INFO 42 --- [obsdk-init-thread-2,,1d917f0fd8ea] com.alibaba.druid.pool.DruidDataSource : {dataSource-4,ob-connector-datasource_proxy_obcluster_null_monitor_tenant_monitor_user_192.168.28.54_2883} inited 2022-12-08 12:03:25.481 INFO 42 --- [obsdk-init-thread-2,,1d917f0fd8ea] c.a.o.c.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=monitor_user, tenantName=monitor_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=monitor_database) 2022-12-08 12:03:25.482 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2022-12-08 12:03:25.483 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:25.487 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:25.488 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:25.493 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2022-12-08 12:03:25.508 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:25.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:25.515 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:03:25.526 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:25.527 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:25.531 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2022-12-08 12:03:25.780 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1667836800000000 2022-12-08 12:03:25.792 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:25.793 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:25.799 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1667836800000000 values less than (1667836800000000)) 2022-12-08 12:03:26.698 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:26.705 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:27.075 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1276, sql=alter table `ob_cluster_system_event` add partition(partition p1667836800000000 values less than (1667836800000000)) 2022-12-08 12:03:27.080 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:27.081 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:27.084 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:27.259 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1667923200000000 2022-12-08 12:03:27.263 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:27.264 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:27.268 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1667923200000000 values less than (1667923200000000)) 2022-12-08 12:03:28.156 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:28.157 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:28.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:28.175 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668009600000000 2022-12-08 12:03:28.179 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:28.180 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:28.185 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668009600000000 values less than (1668009600000000)) 2022-12-08 12:03:28.778 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:28.779 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:28.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:28.798 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668096000000000 2022-12-08 12:03:28.803 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:28.803 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:28.806 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668096000000000 values less than (1668096000000000)) 2022-12-08 12:03:28.959 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=4, name=t-oceanbase-ocp-agent-4.0.0-20221104145832.alios7.aarch64.rpm 2022-12-08 12:03:29.002 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:t-oceanbase-ocp-agent-4.0.0-20221104150026.alios7.x86_64.rpm 2022-12-08 12:03:29.249 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=sys-package, name=t-oceanbase-ocp-agent-4.0.0-20221104150026.alios7.x86_64.rpm, objectId=5 2022-12-08 12:03:29.383 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:29.383 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:29.387 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:29.405 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668182400000000 2022-12-08 12:03:29.410 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:29.410 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:29.414 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668182400000000 values less than (1668182400000000)) 2022-12-08 12:03:29.706 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:29.716 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:30.413 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:30.414 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:30.418 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:30.433 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668268800000000 2022-12-08 12:03:30.437 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:30.437 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:30.442 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668268800000000 values less than (1668268800000000)) 2022-12-08 12:03:30.868 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:03:31.146 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:31.147 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:31.151 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:31.173 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668355200000000 2022-12-08 12:03:31.178 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:31.179 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:31.183 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668355200000000 values less than (1668355200000000)) 2022-12-08 12:03:31.898 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:31.900 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:31.903 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:31.918 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668441600000000 2022-12-08 12:03:31.925 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:31.925 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:31.928 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668441600000000 values less than (1668441600000000)) 2022-12-08 12:03:32.718 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:33.200 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:03:34.425 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:34.530 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2602, sql=alter table `ob_cluster_system_event` add partition(partition p1668441600000000 values less than (1668441600000000)) 2022-12-08 12:03:34.535 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:34.536 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:34.541 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:34.558 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668528000000000 2022-12-08 12:03:34.562 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:34.562 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:34.564 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:03+08:00, updateTime=2022-12-08T12:03:03+08:00, expireTime=null, isLeader=false} 2022-12-08 12:03:34.565 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668528000000000 values less than (1668528000000000)) 2022-12-08 12:03:34.676 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:03+08:00, updateTime=2022-12-08T12:03:03+08:00, expireTime=null, isLeader=false} 2022-12-08 12:03:34.714 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:03+08:00, updateTime=2022-12-08T12:03:03+08:00, expireTime=null, isLeader=false} 2022-12-08 12:03:34.766 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:34.845 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:03:34.860 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:34.931 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:35.067 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:03:35.097 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:03:35.117 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:03:35.182 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:03:35.211 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:35.212 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:35.216 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:35.234 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668614400000000 2022-12-08 12:03:35.240 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:35.241 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:35.244 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668614400000000 values less than (1668614400000000)) 2022-12-08 12:03:35.279 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:35.338 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:03:36.711 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1467, sql=alter table `ob_cluster_system_event` add partition(partition p1668614400000000 values less than (1668614400000000)) 2022-12-08 12:03:36.715 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:36.716 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:36.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:36.739 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668700800000000 2022-12-08 12:03:36.742 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:36.743 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:36.746 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668700800000000 values less than (1668700800000000)) 2022-12-08 12:03:37.481 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:37.487 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:38.288 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1541, sql=alter table `ob_cluster_system_event` add partition(partition p1668700800000000 values less than (1668700800000000)) 2022-12-08 12:03:38.292 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:38.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:38.299 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:38.314 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668787200000000 2022-12-08 12:03:38.318 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:38.319 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:38.323 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668787200000000 values less than (1668787200000000)) 2022-12-08 12:03:40.370 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2047, sql=alter table `ob_cluster_system_event` add partition(partition p1668787200000000 values less than (1668787200000000)) 2022-12-08 12:03:40.376 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:40.377 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:40.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:40.409 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668873600000000 2022-12-08 12:03:40.415 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:40.416 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:40.422 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668873600000000 values less than (1668873600000000)) 2022-12-08 12:03:40.487 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:40.494 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:40.971 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:03:41.078 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:03:40.0, currentDate=Thu Dec 08 12:03:41 CST 2022 2022-12-08 12:03:41.079 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=null, nextRunTime=2022-12-08 12:03:40.0} 2022-12-08 12:03:41.626 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1204, sql=alter table `ob_cluster_system_event` add partition(partition p1668873600000000 values less than (1668873600000000)) 2022-12-08 12:03:41.630 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:41.631 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:41.634 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:41.646 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668960000000000 2022-12-08 12:03:41.650 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:41.651 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:41.654 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668960000000000 values less than (1668960000000000)) 2022-12-08 12:03:42.405 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:42.406 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:42.409 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:42.428 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669046400000000 2022-12-08 12:03:42.433 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:42.433 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:42.439 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669046400000000 values less than (1669046400000000)) 2022-12-08 12:03:43.495 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:44.322 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:44.499 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2060, sql=alter table `ob_cluster_system_event` add partition(partition p1669046400000000 values less than (1669046400000000)) 2022-12-08 12:03:44.504 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:44.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:44.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:44.527 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669132800000000 2022-12-08 12:03:44.533 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:44.534 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:44.538 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669132800000000 values less than (1669132800000000)) 2022-12-08 12:03:45.067 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:46.203 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1665, sql=alter table `ob_cluster_system_event` add partition(partition p1669132800000000 values less than (1669132800000000)) 2022-12-08 12:03:46.208 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:46.209 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:46.212 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:46.227 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669219200000000 2022-12-08 12:03:46.232 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:46.233 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:46.236 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669219200000000 values less than (1669219200000000)) 2022-12-08 12:03:47.324 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:47.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1258, sql=alter table `ob_cluster_system_event` add partition(partition p1669219200000000 values less than (1669219200000000)) 2022-12-08 12:03:47.498 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:47.499 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:47.503 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:47.515 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669305600000000 2022-12-08 12:03:47.521 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:47.521 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:47.525 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669305600000000 values less than (1669305600000000)) 2022-12-08 12:03:48.331 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:48.855 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:03:48.865 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:03:48.866 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:03:48.896 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:03:49.006 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:49.162 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:03:49.668 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2143, sql=alter table `ob_cluster_system_event` add partition(partition p1669305600000000 values less than (1669305600000000)) 2022-12-08 12:03:49.673 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:49.674 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:49.678 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:49.696 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669392000000000 2022-12-08 12:03:49.700 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:49.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:49.704 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669392000000000 values less than (1669392000000000)) 2022-12-08 12:03:50.279 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:03:50.624 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:50.625 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:50.628 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:50.647 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669478400000000 2022-12-08 12:03:50.650 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:50.651 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:50.654 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669478400000000 values less than (1669478400000000)) 2022-12-08 12:03:51.226 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:03:51.273 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:51.274 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:51.277 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:51.290 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669564800000000 2022-12-08 12:03:51.293 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:51.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:51.296 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669564800000000 values less than (1669564800000000)) 2022-12-08 12:03:51.333 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:51.338 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:51.911 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:51.912 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:51.915 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:51.926 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669651200000000 2022-12-08 12:03:51.930 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:51.930 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:51.933 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669651200000000 values less than (1669651200000000)) 2022-12-08 12:03:52.517 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:03:41.0, nextRun=2022-12-08 12:03:45.0, currentDate=Thu Dec 08 12:03:52 CST 2022 2022-12-08 12:03:52.519 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 12:03:41.0, nextRunTime=2022-12-08 12:03:45.0} 2022-12-08 12:03:52.547 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:52.547 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:52.551 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:52.560 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:03:52.561 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:03:52.561 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:03:52.569 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669737600000000 2022-12-08 12:03:52.576 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:52.577 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:52.581 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669737600000000 values less than (1669737600000000)) 2022-12-08 12:03:52.735 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=5, name=t-oceanbase-ocp-agent-4.0.0-20221104150026.alios7.x86_64.rpm 2022-12-08 12:03:53.286 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:53.286 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:53.290 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:53.306 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669824000000000 2022-12-08 12:03:53.311 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:53.311 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:53.315 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669824000000000 values less than (1669824000000000)) 2022-12-08 12:03:53.874 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:53.875 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:53.889 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:53.909 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669910400000000 2022-12-08 12:03:53.916 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:53.917 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:53.926 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669910400000000 values less than (1669910400000000)) 2022-12-08 12:03:54.134 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.performance.ash.scheduled.ObWaitEventSyncSchedule, newAction=com.oceanbase.ocp.perf.ash.internal.scheduled.ObWaitEventSyncSchedule 2022-12-08 12:03:54.267 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.scheduled.CollectClusterSnapshotSchedule, newAction=com.oceanbase.ocp.perf.sql.diag.internal.CollectClusterSnapshotSchedule 2022-12-08 12:03:54.339 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:54.345 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:54.618 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:54.619 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:54.622 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:54.638 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669996800000000 2022-12-08 12:03:54.642 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:54.642 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:54.645 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669996800000000 values less than (1669996800000000)) 2022-12-08 12:03:55.307 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.inspection.BuiltinOracleSequenceInspectionTemplate, newAction=com.oceanbase.ocp.inspection.internal.task.BuiltinOracleSequenceInspectionTemplate 2022-12-08 12:03:55.346 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:03:53.0, nextRun=2022-12-08 12:03:55.0, currentDate=Thu Dec 08 12:03:55 CST 2022 2022-12-08 12:03:55.347 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 12:03:53.0, nextRunTime=2022-12-08 12:03:55.0} 2022-12-08 12:03:55.370 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.inspection.BuiltinMysqlSequenceInspectionTemplate, newAction=com.oceanbase.ocp.inspection.internal.task.BuiltinMysqlSequenceInspectionTemplate 2022-12-08 12:03:55.394 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:03:55.395 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:03:55.395 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:03:55.424 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:55.425 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:55.432 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:55.446 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670083200000000 2022-12-08 12:03:55.450 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:55.450 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:55.449 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.inspection.BuiltinClusterPartitionInspectionTemplate, newAction=com.oceanbase.ocp.inspection.internal.task.BuiltinClusterPartitionInspectionTemplate 2022-12-08 12:03:55.453 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670083200000000 values less than (1670083200000000)) 2022-12-08 12:03:55.561 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupSchedulePhysicalTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupSchedulePhysicalTemplateFactory 2022-12-08 12:03:55.631 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupSchedulePhysicalLogSecondaryTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupSchedulePhysicalLogSecondaryTemplateFactory 2022-12-08 12:03:55.681 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupScheduleLogicalTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupScheduleLogicalTemplateFactory 2022-12-08 12:03:55.746 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupScheduleAlarmTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupScheduleAlarmTemplateFactory 2022-12-08 12:03:55.802 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupScheduleCleanDataTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupScheduleCleanDataTemplateFactory 2022-12-08 12:03:56.180 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupScheduleSamplingInspectTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupScheduleSamplingInspectTemplateFactory 2022-12-08 12:03:56.294 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupScheduleCleanLogTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupScheduleCleanLogTemplateFactory 2022-12-08 12:03:56.381 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupSchedulePhysicalDataWithSecondaryTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupSchedulePhysicalDataWithSecondaryTemplateFactory 2022-12-08 12:03:56.581 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1128, sql=alter table `ob_cluster_system_event` add partition(partition p1670083200000000 values less than (1670083200000000)) 2022-12-08 12:03:56.586 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:56.587 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:56.591 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:56.612 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670169600000000 2022-12-08 12:03:56.616 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:56.617 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:56.620 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670169600000000 values less than (1670169600000000)) 2022-12-08 12:03:56.624 INFO 42 --- [main,,] f.a.AutowiredAnnotationBeanPostProcessor : Autowired annotation is not supported on static methods: public static void com.alipay.ocp.core.util.jpa.JsonNodeConverter.init(com.fasterxml.jackson.databind.ObjectMapper) 2022-12-08 12:03:57.321 INFO 42 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup daemon submitted 2022-12-08 12:03:57.346 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:03:57.434 INFO 42 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup workers submitted 2022-12-08 12:03:57.441 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:03:57.443 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:57.443 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:57.446 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:57.466 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670256000000000 2022-12-08 12:03:57.470 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:57.470 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:57.477 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670256000000000 values less than (1670256000000000)) 2022-12-08 12:03:58.314 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:58.315 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:58.318 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:58.334 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670342400000000 2022-12-08 12:03:58.338 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:58.338 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:58.341 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670342400000000 values less than (1670342400000000)) 2022-12-08 12:03:58.896 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:58.943 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:58.944 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:58.947 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:03:58.960 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670428800000000 2022-12-08 12:03:58.963 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:03:58.964 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:03:58.967 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670428800000000 values less than (1670428800000000)) 2022-12-08 12:03:59.195 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:03:59.300 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:03:59.626 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:04:00.126 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1159, sql=alter table `ob_cluster_system_event` add partition(partition p1670428800000000 values less than (1670428800000000)) 2022-12-08 12:04:00.131 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:00.131 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:00.135 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:04:00.147 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670515200000000 2022-12-08 12:04:00.153 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:00.153 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:00.156 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670515200000000 values less than (1670515200000000)) 2022-12-08 12:04:00.442 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:00.455 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:01.285 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:04:02.114 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:04:00.0, currentDate=Thu Dec 08 12:04:02 CST 2022 2022-12-08 12:04:02.115 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=null, nextRunTime=2022-12-08 12:04:00.0} 2022-12-08 12:04:02.266 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 12:04:02.398 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:03:55.0, nextRun=2022-12-08 12:04:00.0, currentDate=Thu Dec 08 12:04:02 CST 2022 2022-12-08 12:04:02.398 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 12:03:55.0, nextRunTime=2022-12-08 12:04:00.0} 2022-12-08 12:04:02.432 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:04:02.432 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:02.433 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:02.479 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2323, sql=alter table `ob_cluster_system_event` add partition(partition p1670515200000000 values less than (1670515200000000)) 2022-12-08 12:04:02.483 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:02.483 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:02.487 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:04:02.498 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670601600000000 2022-12-08 12:04:02.504 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:02.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:02.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670601600000000 values less than (1670601600000000)) 2022-12-08 12:04:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,85764ccc2711] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472300, interval=60 2022-12-08 12:04:02.711 INFO 42 --- [pool-prometheus-minute-schedule-2,,85764ccc2711] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472242, count=0, elapsed=1668801770469 2022-12-08 12:04:02.713 INFO 42 --- [pool-prometheus-minute-schedule-1,,06e1e516110b] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472300, interval=60 2022-12-08 12:04:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,06e1e516110b] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472242, count=0, elapsed=1668801770472 2022-12-08 12:04:02.728 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:04:00.0, currentDate=Thu Dec 08 12:04:02 CST 2022 2022-12-08 12:04:02.729 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:04:00.0} 2022-12-08 12:04:02.756 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:04:02.757 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:02.757 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:02.875 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:04:00.0, currentDate=Thu Dec 08 12:04:02 CST 2022 2022-12-08 12:04:02.878 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:04:00.0} 2022-12-08 12:04:03.097 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:04:03.098 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:03.099 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:03.181 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:04:00.0, currentDate=Thu Dec 08 12:04:03 CST 2022 2022-12-08 12:04:03.182 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:04:00.0} 2022-12-08 12:04:03.213 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:04:03.214 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:03.214 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:03.294 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:04:00.0, currentDate=Thu Dec 08 12:04:03 CST 2022 2022-12-08 12:04:03.295 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=null, nextRunTime=2022-12-08 12:04:00.0} 2022-12-08 12:04:03.323 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:04:03.323 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:03.324 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:03.421 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:04:00.0, currentDate=Thu Dec 08 12:04:03 CST 2022 2022-12-08 12:04:03.422 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:04:00.0} 2022-12-08 12:04:03.456 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:03.463 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:03.589 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1080, sql=alter table `ob_cluster_system_event` add partition(partition p1670601600000000 values less than (1670601600000000)) 2022-12-08 12:04:03.593 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:03.593 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:03.596 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:04:03.610 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670688000000000 2022-12-08 12:04:03.614 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:03.614 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:03.624 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670688000000000 values less than (1670688000000000)) 2022-12-08 12:04:04.301 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:04.302 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:04.305 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 12:04:04.322 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:04.323 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:04.326 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:04:04.337 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:04.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:04.341 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2022-12-08 12:04:04.452 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1669824000 2022-12-08 12:04:04.456 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:04.456 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:04.459 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1669824000 values less than (1669824000)) 2022-12-08 12:04:04.939 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:04:04.942 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:04.942 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:04.946 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:04.965 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1669910400 2022-12-08 12:04:04.971 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:04.972 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:04.977 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:04:04.979 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 12:04:05.349 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:04:05.420 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:04:05.699 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:05.700 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:05.704 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:05.720 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1669996800 2022-12-08 12:04:05.725 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:05.725 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:05.731 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 12:04:05.893 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:04:05.898 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:05.898 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:05.916 INFO 42 --- [main,,] c.a.o.core.sharding.ShardingCoordinator : Sharding registry started, module=metric-collect 2022-12-08 12:04:06.464 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:06.470 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:06.562 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:06.563 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:06.566 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:06.583 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670083200 2022-12-08 12:04:06.587 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:06.587 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:06.591 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 12:04:07.247 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:04:05.0, currentDate=Thu Dec 08 12:04:07 CST 2022 2022-12-08 12:04:07.248 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:04:05.0} 2022-12-08 12:04:07.279 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:04:07.280 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:07.280 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:07.390 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:07.390 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:07.393 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:07.408 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670169600 2022-12-08 12:04:07.412 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:07.412 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:07.415 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 12:04:07.434 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:02.0, nextRun=2022-12-08 12:04:05.0, currentDate=Thu Dec 08 12:04:07 CST 2022 2022-12-08 12:04:07.435 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 12:04:02.0, nextRunTime=2022-12-08 12:04:05.0} 2022-12-08 12:04:07.458 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:04:07.459 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:07.459 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:08.501 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1086, sql=alter table `ocp_metric_data_1` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 12:04:08.507 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:08.507 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:08.512 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:08.533 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670256000 2022-12-08 12:04:08.540 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:08.541 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:08.545 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 12:04:09.003 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:09.004 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:09.015 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:09.034 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670342400 2022-12-08 12:04:09.038 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:09.039 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:09.042 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 12:04:09.195 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:09.300 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:04:09.470 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:09.476 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:09.507 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:09.508 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:09.511 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:09.544 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670428800 2022-12-08 12:04:09.548 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:09.548 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:09.551 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 12:04:09.626 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:09.669 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:04:09.865 INFO 42 --- [main,,] c.a.o.c.t.engine.util.ThreadPrintStream : replaceSystemOut done 2022-12-08 12:04:09.875 INFO 42 --- [main,,] c.a.o.c.t.e.c.SubtaskCoordinator : Start subtask coordinator 2022-12-08 12:04:10.329 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:10.329 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:10.332 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:10.346 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670515200 2022-12-08 12:04:10.350 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:10.351 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:10.354 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 12:04:11.070 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:07.0, nextRun=2022-12-08 12:04:10.0, currentDate=Thu Dec 08 12:04:11 CST 2022 2022-12-08 12:04:11.071 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 12:04:07.0, nextRunTime=2022-12-08 12:04:10.0} 2022-12-08 12:04:11.093 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:04:11.093 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:11.093 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:11.104 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:11.104 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:11.109 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:11.125 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670601600 2022-12-08 12:04:11.129 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:11.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:11.140 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 12:04:11.647 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:04:11.661 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:04:11.826 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:11.826 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:11.829 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:11.841 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670688000 2022-12-08 12:04:11.845 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:11.845 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:11.849 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 12:04:11.883 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:04:12.285 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:12.286 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:12.291 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 12:04:12.313 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:12.314 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:12.317 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:04:12.323 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:12.323 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:12.327 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2022-12-08 12:04:12.359 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1667836800 2022-12-08 12:04:12.363 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:12.364 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:12.368 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1667836800 values less than (1667836800)) 2022-12-08 12:04:12.477 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:12.482 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:13.117 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:13.118 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:13.122 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:13.143 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1667923200 2022-12-08 12:04:13.150 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:13.151 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:13.158 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1667923200 values less than (1667923200)) 2022-12-08 12:04:13.709 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:13.710 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:13.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:13.734 INFO 42 --- [pool-prometheus-cache-monitor1,,4355174d5454] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:04:13.735 INFO 42 --- [pool-prometheus-cache-monitor1,,4355174d5454] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:04:13.741 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668009600 2022-12-08 12:04:13.752 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:13.753 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:13.756 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668009600 values less than (1668009600)) 2022-12-08 12:04:14.274 INFO 42 --- [pool-heartbeat-task-192.168.28.62:80801,,] c.a.o.c.s.registry.ConsumerRegistry : Init consumer, consumerInfo=ShardingConsumerEntity(id=3, module=task, name=192.168.28.62:8080, state=NEW, enabled=true, heartbeatTime=2022-12-08T12:04:14.139+08:00, createTime=null) 2022-12-08 12:04:14.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:14.556 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:14.843 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:04:15.002 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1246, sql=alter table `ocp_metric_data_60` add partition(partition p1668009600 values less than (1668009600)) 2022-12-08 12:04:15.007 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:15.007 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:15.011 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:15.027 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668096000 2022-12-08 12:04:15.031 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:15.031 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:15.035 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668096000 values less than (1668096000)) 2022-12-08 12:04:15.489 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:15.496 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:15.925 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:15.926 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:15.939 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:15.963 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668182400 2022-12-08 12:04:15.976 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:15.977 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:15.989 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668182400 values less than (1668182400)) 2022-12-08 12:04:16.875 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:16.875 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:16.888 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:16.927 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668268800 2022-12-08 12:04:16.941 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:16.942 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:16.955 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668268800 values less than (1668268800)) 2022-12-08 12:04:17.008 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:11.0, nextRun=2022-12-08 12:04:15.0, currentDate=Thu Dec 08 12:04:17 CST 2022 2022-12-08 12:04:17.009 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 12:04:11.0, nextRunTime=2022-12-08 12:04:15.0} 2022-12-08 12:04:17.049 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:04:17.049 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:17.050 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:17.373 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:17.374 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:17.390 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:17.408 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668355200 2022-12-08 12:04:17.412 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:17.412 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:17.417 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668355200 values less than (1668355200)) 2022-12-08 12:04:17.676 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:17.677 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:17.678 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:17.678 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:17.971 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:17.972 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:17.986 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:18.003 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668441600 2022-12-08 12:04:18.012 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:18.013 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:18.022 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668441600 values less than (1668441600)) 2022-12-08 12:04:18.618 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:18.632 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:18.632 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:18.632 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:18.635 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:18.658 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668528000 2022-12-08 12:04:18.672 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:18.673 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:18.685 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668528000 values less than (1668528000)) 2022-12-08 12:04:19.215 INFO 42 --- [main,,] o.s.b.a.w.s.WelcomePageHandlerMapping : Adding welcome page: class path resource [static/index.html] 2022-12-08 12:04:19.238 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:19.239 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:19.242 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:19.256 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668614400 2022-12-08 12:04:19.256 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:19.264 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:19.265 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:19.274 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668614400 values less than (1668614400)) 2022-12-08 12:04:19.329 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:04:19.656 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:19.665 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:19.665 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:19.684 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:19.698 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668700800 2022-12-08 12:04:19.703 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:19.703 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:19.717 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668700800 values less than (1668700800)) 2022-12-08 12:04:19.979 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:04:20.065 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:20.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:20.069 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:20.081 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668787200 2022-12-08 12:04:20.087 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:20.088 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:20.091 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668787200 values less than (1668787200)) 2022-12-08 12:04:20.127 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:04:20.131 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:04:20.148 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:04:20.0, currentDate=Thu Dec 08 12:04:20 CST 2022 2022-12-08 12:04:20.149 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:04:20.0} 2022-12-08 12:04:20.169 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:04:20.170 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:20.170 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:20.284 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:17.0, nextRun=2022-12-08 12:04:20.0, currentDate=Thu Dec 08 12:04:20 CST 2022 2022-12-08 12:04:20.285 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 12:04:17.0, nextRunTime=2022-12-08 12:04:20.0} 2022-12-08 12:04:20.292 WARN 42 --- [main,,] ion$DefaultTemplateResolverConfiguration : Cannot find template location: classpath:/templates/ (please add some templates or check your Thymeleaf configuration) 2022-12-08 12:04:20.301 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:04:20.302 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:20.302 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:20.446 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:04:20.797 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:20.800 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:20.836 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:20.836 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:20.839 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:20.850 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668873600 2022-12-08 12:04:20.853 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:20.854 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:20.856 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668873600 values less than (1668873600)) 2022-12-08 12:04:21.168 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:21.169 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:21.175 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:21.183 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668960000 2022-12-08 12:04:21.186 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:21.186 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:21.198 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668960000 values less than (1668960000)) 2022-12-08 12:04:21.464 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:04:21.534 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:21.534 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:21.537 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:21.545 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669046400 2022-12-08 12:04:21.549 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:21.549 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:21.552 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669046400 values less than (1669046400)) 2022-12-08 12:04:21.632 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:21.640 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:21.867 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:21.867 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:21.870 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:21.879 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669132800 2022-12-08 12:04:21.882 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:21.882 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:21.885 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669132800 values less than (1669132800)) 2022-12-08 12:04:21.921 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:04:22.502 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:22.503 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:22.506 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:22.514 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669219200 2022-12-08 12:04:22.517 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:22.518 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:22.521 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669219200 values less than (1669219200)) 2022-12-08 12:04:23.151 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:23.151 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:23.154 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:23.169 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669305600 2022-12-08 12:04:23.175 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:23.176 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:23.178 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669305600 values less than (1669305600)) 2022-12-08 12:04:23.861 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:23.861 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:23.899 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:23.900 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:24.075 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:24.077 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:24.081 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:24.096 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669392000 2022-12-08 12:04:24.103 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:24.103 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:24.106 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669392000 values less than (1669392000)) 2022-12-08 12:04:24.641 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:24.655 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:25.091 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:04:25.0, currentDate=Thu Dec 08 12:04:25 CST 2022 2022-12-08 12:04:25.093 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:04:25.0} 2022-12-08 12:04:25.186 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1080, sql=alter table `ocp_metric_data_60` add partition(partition p1669392000 values less than (1669392000)) 2022-12-08 12:04:25.201 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:25.202 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:25.207 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:25.218 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669478400 2022-12-08 12:04:25.225 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:25.225 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:25.229 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669478400 values less than (1669478400)) 2022-12-08 12:04:25.580 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:04:25.580 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:25.581 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:26.223 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:20.0, nextRun=2022-12-08 12:04:25.0, currentDate=Thu Dec 08 12:04:26 CST 2022 2022-12-08 12:04:26.224 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 12:04:20.0, nextRunTime=2022-12-08 12:04:25.0} 2022-12-08 12:04:26.248 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:04:26.249 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:26.249 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:26.646 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:04:26.651 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1422, sql=alter table `ocp_metric_data_60` add partition(partition p1669478400 values less than (1669478400)) 2022-12-08 12:04:26.654 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:04:26.656 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:26.656 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:26.660 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:26.682 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669564800 2022-12-08 12:04:26.685 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:26.686 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:26.689 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669564800 values less than (1669564800)) 2022-12-08 12:04:27.007 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:27.007 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:27.144 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:27.145 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:27.148 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:27.167 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669651200 2022-12-08 12:04:27.171 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:27.172 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:27.175 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669651200 values less than (1669651200)) 2022-12-08 12:04:27.255 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:04:27.324 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 12:04:27.359 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=34ms, period=120000ms 2022-12-08 12:04:27.661 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:27.668 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:27.693 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:27.694 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:27.697 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:27.709 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669737600 2022-12-08 12:04:27.714 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:27.714 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:27.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669737600 values less than (1669737600)) 2022-12-08 12:04:28.424 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:28.425 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:28.430 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:28.447 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669824000 2022-12-08 12:04:28.451 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:28.452 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:28.456 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669824000 values less than (1669824000)) 2022-12-08 12:04:28.957 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:28.958 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:28.961 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:28.978 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669910400 2022-12-08 12:04:28.982 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:28.982 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:28.986 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 12:04:29.303 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:29.591 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:04:29.727 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:29.778 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:29.779 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:29.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:29.794 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669996800 2022-12-08 12:04:29.799 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:29.800 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:29.803 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 12:04:30.084 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:04:30.097 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:30.098 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:30.098 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:30.097 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:30.669 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:30.674 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:30.691 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:30.692 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:30.695 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:30.706 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670083200 2022-12-08 12:04:30.710 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:30.710 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:30.713 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 12:04:30.896 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:04:30.0, currentDate=Thu Dec 08 12:04:30 CST 2022 2022-12-08 12:04:30.897 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=null, nextRunTime=2022-12-08 12:04:30.0} 2022-12-08 12:04:30.931 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:04:30.998 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:26.0, nextRun=2022-12-08 12:04:30.0, currentDate=Thu Dec 08 12:04:30 CST 2022 2022-12-08 12:04:30.999 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 12:04:26.0, nextRunTime=2022-12-08 12:04:30.0} 2022-12-08 12:04:31.024 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:04:31.025 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:31.025 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:31.432 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:03.0, nextRun=2022-12-08 12:04:30.0, currentDate=Thu Dec 08 12:04:31 CST 2022 2022-12-08 12:04:31.432 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:04:03.0, nextRunTime=2022-12-08 12:04:30.0} 2022-12-08 12:04:31.449 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:04:31.449 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:31.450 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:31.724 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1011, sql=alter table `ocp_metric_data_60` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 12:04:31.735 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:31.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:31.743 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:31.757 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670169600 2022-12-08 12:04:31.765 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:31.766 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:31.777 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 12:04:31.964 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:04:32.241 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:32.241 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:32.246 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:32.256 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670256000 2022-12-08 12:04:32.259 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:32.260 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:32.263 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 12:04:32.452 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:04:32.459 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:04:32.775 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:32.776 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:32.779 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:32.789 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670342400 2022-12-08 12:04:32.802 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:32.803 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:32.805 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 12:04:33.398 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:33.398 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:33.401 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:33.411 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670428800 2022-12-08 12:04:33.414 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:33.414 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:33.421 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 12:04:33.445 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:33.450 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:33.586 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:04:33.674 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:33.679 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:33.914 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:33.914 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:33.916 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:33.927 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670515200 2022-12-08 12:04:33.931 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:33.931 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:33.934 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 12:04:34.551 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:34.551 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:34.553 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:34.561 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670601600 2022-12-08 12:04:34.563 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:34.563 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:34.566 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 12:04:34.710 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Local JDBC authentication enabled: whiteList [/api/status.*, /api/v2/time, /api/v2/mc/info, /api/v2/loginKey, .*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|GetObRootServiceInfoUrlTemplate).*, performance/ash/reports/.*/data], basicAuth true, CSRF true 2022-12-08 12:04:34.715 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/assets/**'], [] 2022-12-08 12:04:34.715 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/index.html'], [] 2022-12-08 12:04:34.715 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.js'], [] 2022-12-08 12:04:34.716 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.css'], [] 2022-12-08 12:04:34.716 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/webjars/**'], [] 2022-12-08 12:04:34.716 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.svg'], [] 2022-12-08 12:04:35.231 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:04:35.244 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:35.245 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:35.261 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:35.284 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670688000 2022-12-08 12:04:35.286 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:35.286 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:35.289 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 12:04:35.640 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:34+08:00, updateTime=2022-12-08T12:04:04+08:00, expireTime=null, isLeader=false} 2022-12-08 12:04:35.722 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:34+08:00, updateTime=2022-12-08T12:04:04+08:00, expireTime=null, isLeader=false} 2022-12-08 12:04:35.727 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:04:35.778 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:04:35.797 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 12:04:35.806 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:31.0, nextRun=2022-12-08 12:04:35.0, currentDate=Thu Dec 08 12:04:35 CST 2022 2022-12-08 12:04:35.806 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 12:04:31.0, nextRunTime=2022-12-08 12:04:35.0} 2022-12-08 12:04:35.819 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 12:04:35.819 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:04:35.819 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 12:04:35.884 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: com.alipay.ocp.server.config.security.BasicAuthenticationSecurityConfiguration$$Lambda$2025/1240346826@6984940e, [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@49b5c730, org.springframework.security.web.context.SecurityContextPersistenceFilter@1641ee27, org.springframework.security.web.header.HeaderWriterFilter@a5de4af, org.springframework.security.web.authentication.logout.LogoutFilter@3d67e1b7, com.alipay.ocp.server.authentication.PreAuthenticationFilter@11c372e9, org.springframework.security.oauth2.server.resource.web.BearerTokenAuthenticationFilter@2d751681, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@2a77a5d3, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@6971e091, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@6334178e, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@70867b70, org.springframework.security.web.session.SessionManagementFilter@6191335f, org.springframework.security.web.access.ExceptionTranslationFilter@61606235, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@124c77bd] 2022-12-08 12:04:36.008 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: any request, [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@70f15b, org.springframework.security.web.context.SecurityContextPersistenceFilter@72d6f5c, org.springframework.security.web.header.HeaderWriterFilter@4ff67c4b, org.springframework.security.web.csrf.CsrfFilter@374baba3, org.springframework.security.web.authentication.logout.LogoutFilter@1ec6b7b6, com.alipay.ocp.server.authentication.PreAuthenticationFilter@11c372e9, org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter@358720a0, org.springframework.security.oauth2.server.resource.web.BearerTokenAuthenticationFilter@cfe4244, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@7de9b985, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@1019657, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@72eca02d, org.springframework.security.web.session.SessionManagementFilter@258ad0a5, org.springframework.security.web.access.ExceptionTranslationFilter@187c5844, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@6e4ef465] 2022-12-08 12:04:36.114 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:04:36.200 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:35+08:00, updateTime=2022-12-08T12:04:05+08:00, expireTime=null, isLeader=false} 2022-12-08 12:04:36.206 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:04:36.246 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:04:36.357 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1068, sql=alter table `ocp_metric_data_60` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 12:04:36.362 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:36.363 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:36.366 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 12:04:36.381 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:36.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:36.384 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:04:36.388 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:36.389 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:36.391 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2022-12-08 12:04:36.458 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2019 2022-12-08 12:04:36.461 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:36.461 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:36.463 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2019 values less than (1577836800)) 2022-12-08 12:04:36.540 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:36.541 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:36.585 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:36.586 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:36.679 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:36.686 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:37.146 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:37.146 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:37.151 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2022-12-08 12:04:37.163 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2020 2022-12-08 12:04:37.166 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:37.167 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:37.171 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2020 values less than (1609459200)) 2022-12-08 12:04:37.614 INFO 42 --- [main,,] o.s.b.a.e.web.EndpointLinksResolver : Exposing 3 endpoint(s) beneath base path '/actuator' 2022-12-08 12:04:37.658 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:37.659 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:37.662 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2022-12-08 12:04:37.674 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2021 2022-12-08 12:04:37.681 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:37.682 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:37.685 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2021 values less than (1640995200)) 2022-12-08 12:04:38.156 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:38.157 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:38.159 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2022-12-08 12:04:38.167 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2022 2022-12-08 12:04:38.170 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:38.170 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:38.173 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2022 values less than (1672531200)) 2022-12-08 12:04:38.490 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:38.491 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:38.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2022-12-08 12:04:38.503 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2023 2022-12-08 12:04:38.506 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:38.507 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:38.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2023 values less than (1704067200)) 2022-12-08 12:04:38.728 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:04:38.734 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:04:38.918 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:38.919 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:38.921 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2022-12-08 12:04:38.936 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:38.936 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:38.939 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:04:38.950 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:38.950 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:38.954 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2022-12-08 12:04:39.026 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2019 2022-12-08 12:04:39.036 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:39.036 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:39.040 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2019 values less than (1577836800)) 2022-12-08 12:04:39.193 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8080 (http) with context path '' 2022-12-08 12:04:39.222 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ************************* ACTIVE OCP PROPERTIES ****************************** 2022-12-08 12:04:39.223 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : Active profiles: [composite, default] 2022-12-08 12:04:39.235 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : apsara.audit.enabled=false 2022-12-08 12:04:39.235 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : backup.dbname.prefix=backup 2022-12-08 12:04:39.235 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : display-parse-failed-sql=true 2022-12-08 12:04:39.235 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : enable-sql.parse-service=true 2022-12-08 12:04:39.236 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file=/home/admin/ocp-server/log/ocp.log 2022-12-08 12:04:39.236 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.max-history=100 2022-12-08 12:04:39.236 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.max-size=100MB 2022-12-08 12:04:39.237 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.name=/home/admin/ocp-server/log/ocp.log 2022-12-08 12:04:39.237 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.total-size-cap=10GB 2022-12-08 12:04:39.237 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.com.alipay.ocp=INFO 2022-12-08 12:04:39.237 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.com.oceanbase.ocp=INFO 2022-12-08 12:04:39.237 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.org.hibernate.SQL=INFO 2022-12-08 12:04:39.238 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.web=INFO 2022-12-08 12:04:39.238 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.pattern.console=%clr(%d{yyyy-MM-dd HH:mm:ss.SSS}){faint} %clr(%5p) %clr(42){magenta} %clr(---){faint} %clr([%t,%X{traceId},%X{spanId}]){faint} %clr(%-40.40logger{39}){cyan} %clr(:){faint} %m%n%wEx 2022-12-08 12:04:39.238 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.pattern.file=%d{yyyy-MM-dd HH:mm:ss.SSS} %5p 42 --- [%t,%X{traceId},%X{spanId}] %-40.40logger{39} : %m%n%wEx 2022-12-08 12:04:39.238 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : mc.ocp.cluster.role.sync.check-timeout-seconds=120 2022-12-08 12:04:39.238 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : mgragent.log.level=info 2022-12-08 12:04:39.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : monagent.log.level=info 2022-12-08 12:04:39.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ob.logtailer.keyword.alarm.rules=[{"keyword":"partition table update task cost too much time to execute", "logLevel":"error", "svrType":"observer", "errorCode":4015, "alarmLevel":2}, {"keyword":"is_out_of_memstore_mem=true", "logLevel":"error", "svrType":"observer", "errorCode":100000, "alarmLevel":1}, {"keyword":"clog disk is almost full", "logLevel":"error", "svrType":"observer", "errorCode":100001, "alarmLevel":2}, {"keyword":"set_disk_error:attention!!!", "logLevel":"error", "svrType":"observer", "errorCode":100002, "alarmLevel":2}, {"keyword":"error occurs on data disk or slog disk", "logLevel":"warn", "svrType":"observer", "errorCode":100003, "alarmLevel":2}, {"keyword":"right_to_die_or_duty_to_live", "logLevel":"error", "svrType":"observer", "errorCode":100004, "alarmLevel":1}, {"keyword":"on_fatal_error", "logLevel":"error", "svrType":"observer", "errorCode":4070, "alarmLevel":1}] 2022-12-08 12:04:39.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.cleanup.period.seconds=300 2022-12-08 12:04:39.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.holder.capacity=100 2022-12-08 12:04:39.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.init.executor.thread-count=16 2022-12-08 12:04:39.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.init.timeout.millis=3000 2022-12-08 12:04:39.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.max-idle.seconds=3600 2022-12-08 12:04:39.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.operation.global.timeout.millis=300000 2022-12-08 12:04:39.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.print.sql=true 2022-12-08 12:04:39.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.slow.query.threshold.millis=1000 2022-12-08 12:04:39.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.socket.connect.timeout.millis=2000 2022-12-08 12:04:39.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.socket.read.timeout.millis=1800000 2022-12-08 12:04:39.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.auth.metric-auth-enabled=true 2022-12-08 12:04:39.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.auth.username=ocp_agent 2022-12-08 12:04:39.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.manager.http.port=62888 2022-12-08 12:04:39.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.monitor.http.port=62889 2022-12-08 12:04:39.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.ob-cleaner.config={"ob_log":{"path":"{INSTALL_PATH}/log","disk_threshold":80,"rules":[{"file_reg":"\\([a-z]\\+\\.\\)\\?[a-z]\\+\\.log\\.[0-9]\\+","retention_days":8,"keep_percentage":0.6},{"file_reg":"\\([a-z]\\+\\.\\)\\?[a-z]\\+\\.log\\.wf\\.[0-9]\\+","retention_days":30,"keep_percentage":0.8}]},"core_log":{"path":"{INSTALL_PATH}","disk_threshold":80,"rules":[{"file_reg":"core\\.[0-9]\\+","retention_days":8,"keep_percentage":0.6}]}} 2022-12-08 12:04:39.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-end-time-offset-seconds=130 2022-12-08 12:04:39.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-timeout-seconds=3 2022-12-08 12:04:39.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.slow-sql-exclude-obclusters=sys#* 2022-12-08 12:04:39.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-min-duration-seconds=60 2022-12-08 12:04:39.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-min-log-size-mb=0.5 2022-12-08 12:04:39.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-stat-exclude-obclusters= 2022-12-08 12:04:39.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans.query-end-time-offset-seconds=15 2022-12-08 12:04:39.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.detect.too-many-targets-alarm-threshold=20 2022-12-08 12:04:39.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.enabled=true 2022-12-08 12:04:39.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.host.property=svr_ip 2022-12-08 12:04:39.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.notification.expired-days=90 2022-12-08 12:04:39.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.recover-message-template= 2022-12-08 12:04:39.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.batch-max=20 2022-12-08 12:04:39.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.enabled=true 2022-12-08 12:04:39.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.once-retry-times=1 2022-12-08 12:04:39.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.once-timeout-ms=10000 2022-12-08 12:04:39.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.period.ms=2000 2022-12-08 12:04:39.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.retry-timeout-minutes=60 2022-12-08 12:04:39.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.total-failed-retry-times=3 2022-12-08 12:04:39.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.total-timeout-seconds=60 2022-12-08 12:04:39.244 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.will-be-sent-in-period-seconds=1800 2022-12-08 12:04:39.244 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.enabled=false 2022-12-08 12:04:39.244 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.addresses=null 2022-12-08 12:04:39.245 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.password=null 2022-12-08 12:04:39.245 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.username=null 2022-12-08 12:04:39.245 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.keep.days=7 2022-12-08 12:04:39.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.replicas=1 2022-12-08 12:04:39.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.shards=12 2022-12-08 12:04:39.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.ob.log.enabled=false 2022-12-08 12:04:39.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.ob.trace.enabled=false 2022-12-08 12:04:39.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.audit.enabled=true 2022-12-08 12:04:39.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.agent.relation.file.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/backup_agent_ob_relations_config.yaml')} 2022-12-08 12:04:39.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.backup-data-retention-days=7 2022-12-08 12:04:39.247 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.backup-liboblog-expire-days=7 2022-12-08 12:04:39.247 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.base-backup-last-finished-threshold=12960 2022-12-08 12:04:39.247 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.base-backup-timeout=10 2022-12-08 12:04:39.247 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.inc-backup-delay-threshold=3600 2022-12-08 12:04:39.247 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.last-data-backup-max-interval-minutes=1440 2022-12-08 12:04:39.248 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.backup-command.timeout=300 2022-12-08 12:04:39.248 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.logical.log.meta.time.continuity.threshold.seconds=10 2022-12-08 12:04:39.248 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.oss.support.cname=true 2022-12-08 12:04:39.248 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.restore-time-pre-check.enabled=true 2022-12-08 12:04:39.248 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.command.timeout=3600000 2022-12-08 12:04:39.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.host.task.concurrency=8 2022-12-08 12:04:39.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.max.retry.times=2 2022-12-08 12:04:39.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-interval-seconds=60 2022-12-08 12:04:39.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-times=60 2022-12-08 12:04:39.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.period.minutes=180 2022-12-08 12:04:39.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.schedule.enabled=true 2022-12-08 12:04:39.250 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.task.timeout=10800000 2022-12-08 12:04:39.250 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cloud.data.platform.site.url=null 2022-12-08 12:04:39.250 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cloud.meta.platform.site.url=null 2022-12-08 12:04:39.251 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.id=1 2022-12-08 12:04:39.251 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.name=ocp-cluster 2022-12-08 12:04:39.251 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.role=FOLLOWER 2022-12-08 12:04:39.251 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.config-url.site.url= 2022-12-08 12:04:39.253 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.config-url.use-request-address=true 2022-12-08 12:04:39.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.debug.web.cdn.enabled=false 2022-12-08 12:04:39.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.debug.web.cdn.location=https://gw-office.alipayobjects.com/a-sit/g/oceanbase/ocp-v2/2.5.0 2022-12-08 12:04:39.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.server.expire.seconds=30 2022-12-08 12:04:39.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.server.update.seconds=10 2022-12-08 12:04:39.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.service.expire.seconds={CMDB_SYNCER:30, TASK_MANAGER:30, RATE_LIMIT:30, PERF_SQL_ROLLUP:30, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:30} 2022-12-08 12:04:39.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.service.update.seconds={CMDB_SYNCER:10, TASK_MANAGER:10, RATE_LIMIT:10, PERF_SQL_ROLLUP:15, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:10} 2022-12-08 12:04:39.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.env=private 2022-12-08 12:04:39.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.access-key=****** 2022-12-08 12:04:39.255 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.access-secret=****** 2022-12-08 12:04:39.255 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.endpoint=TO_BE_REPLACED 2022-12-08 12:04:39.255 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.built-in.bucket=built-in 2022-12-08 12:04:39.255 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.default-block-split-size=1048576 2022-12-08 12:04:39.255 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.file-server.bucket.type=LOCAL 2022-12-08 12:04:39.255 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.local.built-in.dir=#{systemProperties['user.home'].concat('/ocp-server/lib')} 2022-12-08 12:04:39.256 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.local.dir=#{systemProperties['user.home'].concat('/data/files')} 2022-12-08 12:04:39.256 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.max-concurrent-count=16 2022-12-08 12:04:39.256 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.oss-block-split-size=1048576 2022-12-08 12:04:39.256 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.supported-architecture=x86_64,AArch64 2022-12-08 12:04:39.256 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.sys-package.bucket=sys-package 2022-12-08 12:04:39.257 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.try-lock-timeout-milliseconds=60000 2022-12-08 12:04:39.257 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.config.threshold={"-1":{"host_load":{"load1_per_cpu":2},"host_disk_status":{"host_disk_used_percent":85},"host_time":{"clock_diff":500,"ssh_interval":1000},"ob_server_disk_status":{"observer_disk_threshold_percentage":80},"ob_server_partition_count":{"ob_server_partition_count":100000},"obproxy_connection_count":{"obproxy_session_count_percentage":80}}} 2022-12-08 12:04:39.257 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.status.available-keyword=okay 2022-12-08 12:04:39.257 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.status.unavailable-keyword=bad 2022-12-08 12:04:39.258 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host-manager.staragent.enable=false 2022-12-08 12:04:39.258 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.check.clock-diff.enable=false 2022-12-08 12:04:39.258 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.check.clock-diff.max-diff=50 2022-12-08 12:04:39.258 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.remote-command.default-timeout-millis=30000 2022-12-08 12:04:39.258 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.remote-command.min-timeout-millis=30000 2022-12-08 12:04:39.259 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.ssh-ping.max-delay-millis=3000 2022-12-08 12:04:39.259 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.account.system.active=false 2022-12-08 12:04:39.259 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth=local 2022-12-08 12:04:39.259 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-key=****** 2022-12-08 12:04:39.259 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-secret=****** 2022-12-08 12:04:39.259 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-url=TO_BE_REPLACED 2022-12-08 12:04:39.259 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-domain=TO_BE_REPLACED 2022-12-08 12:04:39.260 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-login-url=TO_BE_REPLACED 2022-12-08 12:04:39.260 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-logout-url=TO_BE_REPLACED 2022-12-08 12:04:39.260 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-domain=TO_BE_REPLACED 2022-12-08 12:04:39.260 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-login-url=TO_BE_REPLACED 2022-12-08 12:04:39.260 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-logout-url=TO_BE_REPLACED 2022-12-08 12:04:39.261 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.access-key=****** 2022-12-08 12:04:39.261 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.access-secret=****** 2022-12-08 12:04:39.261 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.domain=TO_BE_REPLACED 2022-12-08 12:04:39.261 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.endpoint=TO_BE_REPLACED 2022-12-08 12:04:39.261 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.region-name=TO_BE_REPLACED 2022-12-08 12:04:39.261 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.ram.endpoint=TO_BE_REPLACED 2022-12-08 12:04:39.262 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.ram.region-name=TO_BE_REPLACED 2022-12-08 12:04:39.262 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.basic.enabled=true 2022-12-08 12:04:39.262 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.admin-employee-ids=146380,073156,032575 2022-12-08 12:04:39.262 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.app-name=TO_BE_REPLACED 2022-12-08 12:04:39.263 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.login-env=daily 2022-12-08 12:04:39.263 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.login-url=TO_BE_REPLACED 2022-12-08 12:04:39.263 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.logout-url=TO_BE_REPLACED 2022-12-08 12:04:39.263 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.whitelist=/api/v2/time,/api/v2/mc/info,/api/v2/loginKey,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|GetObRootServiceInfoUrlTemplate).*,performance/ash/reports/.*/data 2022-12-08 12:04:39.263 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.csrf.enabled=true 2022-12-08 12:04:39.263 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.csrf.url.excluded=/api/v2/iam/login.*,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName).* 2022-12-08 12:04:39.264 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.lockout-minutes=10 2022-12-08 12:04:39.264 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.max-attempts=10 2022-12-08 12:04:39.264 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.white-list=null 2022-12-08 12:04:39.265 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.lockout-minutes=30 2022-12-08 12:04:39.265 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.max-attempts=5 2022-12-08 12:04:39.265 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.preserved.username.list=admin,sys,system,sysdba,dba,oceanbase,obproxy,proxyro,ocp,ocp_monitor,ocp_agent,odc,oms,backup,drc,lbacsys,odp,temp 2022-12-08 12:04:39.265 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.enabled=true 2022-12-08 12:04:39.265 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.connect.timeout=1000 2022-12-08 12:04:39.265 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.read.timeout=1000 2022-12-08 12:04:39.266 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.on-ip.enabled=false 2022-12-08 12:04:39.266 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.on-user.enabled=true 2022-12-08 12:04:39.266 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.task.schedule.period=3 2022-12-08 12:04:39.266 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.role.forbidden.update.username.list=admin,system,obpass,obproxy,ocp_admin,monitor 2022-12-08 12:04:39.266 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.idempotent.client-token.expire.time=14d 2022-12-08 12:04:39.266 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.scrips.sequence-availability.threshold-percentage=0.8 2022-12-08 12:04:39.266 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-cluster-not-exists-name=__UNKNOWN__ 2022-12-08 12:04:39.266 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-database-not-exists-name=__UNKNOWN__ 2022-12-08 12:04:39.267 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-host-not-exists-ip=__UNKNOWN__ 2022-12-08 12:04:39.267 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-tenant-not-exists-name=__UNKNOWN__ 2022-12-08 12:04:39.267 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.core-pool-size=5 2022-12-08 12:04:39.267 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.max-pool-size=100 2022-12-08 12:04:39.267 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.queue-size=100 2022-12-08 12:04:39.267 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.thread-keep-alive-time=100 2022-12-08 12:04:39.267 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.internal.rpc.user.password=****** 2022-12-08 12:04:39.268 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.internal.rpc.user.username=system 2022-12-08 12:04:39.268 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.http.connect.timeout=180000 2022-12-08 12:04:39.268 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.http.read.timeout=180000 2022-12-08 12:04:39.268 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.tmp.dir=#{systemProperties['user.home'].concat('/logs/ocp')} 2022-12-08 12:04:39.269 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.max-download-speed=1024 2022-12-08 12:04:39.269 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.host=/var/log/message* 2022-12-08 12:04:39.269 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.obproxy=/home/admin/logs/obproxy/log/* 2022-12-08 12:04:39.269 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.observer=%s/log/* 2022-12-08 12:04:39.269 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.ocp_agent=/home/admin/ocp_agent/log/* 2022-12-08 12:04:39.269 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.enabled=true 2022-12-08 12:04:39.270 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.private-key=****** 2022-12-08 12:04:39.270 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.public-key=****** 2022-12-08 12:04:39.270 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.meta.cluster.name= 2022-12-08 12:04:39.270 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.metric.collect.interval.second=1 2022-12-08 12:04:39.270 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.host.enabled=true 2022-12-08 12:04:39.271 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.max-pool-size=3000 2022-12-08 12:04:39.271 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obcluster.enabled=true 2022-12-08 12:04:39.271 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obproxy.enabled=true 2022-12-08 12:04:39.271 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obsdk.sql-query-row-limit=10000 2022-12-08 12:04:39.271 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.data.retention-days={"ob_cluster_system_event":31,"ocp_metric_data_1":8,"ocp_metric_data_60":31,"metric_hour_data":1098,"metric_daily_data":1098} 2022-12-08 12:04:39.272 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.datasource.query.timeout.sec=120 2022-12-08 12:04:39.272 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.datasource.socket.timeout.ms=120000 2022-12-08 12:04:39.272 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.check-active-period-seconds=60 2022-12-08 12:04:39.272 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.check-inactive-period-seconds=50 2022-12-08 12:04:39.272 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.inactive.threshold.seconds=300 2022-12-08 12:04:39.273 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.host.exporters=/metrics/node/host,:62888/metrics/stat,:62889/metrics/stat 2022-12-08 12:04:39.273 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.host.metrics-list=load1,load5,load15,cpu_percent,io_read,io_write,io_read_time,io_write_time,io_read_byte,io_write_byte,net_recv,net_send,memory_used,memory_buffers,memory_free,host_disk_used,disk_percent,net_recv_percent,load1_per_cpu,memory_percent,net_send_percent,disk_readonly_flag,ssd_wear_indicator,tcp_retrans_percent,host_partition_usage_percent,memory_cached,ob_log_disk_usage_percent,ob_data_disk_usage_percent,ob_install_disk_usage_percent 2022-12-08 12:04:39.273 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.minute.exporters=:62888/metrics/stat,:62889/metrics/stat,/metrics/ob/extra,/metrics/obcloud/extra 2022-12-08 12:04:39.273 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.ob.exporters=/metrics/node/ob,/metrics/ob/basic,/metrics/ob/extra 2022-12-08 12:04:39.273 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.obproxy.exporters=/metrics/node/obproxy,/metrics/obproxy 2022-12-08 12:04:39.274 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.second.exporters=/metrics/node/host,/metrics/node/ob,/metrics/ob/basic,/metrics/node/obproxy,/metrics/obproxy 2022-12-08 12:04:39.274 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.database=monitor_database 2022-12-08 12:04:39.274 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.driverClassName=com.oceanbase.jdbc.Driver 2022-12-08 12:04:39.274 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.initialSize=10 2022-12-08 12:04:39.274 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.keepAlive=true 2022-12-08 12:04:39.275 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.maxActive=200 2022-12-08 12:04:39.275 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.maxWait=2000 2022-12-08 12:04:39.275 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.minIdle=2 2022-12-08 12:04:39.275 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.name=monitordb-connect-pool 2022-12-08 12:04:39.275 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.testWhileIdle=true 2022-12-08 12:04:39.276 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.validationQuery=SELECT 1 FROM DUAL 2022-12-08 12:04:39.276 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.host=192.168.28.54 2022-12-08 12:04:39.276 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.password=****** 2022-12-08 12:04:39.276 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.port=2883 2022-12-08 12:04:39.276 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.username=monitor_user@monitor_tenant#obcluster 2022-12-08 12:04:39.277 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.enabled=false 2022-12-08 12:04:39.277 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.heartbeat.expire.seconds=60 2022-12-08 12:04:39.277 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.heartbeat.interval.seconds=10 2022-12-08 12:04:39.277 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.replication.interval.seconds=30 2022-12-08 12:04:39.277 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.replication.properties.metadb.global-tables=[{"tableName":"mc_ocp_cluster", "mode":"FULL", "querySql":"select `id`, `name`, `role`, `address`, `metadb_config`, `version`, `status`, `last_heartbeat_time`, `create_time`, `update_time` from mc_ocp_cluster","writeSql":"replace into mc_ocp_cluster (`id`, `name`, `role`, `address`, `metadb_config`, `version`, `status`, `last_heartbeat_time`, `create_time`, `update_time`) values (:id, :name, :role, :address, :metadb_config, :version, :status, :last_heartbeat_time, :create_time, :update_time)"},{"tableName":"mc_common_sequence", "mode":"FULL", "querySql":"select `id`, `name`, `next_val`, `create_time`, `update_time` from mc_common_sequence","writeSql":"replace into mc_common_sequence (`id`, `name`, `next_val`, `create_time`, `update_time`) values (:id, :name, :next_val, :create_time, :update_time)"},{"tableName":"mc_ob_cluster", "mode": "FULL", "querySql":"select `ocp_cluster_id`, `ocp_ob_cluster_id`, `ob_cluster_name`, `ob_cluster_id`, `type`, `architecture`, `rootserver_json`, `ob_version`, `locker_id`, `lock_count`, `create_time`, `update_time` from mc_ob_cluster", "writeSql":"replace into mc_ob_cluster (`ocp_cluster_id`, `ocp_ob_cluster_id`, `ob_cluster_name`, `ob_cluster_id`, `type`, `architecture`, `rootserver_json`, `ob_version`, `locker_id`, `lock_count`, `create_time`, `update_time`) values (:ocp_cluster_id, :ocp_ob_cluster_id, :ob_cluster_name, :ob_cluster_id, :type, :architecture, :rootserver_json, :ob_version, :locker_id, :lock_count, :create_time, :update_time)"}, {"tableName":"mc_ocp_cluster_remote_call", "mode":"INCREMENTAL", "querySql":"select `uuid`, `caller_id`, `executor_id`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `max_retry_times`, `retry_interval`, `current_retry_time`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time` from mc_ocp_cluster_remote_call where update_time >= :INCREMENTAL_COLUMN_VALUE", "writeSql":"replace into mc_ocp_cluster_remote_call (`uuid`, `caller_id`, `executor_id`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `max_retry_times`, `retry_interval`, `current_retry_time`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time`) values (:uuid, :caller_id, :executor_id, :task_type, :request_type, :context, :arguments_json, :output_json, :max_retry_times, :retry_interval, :current_retry_time, :timeout, :status, :start_time, :finish_time, :create_time, :update_time)", "queryMaxRecordSql":"select max(update_time) from mc_ocp_cluster_remote_call"}, {"tableName":"mc_ocp_cluster_remote_call_instance", "mode":"INCREMENTAL", "querySql":"select `uuid`, `remote_call_uuid`, `caller_id`, `executor_id`, `server_ip_port`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time` from mc_ocp_cluster_remote_call_instance where update_time >= :INCREMENTAL_COLUMN_VALUE", "writeSql":"replace into mc_ocp_cluster_remote_call_instance (`uuid`, `remote_call_uuid`, `caller_id`, `executor_id`, `server_ip_port`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time`) values (:uuid, :remote_call_uuid, :caller_id, :executor_id, :server_ip_port, :task_type, :request_type, :context, :arguments_json, :output_json, :timeout, :status, :start_time, :finish_time, :create_time, :update_time)","queryMaxRecordSql":"select max(update_time) from mc_ocp_cluster_remote_call_instance"}] 2022-12-08 12:04:39.278 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.agent.socks-port=1080 2022-12-08 12:04:39.278 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.host-address=localhost 2022-12-08 12:04:39.278 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.socks-port=1080 2022-12-08 12:04:39.278 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.web-port=8088 2022-12-08 12:04:39.279 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.vpc.mode.enabled=false 2022-12-08 12:04:39.279 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.cluster.ops.blacklist= 2022-12-08 12:04:39.279 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.slowsql.threshold=100000 2022-12-08 12:04:39.279 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.upgrade.allow-downgrade=false 2022-12-08 12:04:39.279 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.upgrade.dependencies.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/oceanbase_upgrade_dep.yml')} 2022-12-08 12:04:39.280 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.obcloud.api.address= 2022-12-08 12:04:39.280 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.connector.cache.max-idle-seconds=3600 2022-12-08 12:04:39.280 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.connector.cache.max-size=1000 2022-12-08 12:04:39.280 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connect-timeout=5000 2022-12-08 12:04:39.281 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connection.max-per-route=100 2022-12-08 12:04:39.281 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connection.max-pool-size=100 2022-12-08 12:04:39.281 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.read-timeout=30000 2022-12-08 12:04:39.281 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.socket-timeout=3000 2022-12-08 12:04:39.281 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.core-pool-size=500 2022-12-08 12:04:39.282 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.keep-alive-time=120000 2022-12-08 12:04:39.282 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.max-pool-size=1500 2022-12-08 12:04:39.282 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.ssh.connect-timeout=10000 2022-12-08 12:04:39.282 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.ssh.default-command-timeout=10000 2022-12-08 12:04:39.282 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.delete-server.reserve-data-enabled=false 2022-12-08 12:04:39.283 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.resource.trend.collect.period=daily 2022-12-08 12:04:39.283 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.resource.trend.max-point=20 2022-12-08 12:04:39.283 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.single-idc-for-zone-enabled=true 2022-12-08 12:04:39.283 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.sql-execute.enabled=false 2022-12-08 12:04:39.284 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.sql-execute.sql-type.whitelist=SELECT,SHOW 2022-12-08 12:04:39.284 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.tenant.allow-small-unit=false 2022-12-08 12:04:39.284 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.tenant.whitelist.attach-default-whitelist=true 2022-12-08 12:04:39.284 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.unit.unused.max-reserve-hour=1 2022-12-08 12:04:39.284 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.password=****** 2022-12-08 12:04:39.285 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.username=proxyro 2022-12-08 12:04:39.285 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.start.command.template=./bin/obproxy -p 2883 -n %s -o obproxy_config_server_url='%s/services?User_ID=alibaba&UID=test&Action=GetObProxyConfig',enable_metadb_used=false,enable_strict_kernel_release=false,enable_proxy_scramble=true,proxy_mem_limited=2G,log_dir_size_threshold=10G,prometheus_sync_interval=1s 2022-12-08 12:04:39.285 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.odp.root.default.password=****** 2022-12-08 12:04:39.285 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.ash.earliest-analyse-time=8 2022-12-08 12:04:39.285 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.ash.max-analyse-range=60m 2022-12-08 12:04:39.285 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.parallel.sql.limit=2000 2022-12-08 12:04:39.285 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.parallel.sql.partition.retention.days=15 2022-12-08 12:04:39.285 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.awful-performance-index-used-config={"enabled":true, "cpuTimeLimitUs":100000, "execPsLimit":5.0, "fullLogicalReadsLimit":10000} 2022-12-08 12:04:39.286 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.cpu-time-proportion-high-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":10.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":30, "sqlCountLimit":20, "cpuTimePercentLimit":20} 2022-12-08 12:04:39.286 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.database-white-list=oceanbase,information_schema,mysql,__recyclebin,sys,__public 2022-12-08 12:04:39.286 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.diagnose.standby-cluster.enabled=0 2022-12-08 12:04:39.286 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.execution-spike-config={"enabled":true, "cpuTimeLimitUs":3000, "execPsLimit":5.0, "pointsLimit":5, "compareMin":20, "avgExecutionMultiply":{"0":6, "1":5, "5":4, "10":3, "50": 2.5, "100": 2, "500": 1.6}, "stdExecutionMultiply":{"0":80, "1":60 , "3": 30,"5":20, "10":15, "20":8, "30":6, "50":5, "80":4}} 2022-12-08 12:04:39.286 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.index-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2022-12-08 12:04:39.286 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.ineffective-hint-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 12:04:39.287 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.outline-history-query-days=30 2022-12-08 12:04:39.287 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.perf-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2022-12-08 12:04:39.287 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-after-plan-changed-config={"enabled":true, "compareMin":5, "cpuTimeMultiply":{"0":50, "1":30, "10":10, "100":8, "1000":6}} 2022-12-08 12:04:39.287 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":5.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":5, "compareMin":20, "cpuTimeMultiply":{"0":50, "1":30, "10":10, "100":8, "1000":6}} 2022-12-08 12:04:39.287 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.query-timeout=30000000 2022-12-08 12:04:39.287 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.row-lock-contention-high-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":100000, "elapsedTimeLimitUs":0} 2022-12-08 12:04:39.287 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.sql-diagnosis-retention-days=30 2022-12-08 12:04:39.288 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-exists-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 12:04:39.288 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-used-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 12:04:39.290 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.tenant-white-list=null 2022-12-08 12:04:39.290 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.advisor-plan-max-query-range=7d 2022-12-08 12:04:39.291 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag-plan-change-config={"enabled":true,"schedulePeriodMin":2, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":500,"diagPeriodSec":120,"diagOffsetSec":120,"maxDiagPeriodSec":600} 2022-12-08 12:04:39.291 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-queue-max-size=1000000 2022-12-08 12:04:39.291 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-core-size=30 2022-12-08 12:04:39.291 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-max-size=300 2022-12-08 12:04:39.291 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.earliest-query-time=8d 2022-12-08 12:04:39.292 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.index-advisor-cpu-time-threshold=10 2022-12-08 12:04:39.292 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.index-advisor-elapsed-time-threshold=20 2022-12-08 12:04:39.292 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.info.parameterize.sql=false 2022-12-08 12:04:39.292 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.info.parse.sql.type=true 2022-12-08 12:04:39.292 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.max-query-range=24h 2022-12-08 12:04:39.293 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.batch.insert.size=100 2022-12-08 12:04:39.293 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.core.thread=8 2022-12-08 12:04:39.293 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.insert.query.rate.limit=10 2022-12-08 12:04:39.293 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.max.thread=16 2022-12-08 12:04:39.293 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.query.limit=2000 2022-12-08 12:04:39.293 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.queue.size=20000 2022-12-08 12:04:39.294 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-granularity=30s 2022-12-08 12:04:39.294 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-query-interval=2h 2022-12-08 12:04:39.294 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-retention=8d 2022-12-08 12:04:39.294 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.prepare-partition-ahead=8 2022-12-08 12:04:39.294 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-digest-limit=0 2022-12-08 12:04:39.294 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-digest-trend.points=15 2022-12-08 12:04:39.295 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-timeout=30000000 2022-12-08 12:04:39.295 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.slow-sql-limit=2000 2022-12-08 12:04:39.295 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-audit-sample-retention=8d 2022-12-08 12:04:39.295 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-granularity=30s 2022-12-08 12:04:39.295 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-query-interval=2h 2022-12-08 12:04:39.296 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-retention=2d 2022-12-08 12:04:39.296 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-granularity=2m 2022-12-08 12:04:39.296 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-query-interval=12h 2022-12-08 12:04:39.296 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-retention=8d 2022-12-08 12:04:39.296 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-granularity=10m 2022-12-08 12:04:39.297 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-query-interval=48h 2022-12-08 12:04:39.297 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-retention=15d 2022-12-08 12:04:39.297 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-info-secondary-cache-expiration=30m 2022-12-08 12:04:39.297 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level0-query-interval=30m 2022-12-08 12:04:39.297 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level1-query-interval=2h 2022-12-08 12:04:39.298 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.top-sql-limit=2000 2022-12-08 12:04:39.298 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.tuning-advisor-cpu-time-ratio-of-plan-comparison=0.8 2022-12-08 12:04:39.298 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.transaction.partition.retention.days=7 2022-12-08 12:04:39.298 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.site.url=http://192.168.28.62:8080 2022-12-08 12:04:39.298 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.startup-check.metadb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2022-12-08 12:04:39.298 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.startup-check.monitordb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2022-12-08 12:04:39.299 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.default.language=zh-CN 2022-12-08 12:04:39.300 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.default.timezone= 2022-12-08 12:04:39.300 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.event.excluded={balancer: {'start_sql_bkgd_task','finish_sql_bkgd_task'}} 2022-12-08 12:04:39.300 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.address=localhost 2022-12-08 12:04:39.300 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.cluster-name=obdv1 2022-12-08 12:04:39.301 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.database=obproxy 2022-12-08 12:04:39.301 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.enabled=false 2022-12-08 12:04:39.301 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.user=root@obproxy 2022-12-08 12:04:39.301 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.port=2888 2022-12-08 12:04:39.301 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.batch-interval-millis=10 2022-12-08 12:04:39.301 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.batch-size=1000 2022-12-08 12:04:39.301 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.preserve-days=30 2022-12-08 12:04:39.302 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.thread.core-pool-size=4 2022-12-08 12:04:39.302 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.thread.maximum-pool-size=16 2022-12-08 12:04:39.302 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.version=4.0.0 2022-12-08 12:04:39.302 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.web.tracking.enabled=False 2022-12-08 12:04:39.302 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.client-id=TO_BE_REPLACED 2022-12-08 12:04:39.303 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.client-secret=****** 2022-12-08 12:04:39.303 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.issuer=https://example.com/oauth2/default 2022-12-08 12:04:39.303 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.redirect-uri=TO_BE_REPLACED 2022-12-08 12:04:39.303 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : server.port=8080 2022-12-08 12:04:39.303 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : server.servlet.session.timeout=30m 2022-12-08 12:04:39.303 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : slow-sql.query-sql-info-from.cache.directly=false 2022-12-08 12:04:39.303 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.data.web.pageable.one-indexed-parameters=true 2022-12-08 12:04:39.304 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.initialSize=10 2022-12-08 12:04:39.304 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.keepAlive=true 2022-12-08 12:04:39.304 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.maxActive=100 2022-12-08 12:04:39.304 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.maxWait=2000 2022-12-08 12:04:39.304 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.minIdle=2 2022-12-08 12:04:39.304 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.name=metadb-connect-pool 2022-12-08 12:04:39.304 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.testWhileIdle=true 2022-12-08 12:04:39.305 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.validationQuery=SELECT 1 FROM DUAL 2022-12-08 12:04:39.305 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.hibernate.naming-strategy=org.hibernate.cfg.ImprovedNamingStrategy 2022-12-08 12:04:39.305 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.properties.hibernate.dialect=org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:04:39.305 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.properties.hibernate.globally_quoted_identifiers=true 2022-12-08 12:04:39.305 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.enabled=true 2022-12-08 12:04:39.305 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.max-file-size=2048MB 2022-12-08 12:04:39.306 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.max-request-size=2048MB 2022-12-08 12:04:39.306 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.api-docs.enabled=false 2022-12-08 12:04:39.306 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.api-docs.path=/doc/api-docs 2022-12-08 12:04:39.307 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.paths-to-exclude=null 2022-12-08 12:04:39.307 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.paths-to-match=/api/v2/** 2022-12-08 12:04:39.307 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.swagger-ui.path=/doc/swagger-ui.html 2022-12-08 12:04:39.307 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : sql-stat.flush-sql-info-to-cache=true 2022-12-08 12:04:39.307 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.core-pool-size=8 2022-12-08 12:04:39.308 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.max-pool-size=64 2022-12-08 12:04:39.308 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.task-queue-size=1800 2022-12-08 12:04:39.308 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : top-sql.query-sql-info-from.cache.directly=false 2022-12-08 12:04:39.308 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ****************************************************************************** 2022-12-08 12:04:39.480 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:39.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:39.484 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2022-12-08 12:04:39.495 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2020 2022-12-08 12:04:39.498 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:39.498 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:39.501 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2020 values less than (1609459200)) 2022-12-08 12:04:39.592 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:39.654 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:04:39.686 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:39.692 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:39.712 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:39.712 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:39.775 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:39.834 INFO 42 --- [pool-ocp-schedules-1,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 12:04:39.842 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:39.842 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:39.845 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2022-12-08 12:04:39.856 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2021 2022-12-08 12:04:39.860 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:39.861 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:39.870 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2021 values less than (1640995200)) 2022-12-08 12:04:39.884 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:04:39.885 INFO 42 --- [pool-ocp-schedules-10,,103cb0e41ba2] .s.a.AnnotationAsyncExecutionInterceptor : More than one TaskExecutor bean found within the context, and none is named 'taskExecutor'. Mark one of them as primary or name it 'taskExecutor' (possibly as an alias) in order to use it for async processing: [alarmTaskExecutor, notificationSendExecutor, alarmDetectMetricExecutor] 2022-12-08 12:04:39.891 INFO 42 --- [pool-ocp-schedules-2,,6affd940a5ff] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:04:39.933 INFO 42 --- [pool-ocp-schedules-18,,5ec3303e8c98] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:04:39.940 INFO 42 --- [pool-ocp-schedules-19,,bcf83848bbf6] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:04:39.941 INFO 42 --- [pool-ocp-schedules-19,,bcf83848bbf6] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:04:39.941 INFO 42 --- [pool-ocp-schedules-19,,bc931f2a9f79] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:04:39.952 INFO 42 --- [pool-ocp-schedules-12,,e53d8491c5f6] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:04:39.990 INFO 42 --- [pool-ocp-schedules-2,,6affd940a5ff] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:04:40.071 INFO 42 --- [pool-ocp-schedules-5,,ca0d2a7e3eb4] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 12:04:40.122 INFO 42 --- [pool-ocp-schedules-4,,010206b23539] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:04:40.154 INFO 42 --- [pool-ocp-schedules-6,,edc43d37210d] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:04:40.157 INFO 42 --- [pool-ocp-schedules-13,,2baa381944b9] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:04:40.251 INFO 42 --- [pool-ocp-schedules-1,,e44597e3e25f] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:04:40.253 INFO 42 --- [pool-ocp-schedules-1,,e44597e3e25f] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:04:40.260 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.service.TaskRepositoryService : fetchNeedExecute, tryAcquireTasksCount=2, fetchedCount=2 2022-12-08 12:04:40.266 INFO 42 --- [pool-ocp-schedules-12,,ecccd4e886c9] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 12:04:40.268 INFO 42 --- [pool-ocp-schedules-1,,e44597e3e25f] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:04:40.300 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:40.301 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:40.305 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2022-12-08 12:04:40.345 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : Started OcpServerApplication in 427.794 seconds (JVM running for 434.934) 2022-12-08 12:04:40.354 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.alarm.core.task.AlarmDetectTask : AlarmDetectTask created 2022-12-08 12:04:40.376 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=1, uuid=1b5fa8db-4c8f-4f48-89fa-b7878569b70f, taskType=AlarmDetect, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T04:03:00.869769Z, startAt=2022-12-08T04:04:40.169Z, endAt=null, heartbeatAt=2022-12-08T04:04:40.169Z, result=executing) 2022-12-08 12:04:40.380 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:04:40.407 INFO 42 --- [pool-ocp-schedules-15,,cee64e4d4af9] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100000, channelName=钉钉群消息样例 2022-12-08 12:04:40.432 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:04:40.408 INFO 42 --- [pool-ocp-schedules-15,,cee64e4d4af9] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=钉钉群消息样例 2022-12-08 12:04:40.447 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2022 2022-12-08 12:04:40.459 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:40.460 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:40.472 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2022 values less than (1672531200)) 2022-12-08 12:04:40.505 INFO 42 --- [SimpleAsyncTaskExecutor-8,,] c.o.o.p.a.i.SessionEventSyncService : start to sync session wait event info, cluster ids is [] 2022-12-08 12:04:40.506 INFO 42 --- [SimpleAsyncTaskExecutor-8,,] c.o.o.p.a.i.SessionEventSyncService : Sync session wait event info finished, cluster ids is [] 2022-12-08 12:04:40.554 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100000, channelName=钉钉群消息样例 2022-12-08 12:04:40.555 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=钉钉群消息样例 2022-12-08 12:04:40.576 INFO 42 --- [pool-ocp-schedules-15,,cee64e4d4af9] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100001, channelName=自定义脚本通道(待配置样例) 2022-12-08 12:04:40.576 INFO 42 --- [pool-ocp-schedules-15,,cee64e4d4af9] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=自定义脚本通道(待配置样例) 2022-12-08 12:04:40.576 INFO 42 --- [pool-ocp-schedules-15,,cee64e4d4af9] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=2, updatedCount=2, failedToUpdateCount=0 2022-12-08 12:04:40.675 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100001, channelName=自定义脚本通道(待配置样例) 2022-12-08 12:04:40.676 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=自定义脚本通道(待配置样例) 2022-12-08 12:04:40.676 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=2, updatedCount=2, failedToUpdateCount=0 2022-12-08 12:04:40.693 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.core.process.AlarmProcessor : AlarmProcessor init done, lastProcessTime=2022-12-08T12:04:40.692523+08:00 2022-12-08 12:04:40.694 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.core.task.AlarmProcessTask : AlarmProcessTask created 2022-12-08 12:04:40.698 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=2, uuid=5f13908a-dd7e-4807-b3e0-26648e685c4d, taskType=AlarmProcess, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T04:03:00.947157Z, startAt=2022-12-08T04:04:40.169Z, endAt=null, heartbeatAt=2022-12-08T04:04:40.169Z, result=executing) 2022-12-08 12:04:40.699 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.utils.task.AlarmTaskManager : startNeedExecute, activeCount=0, tryStartCount=2, startedCount=2 2022-12-08 12:04:40.763 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:04:40.764 INFO 42 --- [pool-ocp-schedules-17,,71b0e738c27a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:04:40.804 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:04:40.803154+08:00, lastProcessTime=2022-12-08T12:04:40.692523+08:00 2022-12-08 12:04:40.842 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obagent_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.843 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obagent_dead 2022-12-08 12:04:40.843 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obagent_dead 2022-12-08 12:04:40.844 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cannot_connected, duration=PT1M, resolveTimeout=PT10S 2022-12-08 12:04:40.845 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cannot_connected 2022-12-08 12:04:40.845 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cannot_connected 2022-12-08 12:04:40.846 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_connection_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.847 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_connection_percent_over_threshold 2022-12-08 12:04:40.847 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_connection_percent_over_threshold 2022-12-08 12:04:40.848 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 12:04:40.848 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_cpu_percent_over_threshold 2022-12-08 12:04:40.848 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_cpu_percent_over_threshold 2022-12-08 12:04:40.849 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 12:04:40.849 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cpu_percent_over_threshold 2022-12-08 12:04:40.849 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cpu_percent_over_threshold 2022-12-08 12:04:40.850 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.850 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold 2022-12-08 12:04:40.850 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_frozen_version_delta_over_threshold 2022-12-08 12:04:40.851 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_net_recv_percent_over_threshold, duration=PT2M, resolveTimeout=PT1M 2022-12-08 12:04:40.851 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_recv_percent_over_threshold 2022-12-08 12:04:40.852 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_net_recv_percent_over_threshold 2022-12-08 12:04:40.852 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_exists_inactive_server, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:04:40.852 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_inactive_server 2022-12-08 12:04:40.853 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_exists_inactive_server 2022-12-08 12:04:40.853 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_exists_index_fail_table, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.853 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_index_fail_table 2022-12-08 12:04:40.854 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_exists_index_fail_table 2022-12-08 12:04:40.855 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_load1_per_cpu_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 12:04:40.855 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_load1_per_cpu_over_threshold 2022-12-08 12:04:40.855 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_load1_per_cpu_over_threshold 2022-12-08 12:04:40.856 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_mem_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.856 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_mem_percent_over_threshold 2022-12-08 12:04:40.856 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_mem_percent_over_threshold 2022-12-08 12:04:40.857 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_merge_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.857 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_timeout 2022-12-08 12:04:40.857 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_merge_timeout 2022-12-08 12:04:40.860 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_merge_error, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.860 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_error 2022-12-08 12:04:40.860 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_merge_error 2022-12-08 12:04:40.861 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_no_frozen, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.861 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_frozen 2022-12-08 12:04:40.861 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_no_frozen 2022-12-08 12:04:40.864 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_no_merge, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.865 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_merge 2022-12-08 12:04:40.865 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_no_merge 2022-12-08 12:04:40.866 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_net_send_percent_over_threshold, duration=PT2M, resolveTimeout=PT1M 2022-12-08 12:04:40.866 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_send_percent_over_threshold 2022-12-08 12:04:40.866 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_net_send_percent_over_threshold 2022-12-08 12:04:40.866 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_partition_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.867 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_partition_count_over_threshold 2022-12-08 12:04:40.869 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_partition_count_over_threshold 2022-12-08 12:04:40.871 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_disk_readonly, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.871 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_disk_readonly 2022-12-08 12:04:40.871 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_disk_readonly 2022-12-08 12:04:40.872 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant500_mem_hold_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.873 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_over_threshold 2022-12-08 12:04:40.873 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant500_mem_hold_over_threshold 2022-12-08 12:04:40.879 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_server_sstable_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.879 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_sstable_percent_over_threshold 2022-12-08 12:04:40.879 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_server_sstable_percent_over_threshold 2022-12-08 12:04:40.880 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_zone_sstable_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.881 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_zone_sstable_percent_over_threshold 2022-12-08 12:04:40.881 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_zone_sstable_percent_over_threshold 2022-12-08 12:04:40.882 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold, duration=PT1M, resolveTimeout=PT10S 2022-12-08 12:04:40.882 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold 2022-12-08 12:04:40.882 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_tcp_retrans_percent_over_threshold 2022-12-08 12:04:40.884 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.884 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold 2022-12-08 12:04:40.884 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant500_mem_hold_percent_over_threshold 2022-12-08 12:04:40.885 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_active_memstore_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.885 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_active_memstore_percent_over_threshold 2022-12-08 12:04:40.886 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_active_memstore_percent_over_threshold 2022-12-08 12:04:40.886 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 12:04:40.887 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_cpu_percent_over_threshold 2022-12-08 12:04:40.887 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_cpu_percent_over_threshold 2022-12-08 12:04:40.888 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_memstore_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.889 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_memstore_percent_over_threshold 2022-12-08 12:04:40.889 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_memstore_percent_over_threshold 2022-12-08 12:04:40.890 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_sync_failed, duration=PT2M, resolveTimeout=PT1M 2022-12-08 12:04:40.890 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_failed 2022-12-08 12:04:40.891 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_sync_failed 2022-12-08 12:04:40.894 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_status_check_failed, duration=PT2M, resolveTimeout=PT1M 2022-12-08 12:04:40.895 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_status_check_failed 2022-12-08 12:04:40.895 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_status_check_failed 2022-12-08 12:04:40.895 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_sync_delay_time_too_long, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.896 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_delay_time_too_long 2022-12-08 12:04:40.896 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_sync_delay_time_too_long 2022-12-08 12:04:40.896 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_exists_expired_xa_trans, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.897 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_exists_expired_xa_trans 2022-12-08 12:04:40.897 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_exists_expired_xa_trans 2022-12-08 12:04:40.897 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=backup_storage_capacity_retry_times_exceeded, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.897 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_retry_times_exceeded 2022-12-08 12:04:40.898 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=backup_storage_capacity_retry_times_exceeded 2022-12-08 12:04:40.898 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=backup_storage_capacity_timeout_or_interrupted, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.898 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_timeout_or_interrupted 2022-12-08 12:04:40.898 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=backup_storage_capacity_timeout_or_interrupted 2022-12-08 12:04:40.899 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_unavailable, duration=PT2M, resolveTimeout=PT1M 2022-12-08 12:04:40.899 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_unavailable 2022-12-08 12:04:40.900 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_unavailable 2022-12-08 12:04:40.900 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ocp_remote_server_time_diff_too_large, duration=PT1M, resolveTimeout=PT1M 2022-12-08 12:04:40.901 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_remote_server_time_diff_too_large 2022-12-08 12:04:40.901 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ocp_remote_server_time_diff_too_large 2022-12-08 12:04:40.902 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxy_process_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.902 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_dead 2022-12-08 12:04:40.902 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxy_process_dead 2022-12-08 12:04:40.903 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxyd_process_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.903 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_dead 2022-12-08 12:04:40.903 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxyd_process_dead 2022-12-08 12:04:40.904 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxy_cannot_connected, duration=PT1M, resolveTimeout=PT10S 2022-12-08 12:04:40.905 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_cannot_connected 2022-12-08 12:04:40.905 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxy_cannot_connected 2022-12-08 12:04:40.906 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_install_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.907 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_install_disk_percent_over_threshold 2022-12-08 12:04:40.908 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_install_disk_percent_over_threshold 2022-12-08 12:04:40.909 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_data_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.909 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_data_disk_percent_over_threshold 2022-12-08 12:04:40.909 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_data_disk_percent_over_threshold 2022-12-08 12:04:40.910 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_log_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.910 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_log_disk_percent_over_threshold 2022-12-08 12:04:40.910 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_log_disk_percent_over_threshold 2022-12-08 12:04:40.911 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=monitor_exporter_unavaliable, duration=PT3M, resolveTimeout=PT1M 2022-12-08 12:04:40.912 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monitor_exporter_unavaliable 2022-12-08 12:04:40.912 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=monitor_exporter_unavaliable 2022-12-08 12:04:40.912 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_ntp_service_not_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.913 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_service_not_exist 2022-12-08 12:04:40.913 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_ntp_service_not_exist 2022-12-08 12:04:40.914 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_ntp_offset_too_large, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:40.914 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_offset_too_large 2022-12-08 12:04:40.914 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_ntp_offset_too_large 2022-12-08 12:04:40.915 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ic_server_connect_failed, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.915 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ic_server_connect_failed 2022-12-08 12:04:40.915 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ic_server_connect_failed 2022-12-08 12:04:40.916 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=vpc_connect_failed, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.916 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=vpc_connect_failed 2022-12-08 12:04:40.916 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=vpc_connect_failed 2022-12-08 12:04:40.917 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_disk_readonly, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.917 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_disk_readonly 2022-12-08 12:04:40.917 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_disk_readonly 2022-12-08 12:04:40.918 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_goroutine_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.918 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_goroutine_count_over_threshold 2022-12-08 12:04:40.918 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_goroutine_count_over_threshold 2022-12-08 12:04:40.919 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_open_fd_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.919 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_open_fd_count_over_threshold 2022-12-08 12:04:40.919 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_open_fd_count_over_threshold 2022-12-08 12:04:40.920 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_res_memory_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.920 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_res_memory_over_threshold 2022-12-08 12:04:40.920 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_res_memory_over_threshold 2022-12-08 12:04:40.921 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_compaction_error, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.921 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_compaction_error 2022-12-08 12:04:40.921 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_compaction_error 2022-12-08 12:04:40.922 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_no_frozen, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.922 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_frozen 2022-12-08 12:04:40.922 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_no_frozen 2022-12-08 12:04:40.923 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_no_compaction, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.923 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_compaction 2022-12-08 12:04:40.923 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_no_compaction 2022-12-08 12:04:40.930 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_log_disk_usage_high, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.930 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_disk_usage_high 2022-12-08 12:04:40.930 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_log_disk_usage_high 2022-12-08 12:04:40.931 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_task_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.931 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_task_timeout 2022-12-08 12:04:40.932 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_task_timeout 2022-12-08 12:04:40.932 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:40.933 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_task_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.933 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_task_timeout 2022-12-08 12:04:40.933 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_task_timeout 2022-12-08 12:04:40.934 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_expired_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.934 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_expired_trans_exist 2022-12-08 12:04:40.935 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_expired_trans_exist 2022-12-08 12:04:40.936 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_long_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.936 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_long_trans_exist 2022-12-08 12:04:40.936 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_long_trans_exist 2022-12-08 12:04:40.937 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_large_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:04:40.937 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_large_trans_exist 2022-12-08 12:04:40.937 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_large_trans_exist 2022-12-08 12:04:40.938 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=node_file_root_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:04:40.938 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_root_usage 2022-12-08 12:04:40.938 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=node_file_root_usage 2022-12-08 12:04:40.939 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:40.942 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2022-12-08 12:04:40.943 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_fd_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:04:40.943 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_fd_usage 2022-12-08 12:04:40.943 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_fd_usage 2022-12-08 12:04:40.944 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_sys_abnormal, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:40.944 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_sys_abnormal 2022-12-08 12:04:40.944 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_sys_abnormal 2022-12-08 12:04:41.068 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_util_full, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:41.068 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_full 2022-12-08 12:04:41.069 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_util_full 2022-12-08 12:04:41.070 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_util_hwm, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:41.070 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_hwm 2022-12-08 12:04:41.071 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_util_hwm 2022-12-08 12:04:41.071 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_kernel_io_hang, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:41.072 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_kernel_io_hang 2022-12-08 12:04:41.072 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_kernel_io_hang 2022-12-08 12:04:41.072 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_sda_ioawait, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:41.072 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_sda_ioawait 2022-12-08 12:04:41.073 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_sda_ioawait 2022-12-08 12:04:41.073 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_nvme_ioawait, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:41.074 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_nvme_ioawait 2022-12-08 12:04:41.074 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_nvme_ioawait 2022-12-08 12:04:41.074 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_drop, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:41.074 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_drop 2022-12-08 12:04:41.074 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_drop 2022-12-08 12:04:41.075 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_error, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:41.075 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_error 2022-12-08 12:04:41.075 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_error 2022-12-08 12:04:41.076 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_not_exist, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:04:41.076 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_not_exist 2022-12-08 12:04:41.076 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_not_exist 2022-12-08 12:04:41.077 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_core_dump, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:04:41.077 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_core_dump 2022-12-08 12:04:41.077 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_core_dump 2022-12-08 12:04:41.078 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_nic_1000m_full, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:41.078 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_full 2022-12-08 12:04:41.078 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_nic_1000m_full 2022-12-08 12:04:41.079 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_nic_1000m_hwm, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:41.079 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_hwm 2022-12-08 12:04:41.079 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_nic_1000m_hwm 2022-12-08 12:04:41.080 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_overload, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:04:41.080 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_overload 2022-12-08 12:04:41.080 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_overload 2022-12-08 12:04:41.081 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=node_file_inode_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:04:41.081 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_inode_usage 2022-12-08 12:04:41.082 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=node_file_inode_usage 2022-12-08 12:04:41.083 INFO 42 --- [alarm-task-1,,1b1e9b23a238] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_cpu_irq_error, duration=PT1M, resolveTimeout=PT10S 2022-12-08 12:04:41.083 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_cpu_irq_error 2022-12-08 12:04:41.083 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_cpu_irq_error 2022-12-08 12:04:41.083 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=75, updatedCount=75, failedToUpdateCount=0 2022-12-08 12:04:41.084 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2023 2022-12-08 12:04:41.088 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:41.089 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:41.091 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2023 values less than (1704067200)) 2022-12-08 12:04:41.347 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:04:40.803154+08:00, resultsCount=0 2022-12-08 12:04:41.347 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:04:40.803154+08:00, resultsCount=0 2022-12-08 12:04:41.347 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:04:40.803154+08:00 2022-12-08 12:04:41.453 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:41.454 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:41.457 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2022-12-08 12:04:41.471 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:41.471 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:41.476 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:04:41.481 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:41.482 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:41.484 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2022-12-08 12:04:41.978 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221201 2022-12-08 12:04:41.982 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:41.983 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:41.985 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221201 values less than (1669824000)) 2022-12-08 12:04:42.010 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:04:42.440 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:42.440 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:42.443 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:42.452 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221202 2022-12-08 12:04:42.455 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:42.455 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:42.457 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221202 values less than (1669910400)) 2022-12-08 12:04:42.692 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:42.697 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:42.775 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:42.776 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:42.864 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:42.864 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:43.046 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:43.046 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:43.049 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:43.057 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221203 2022-12-08 12:04:43.060 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:43.061 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:43.063 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221203 values less than (1669996800)) 2022-12-08 12:04:44.264 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1201, sql=alter table `metric_data_second` add partition(partition p20221203 values less than (1669996800)) 2022-12-08 12:04:44.269 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:44.269 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:44.272 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:44.283 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221204 2022-12-08 12:04:44.286 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:44.286 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:44.290 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221204 values less than (1670083200)) 2022-12-08 12:04:44.869 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:44.869 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:44.873 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:44.884 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221205 2022-12-08 12:04:44.893 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:44.894 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:44.897 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221205 values less than (1670169600)) 2022-12-08 12:04:45.232 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:04:45.239 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:04:45.685 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:45.686 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:45.689 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:45.698 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:45.700 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221206 2022-12-08 12:04:45.703 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:45.705 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:45.705 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:45.708 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221206 values less than (1670256000)) 2022-12-08 12:04:45.862 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:45.934 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:46.339 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:04:46.700 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:46.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:46.707 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:46.725 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221207 2022-12-08 12:04:46.730 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:46.730 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:46.733 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221207 values less than (1670342400)) 2022-12-08 12:04:47.363 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:47.364 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:47.367 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:47.386 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221208 2022-12-08 12:04:47.390 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:47.390 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:47.394 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221208 values less than (1670428800)) 2022-12-08 12:04:47.985 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:47.985 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:47.990 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:48.005 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221209 2022-12-08 12:04:48.011 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:48.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:48.033 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221209 values less than (1670515200)) 2022-12-08 12:04:48.704 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:48.712 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:48.713 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:48.714 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:48.717 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:48.730 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221210 2022-12-08 12:04:48.739 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:48.740 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:48.743 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221210 values less than (1670601600)) 2022-12-08 12:04:49.170 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:49.171 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:49.241 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:49.242 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:49.291 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:49.291 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:49.294 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:49.311 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221211 2022-12-08 12:04:49.315 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:49.315 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:49.319 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221211 values less than (1670688000)) 2022-12-08 12:04:49.631 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:49.685 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:04:49.842 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:49.843 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:49.846 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 12:04:49.859 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:49.860 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:49.863 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:04:49.870 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:49.871 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:49.874 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2022-12-08 12:04:49.912 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:49.935 INFO 42 --- [pool-ocp-schedules-2,,06e573a8548a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:04:50.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:04:50.451 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:04:50.449389+08:00, lastProcessTime=2022-12-08T12:04:40.803154+08:00 2022-12-08 12:04:50.520 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:04:50.534 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221108 2022-12-08 12:04:50.548 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:50.548 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:50.556 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221108 values less than (1667836800)) 2022-12-08 12:04:50.643 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:04:50.449389+08:00, resultsCount=0 2022-12-08 12:04:50.644 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:04:50.449389+08:00, resultsCount=0 2022-12-08 12:04:50.644 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:04:50.449389+08:00 2022-12-08 12:04:51.522 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:51.522 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:51.526 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:51.538 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221109 2022-12-08 12:04:51.541 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:51.541 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:51.546 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221109 values less than (1667923200)) 2022-12-08 12:04:51.571 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:04:51.576 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:04:51.700 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:04:51.713 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:51.720 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:52.013 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:52.013 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:52.016 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:52.031 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221110 2022-12-08 12:04:52.034 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:52.034 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:52.037 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221110 values less than (1668009600)) 2022-12-08 12:04:52.046 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:04:52.280 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:52.311 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:52.667 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:04:52.867 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:52.868 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:52.871 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:52.886 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221111 2022-12-08 12:04:52.889 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:52.890 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:52.893 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221111 values less than (1668096000)) 2022-12-08 12:04:53.674 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:53.675 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:53.678 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:53.694 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221112 2022-12-08 12:04:53.699 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:53.700 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:53.707 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221112 values less than (1668182400)) 2022-12-08 12:04:54.493 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:54.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:54.504 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:54.530 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221113 2022-12-08 12:04:54.539 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:54.539 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:54.543 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221113 values less than (1668268800)) 2022-12-08 12:04:54.721 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:54.726 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:55.116 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:55.117 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:55.120 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:55.134 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221114 2022-12-08 12:04:55.138 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:55.139 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:55.143 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221114 values less than (1668355200)) 2022-12-08 12:04:55.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:55.479 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:55.491 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:04:55.492 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:04:55.824 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:55.824 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:55.829 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:55.848 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221115 2022-12-08 12:04:55.853 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:55.853 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:55.857 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221115 values less than (1668441600)) 2022-12-08 12:04:56.801 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:56.802 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:56.809 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:56.835 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221116 2022-12-08 12:04:56.845 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:56.846 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:56.850 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221116 values less than (1668528000)) 2022-12-08 12:04:57.694 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:57.695 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:57.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:57.723 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221117 2022-12-08 12:04:57.727 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:04:57.727 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:57.728 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:57.732 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221117 values less than (1668614400)) 2022-12-08 12:04:57.733 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:04:57.913 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:04:57.920 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:04:58.598 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:58.598 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:58.601 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:58.606 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:58.615 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221118 2022-12-08 12:04:58.620 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:58.621 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:58.625 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221118 values less than (1668700800)) 2022-12-08 12:04:58.656 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:04:59.061 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:04:59.650 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1025, sql=alter table `metric_data_minute` add partition(partition p20221118 values less than (1668700800)) 2022-12-08 12:04:59.655 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:59.655 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:59.659 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:04:59.667 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:04:59.672 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221119 2022-12-08 12:04:59.676 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:04:59.677 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:04:59.680 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221119 values less than (1668787200)) 2022-12-08 12:04:59.753 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:04:59.939 INFO 42 --- [pool-ocp-schedules-4,,148f85fe0c91] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:05:00.109 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:00.285 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:00.285 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:00.289 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:00.300 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221120 2022-12-08 12:05:00.303 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:00.304 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:00.306 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221120 values less than (1668873600)) 2022-12-08 12:05:00.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:05:00.428 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:05:00.426646+08:00, lastProcessTime=2022-12-08T12:04:50.449389+08:00 2022-12-08 12:05:00.659 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:05:00.426646+08:00, resultsCount=0 2022-12-08 12:05:00.659 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:05:00.426646+08:00, resultsCount=0 2022-12-08 12:05:00.659 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:05:00.426646+08:00 2022-12-08 12:05:00.734 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:00.741 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:00.913 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:05:01.123 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:05:00.0, currentDate=Thu Dec 08 12:05:01 CST 2022 2022-12-08 12:05:01.124 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=null, nextRunTime=2022-12-08 12:05:00.0} 2022-12-08 12:05:01.145 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 12:05:01.145 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:05:01.145 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 12:05:01.470 INFO 42 --- [pool-ocp-schedules-13,,14df64618e9f] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:05:01.470 INFO 42 --- [pool-ocp-schedules-13,,14df64618e9f] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:05:01.509 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:05:00.0, currentDate=Thu Dec 08 12:05:01 CST 2022 2022-12-08 12:05:01.510 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:05:00.0} 2022-12-08 12:05:01.724 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:01.724 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:01.755 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 12:05:01.755 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 12:05:01.788 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:01.788 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:01.865 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:03.0, nextRun=2022-12-08 12:05:00.0, currentDate=Thu Dec 08 12:05:01 CST 2022 2022-12-08 12:05:01.865 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:04:03.0, nextRunTime=2022-12-08 12:05:00.0} 2022-12-08 12:05:01.883 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:05:01.883 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:05:01.884 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:05:01.975 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:03.0, nextRun=2022-12-08 12:05:00.0, currentDate=Thu Dec 08 12:05:01 CST 2022 2022-12-08 12:05:01.976 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:04:03.0, nextRunTime=2022-12-08 12:05:00.0} 2022-12-08 12:05:02.168 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1862, sql=alter table `metric_data_minute` add partition(partition p20221120 values less than (1668873600)) 2022-12-08 12:05:02.173 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:02.173 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:02.177 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:02.188 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221121 2022-12-08 12:05:02.192 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:02.193 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:02.196 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221121 values less than (1668960000)) 2022-12-08 12:05:02.227 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:05:02.263 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.o.o.p.t.i.a.CollectTransSatatSchedule : The last trans sql collect task is still running, skip current task 2022-12-08 12:05:02.264 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Collect trans stat to SqlAggregateData for alarm 2022-12-08 12:05:02.653 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:03.0, nextRun=2022-12-08 12:05:00.0, currentDate=Thu Dec 08 12:05:02 CST 2022 2022-12-08 12:05:02.654 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:04:03.0, nextRunTime=2022-12-08 12:05:00.0} 2022-12-08 12:05:02.701 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.o.o.p.s.i.a.CollectSlowSqlSchedule : The last slow sql collect task is still running, skip current task 2022-12-08 12:05:02.702 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Collect SlowSql to SqlAggregateData for alarm 2022-12-08 12:05:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,d054b3222d23] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472360, interval=60 2022-12-08 12:05:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,d054b3222d23] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472302, count=0, elapsed=1668801830403 2022-12-08 12:05:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,9be9c4ba651d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472360, interval=60 2022-12-08 12:05:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,9be9c4ba651d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472302, count=0, elapsed=1668801830412 2022-12-08 12:05:02.847 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:31.0, nextRun=2022-12-08 12:05:00.0, currentDate=Thu Dec 08 12:05:02 CST 2022 2022-12-08 12:05:02.847 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:04:31.0, nextRunTime=2022-12-08 12:05:00.0} 2022-12-08 12:05:02.878 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:05:02.879 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:05:02.879 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:05:03.039 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:05:00.0, currentDate=Thu Dec 08 12:05:03 CST 2022 2022-12-08 12:05:03.040 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:05:00.0} 2022-12-08 12:05:03.065 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 12:05:03.066 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:05:03.066 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 12:05:03.165 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:03.0, nextRun=2022-12-08 12:05:00.0, currentDate=Thu Dec 08 12:05:03 CST 2022 2022-12-08 12:05:03.166 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:04:03.0, nextRunTime=2022-12-08 12:05:00.0} 2022-12-08 12:05:03.183 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:05:03.184 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:05:03.184 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:05:03.463 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1267, sql=alter table `metric_data_minute` add partition(partition p20221121 values less than (1668960000)) 2022-12-08 12:05:03.467 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:03.467 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:03.470 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:03.484 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221122 2022-12-08 12:05:03.489 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:03.489 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:03.492 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221122 values less than (1669046400)) 2022-12-08 12:05:03.743 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:03.749 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:04.239 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:04.240 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:04.243 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:04.255 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221123 2022-12-08 12:05:04.259 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:04.259 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:04.262 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221123 values less than (1669132800)) 2022-12-08 12:05:04.336 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:05:04.343 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:05:04.870 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:04.870 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:04.873 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:04.876 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:04.889 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:04.893 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221124 2022-12-08 12:05:04.896 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:04.897 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:04.899 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221124 values less than (1669219200)) 2022-12-08 12:05:05.452 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:05:05.611 ERROR 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing SQL_PERF_DIAGNOSER org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=87) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=87) Table has no partition for value ; (conn=87) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=87) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.insert(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy412.save(Unknown Source) ~[na:na] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:49) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$ad3ec26.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=87) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_312] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_312] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 26 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 40 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 41 common frames omitted 2022-12-08 12:05:05.616 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:05.616 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:05.623 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:05.627 ERROR 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing PLAN_CHANGE_DETECTOR org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=86) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=86) Table has no partition for value ; (conn=86) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=86) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.insert(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy412.save(Unknown Source) ~[na:na] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:49) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$ad3ec26.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=86) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_312] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_312] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 26 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 40 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 41 common frames omitted 2022-12-08 12:05:05.634 ERROR 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing SQL_INDEX_DIAGNOSER org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=2097201) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=2097201) Table has no partition for value ; (conn=2097201) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=2097201) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.insert(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy412.save(Unknown Source) ~[na:na] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:49) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$ad3ec26.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=2097201) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_312] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_312] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 26 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 40 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 41 common frames omitted 2022-12-08 12:05:05.641 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221125 2022-12-08 12:05:05.648 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:05.649 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:05.652 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221125 values less than (1669305600)) 2022-12-08 12:05:05.778 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:05:05.980 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:07.0, nextRun=2022-12-08 12:05:05.0, currentDate=Thu Dec 08 12:05:05 CST 2022 2022-12-08 12:05:05.980 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:04:07.0, nextRunTime=2022-12-08 12:05:05.0} 2022-12-08 12:05:06.001 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:05:06.002 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:05:06.002 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:05:06.114 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:05:06.157 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:04:35+08:00, updateTime=2022-12-08T12:04:35+08:00, expireTime=null, isLeader=false} 2022-12-08 12:05:06.165 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 12:05:06.246 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:05:06.632 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:06.633 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:06.636 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:06.652 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221126 2022-12-08 12:05:06.656 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:06.656 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:06.658 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221126 values less than (1669392000)) 2022-12-08 12:05:06.729 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:05:06.750 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:06.755 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:07.672 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1014, sql=alter table `metric_data_minute` add partition(partition p20221126 values less than (1669392000)) 2022-12-08 12:05:07.676 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:07.676 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:07.683 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:07.702 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221127 2022-12-08 12:05:07.705 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:07.706 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:07.710 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221127 values less than (1669478400)) 2022-12-08 12:05:07.954 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:07.954 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:07.980 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:07.981 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:09.172 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1462, sql=alter table `metric_data_minute` add partition(partition p20221127 values less than (1669478400)) 2022-12-08 12:05:09.176 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:09.177 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:09.180 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:09.192 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221128 2022-12-08 12:05:09.196 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:09.197 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:09.200 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221128 values less than (1669564800)) 2022-12-08 12:05:09.754 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:09.755 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:09.765 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:09.765 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:09.765 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:09.768 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:09.790 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221129 2022-12-08 12:05:09.793 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:09.794 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:09.798 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221129 values less than (1669651200)) 2022-12-08 12:05:09.940 INFO 42 --- [pool-ocp-schedules-4,,41cfbbbf1189] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:05:10.071 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:05:10.208 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 1, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:10.260 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=1, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:10.127+08:00, endTime=null} 2022-12-08 12:05:10.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:05:10.405 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 2, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:10.447 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:10.503 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:05:10.500192+08:00, lastProcessTime=2022-12-08T12:05:00.426646+08:00 2022-12-08 12:05:10.520 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=2, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:10.369+08:00, endTime=null} 2022-12-08 12:05:10.639 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 3, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:10.718 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:10.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:10.726 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:10.740 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:05:10.500192+08:00, resultsCount=0 2022-12-08 12:05:10.741 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:05:10.500192+08:00, resultsCount=0 2022-12-08 12:05:10.741 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:05:10.500192+08:00 2022-12-08 12:05:10.742 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=3, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:10.606+08:00, endTime=null} 2022-12-08 12:05:10.743 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221130 2022-12-08 12:05:10.749 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:10.750 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:10.753 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221130 values less than (1669737600)) 2022-12-08 12:05:10.884 INFO 42 --- [pool-subtask-executor1,71424bfefee043c0,3dda3822a0d2] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=1, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:10.120+08:00, sub_task_instance_id=1}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:10.917 INFO 42 --- [pool-subtask-executor2,71424bfefee043c0,fdaba0fdb067] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=2, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=2, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:10.368+08:00, sub_task_instance_id=2}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:11.007 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 4, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:11.112 INFO 42 --- [pool-subtask-executor2,71424bfefee043c0,fdaba0fdb067] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 2, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:11.115 INFO 42 --- [pool-subtask-executor1,71424bfefee043c0,3dda3822a0d2] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 1, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:11.121 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=4, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:10.995+08:00, endTime=null} 2022-12-08 12:05:11.184 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:05:11.226 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 5, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:11.233 INFO 42 --- [pool-subtask-executor3,71424bfefee043c0,2e2d4184c926] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=3, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=3, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:10.604+08:00, sub_task_instance_id=3}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:11.458 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:05:11.470 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:05:11.485 INFO 42 --- [pool-subtask-executor3,71424bfefee043c0,2e2d4184c926] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 3, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:11.499 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=5, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:05:11.210+08:00, endTime=null} 2022-12-08 12:05:11.692 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 6, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:11.695 INFO 42 --- [pool-subtask-executor4,71424bfefee043c0,8004feb877e0] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=4, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=4, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:10.992+08:00, sub_task_instance_id=4}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:11.888 INFO 42 --- [pool-subtask-executor4,71424bfefee043c0,8004feb877e0] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 4, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:11.894 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=6, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T12:05:11.675+08:00, endTime=null} 2022-12-08 12:05:11.932 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:1, status:SUCCESS 2022-12-08 12:05:12.001 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 7, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:12.011 INFO 42 --- [pool-subtask-executor5,71424bfefee043c0,77e5cc883a71] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=5, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=5, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:11.209+08:00, sub_task_instance_id=5}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:12.144 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:1, status:SUCCESS 2022-12-08 12:05:12.267 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=7, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T12:05:11.984+08:00, endTime=null} 2022-12-08 12:05:12.317 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:05:12.346 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 8, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:12.363 INFO 42 --- [pool-subtask-executor6,71424bfefee043c0,be6b1c43c41b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=6, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=6, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:11.674+08:00, sub_task_instance_id=6}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:12.614 INFO 42 --- [pool-subtask-executor5,71424bfefee043c0,77e5cc883a71] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 5, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:12.624 INFO 42 --- [pool-subtask-executor6,71424bfefee043c0,be6b1c43c41b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 6, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:12.627 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=8, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:05:12.333+08:00, endTime=null} 2022-12-08 12:05:12.653 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:2, status:SUCCESS 2022-12-08 12:05:12.672 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:2, status:SUCCESS 2022-12-08 12:05:12.752 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 9, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:12.766 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:12.767 INFO 42 --- [pool-subtask-executor7,71424bfefee043c0,768361d5a2f4] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=7, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=7, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:11.983+08:00, sub_task_instance_id=7}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:12.771 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:12.922 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2169, sql=alter table `metric_data_minute` add partition(partition p20221130 values less than (1669737600)) 2022-12-08 12:05:12.926 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:12.926 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:12.929 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:12.944 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221201 2022-12-08 12:05:12.956 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:12.956 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:12.960 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221201 values less than (1669824000)) 2022-12-08 12:05:13.026 INFO 42 --- [pool-subtask-executor7,71424bfefee043c0,768361d5a2f4] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 7, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:13.037 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=9, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:05:12.725+08:00, endTime=null} 2022-12-08 12:05:13.060 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:3, status:SUCCESS 2022-12-08 12:05:13.070 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:3, status:SUCCESS 2022-12-08 12:05:13.146 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 10, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:13.180 INFO 42 --- [pool-subtask-executor8,71424bfefee043c0,875954784a20] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=8, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=8, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:12.332+08:00, sub_task_instance_id=8}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:13.180 INFO 42 --- [pool-subtask-executor8,71424bfefee043c0,875954784a20] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:05:13.201 INFO 42 --- [pool-subtask-executor8,71424bfefee043c0,875954784a20] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:05:13.547 INFO 42 --- [pool-subtask-executor8,71424bfefee043c0,875954784a20] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 8, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:13.561 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=10, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:05:13.122+08:00, endTime=null} 2022-12-08 12:05:13.684 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:4, status:SUCCESS 2022-12-08 12:05:13.691 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:4, status:SUCCESS 2022-12-08 12:05:13.694 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 11, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,93f4764a2975] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:05:13.780 INFO 42 --- [pool-subtask-executor10,71424bfefee043c0,b4b0890f47d2] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=10, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=10, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:13.121+08:00, sub_task_instance_id=10}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:14.156 INFO 42 --- [pool-prometheus-cache-monitor1,,93f4764a2975] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:05:14.243 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=11, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:13.665+08:00, endTime=null} 2022-12-08 12:05:14.356 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:5, status:SUCCESS 2022-12-08 12:05:14.359 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 12, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:14.364 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:5, status:SUCCESS 2022-12-08 12:05:14.452 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:14.481 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:14.551 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1591, sql=alter table `metric_data_minute` add partition(partition p20221201 values less than (1669824000)) 2022-12-08 12:05:14.555 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:14.555 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:14.558 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:14.569 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221202 2022-12-08 12:05:14.573 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:14.573 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:14.576 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221202 values less than (1669910400)) 2022-12-08 12:05:14.631 INFO 42 --- [pool-subtask-executor10,71424bfefee043c0,b4b0890f47d2] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 10, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:14.703 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=12, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:14.330+08:00, endTime=null} 2022-12-08 12:05:14.724 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:6, status:SUCCESS 2022-12-08 12:05:14.740 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:6, status:SUCCESS 2022-12-08 12:05:14.845 INFO 42 --- [pool-subtask-executor11,71424bfefee043c0,8084ee5bc5ae] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=11, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=11, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:13.663+08:00, sub_task_instance_id=11}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:14.849 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 13, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:14.937 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=13, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:14.820+08:00, endTime=null} 2022-12-08 12:05:14.937 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:7, status:SUCCESS 2022-12-08 12:05:14.948 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:7, status:SUCCESS 2022-12-08 12:05:14.997 INFO 42 --- [pool-subtask-executor11,71424bfefee043c0,8084ee5bc5ae] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 11, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:15.030 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:05:15.046 INFO 42 --- [pool-subtask-executor12,71424bfefee043c0,564eca4d7c9d] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=12, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=12, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:14.329+08:00, sub_task_instance_id=12}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:15.072 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 14, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:15.415 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:8, status:SUCCESS 2022-12-08 12:05:15.423 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:8, status:SUCCESS 2022-12-08 12:05:15.425 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=14, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:05:15.051+08:00, endTime=null} 2022-12-08 12:05:15.428 INFO 42 --- [pool-subtask-executor12,71424bfefee043c0,564eca4d7c9d] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 12, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:15.507 INFO 42 --- [pool-subtask-executor13,71424bfefee043c0,82cc52f7d95e] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=13, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=13, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:14.819+08:00, sub_task_instance_id=13}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:15.579 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 15, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:15.639 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:9, status:SUCCESS 2022-12-08 12:05:15.657 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:9, status:SUCCESS 2022-12-08 12:05:15.664 INFO 42 --- [pool-subtask-executor13,71424bfefee043c0,82cc52f7d95e] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 13, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:15.667 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=15, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:15.536+08:00, endTime=null} 2022-12-08 12:05:15.739 INFO 42 --- [pool-subtask-executor14,71424bfefee043c0,275e75ee91fa] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=14, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=14, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:15.049+08:00, sub_task_instance_id=14}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:15.770 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 16, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:15.772 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:15.791 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:15.826 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1250, sql=alter table `metric_data_minute` add partition(partition p20221202 values less than (1669910400)) 2022-12-08 12:05:15.830 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:15.830 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:15.833 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:15.844 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221203 2022-12-08 12:05:15.847 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:15.848 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:15.851 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221203 values less than (1669996800)) 2022-12-08 12:05:16.323 INFO 42 --- [pool-subtask-executor14,71424bfefee043c0,275e75ee91fa] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 14, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:16.347 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=16, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:05:15.750+08:00, endTime=null} 2022-12-08 12:05:16.364 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:10, status:SUCCESS 2022-12-08 12:05:16.375 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:10, status:SUCCESS 2022-12-08 12:05:16.494 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 17, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:16.523 INFO 42 --- [pool-subtask-executor15,71424bfefee043c0,286d7b3f42fb] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=15, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=15, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:15.534+08:00, sub_task_instance_id=15}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:16.587 INFO 42 --- [pool-subtask-executor16,71424bfefee043c0,a4190006b2dc] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=16, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=16, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:15.749+08:00, sub_task_instance_id=16}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 12:05:16.798 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=17, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:16.449+08:00, endTime=null} 2022-12-08 12:05:16.851 INFO 42 --- [pool-subtask-executor15,71424bfefee043c0,286d7b3f42fb] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 15, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:16.867 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:11, status:SUCCESS 2022-12-08 12:05:16.869 INFO 42 --- [pool-subtask-executor16,71424bfefee043c0,a4190006b2dc] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 16, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:16.874 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:11, status:SUCCESS 2022-12-08 12:05:16.910 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 18, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:17.279 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=18, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:16.883+08:00, endTime=null} 2022-12-08 12:05:17.379 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:12, status:SUCCESS 2022-12-08 12:05:17.387 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:12, status:SUCCESS 2022-12-08 12:05:17.413 INFO 42 --- [pool-subtask-executor17,71424bfefee043c0,a45b7eaa8e14] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=17, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=17, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:16.447+08:00, sub_task_instance_id=17}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:17.431 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 19, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:17.563 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1712, sql=alter table `metric_data_minute` add partition(partition p20221203 values less than (1669996800)) 2022-12-08 12:05:17.569 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:17.569 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:17.573 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:17.586 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221204 2022-12-08 12:05:17.590 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:17.590 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:17.593 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221204 values less than (1670083200)) 2022-12-08 12:05:17.698 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:17.699 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:17.713 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:17.714 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:17.811 INFO 42 --- [pool-subtask-executor17,71424bfefee043c0,a45b7eaa8e14] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 17, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:17.823 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=19, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:05:17.409+08:00, endTime=null} 2022-12-08 12:05:17.850 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:13, status:SUCCESS 2022-12-08 12:05:17.865 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:13, status:SUCCESS 2022-12-08 12:05:17.950 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 20, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:17.969 INFO 42 --- [pool-subtask-executor18,71424bfefee043c0,c36cbc62fc2e] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=18, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=18, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:16.882+08:00, sub_task_instance_id=18}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:18.792 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:18.801 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:18.827 INFO 42 --- [pool-subtask-executor18,71424bfefee043c0,c36cbc62fc2e] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 18, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:18.843 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=20, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T12:05:17.932+08:00, endTime=null} 2022-12-08 12:05:18.857 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:14, status:SUCCESS 2022-12-08 12:05:18.865 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:14, status:SUCCESS 2022-12-08 12:05:18.936 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 21, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:18.940 INFO 42 --- [pool-subtask-executor19,71424bfefee043c0,eb3585225d9b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=19, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=19, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:17.407+08:00, sub_task_instance_id=19}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:18.941 INFO 42 --- [pool-subtask-executor19,71424bfefee043c0,eb3585225d9b] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:05:18.954 INFO 42 --- [pool-subtask-executor19,71424bfefee043c0,eb3585225d9b] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:05:19.213 INFO 42 --- [pool-subtask-executor19,71424bfefee043c0,eb3585225d9b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 19, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:19.224 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=21, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T12:05:18.922+08:00, endTime=null} 2022-12-08 12:05:19.255 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:15, status:SUCCESS 2022-12-08 12:05:19.273 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:15, status:SUCCESS 2022-12-08 12:05:19.351 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 22, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:19.361 INFO 42 --- [pool-subtask-executor20,71424bfefee043c0,c9a8639f2dee] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=20, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=20, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:17.930+08:00, sub_task_instance_id=20}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:19.427 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=22, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:05:19.332+08:00, endTime=null} 2022-12-08 12:05:19.442 INFO 42 --- [pool-subtask-executor20,71424bfefee043c0,c9a8639f2dee] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 20, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:19.453 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:16, status:SUCCESS 2022-12-08 12:05:19.464 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:16, status:SUCCESS 2022-12-08 12:05:19.479 INFO 42 --- [pool-subtask-executor21,71424bfefee043c0,5b4863dba14d] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=21, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=21, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:18.921+08:00, sub_task_instance_id=21}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:19.525 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 23, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:19.787 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:17, status:SUCCESS 2022-12-08 12:05:19.803 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:17, status:SUCCESS 2022-12-08 12:05:19.807 INFO 42 --- [pool-subtask-executor21,71424bfefee043c0,5b4863dba14d] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 21, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:19.807 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=23, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:05:19.509+08:00, endTime=null} 2022-12-08 12:05:19.922 INFO 42 --- [pool-subtask-executor22,71424bfefee043c0,72e05e9c860e] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=22, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=22, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:19.331+08:00, sub_task_instance_id=22}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:19.941 INFO 42 --- [pool-ocp-schedules-10,,7ca903473802] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:05:19.950 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 24, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:20.039 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=24, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T12:05:19.887+08:00, endTime=null} 2022-12-08 12:05:20.055 INFO 42 --- [pool-subtask-executor22,71424bfefee043c0,72e05e9c860e] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 22, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:20.062 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:18, status:SUCCESS 2022-12-08 12:05:20.069 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:18, status:SUCCESS 2022-12-08 12:05:20.071 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:20.081 INFO 42 --- [pool-subtask-executor23,71424bfefee043c0,c35ce3c3777f] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=23, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=23, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:19.507+08:00, sub_task_instance_id=23}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:20.082 INFO 42 --- [pool-subtask-executor23,71424bfefee043c0,c35ce3c3777f] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:05:20.105 INFO 42 --- [pool-subtask-executor23,71424bfefee043c0,c35ce3c3777f] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:05:20.146 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:05:20.153 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2560, sql=alter table `metric_data_minute` add partition(partition p20221204 values less than (1670083200)) 2022-12-08 12:05:20.156 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:20.157 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:20.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:20.162 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 25, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:20.174 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221205 2022-12-08 12:05:20.178 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:20.179 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:20.183 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221205 values less than (1670169600)) 2022-12-08 12:05:20.197 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:19, status:SUCCESS 2022-12-08 12:05:20.205 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:19, status:SUCCESS 2022-12-08 12:05:20.228 INFO 42 --- [pool-subtask-executor23,71424bfefee043c0,c35ce3c3777f] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 23, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:20.232 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=25, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:05:20.118+08:00, endTime=null} 2022-12-08 12:05:20.261 INFO 42 --- [pool-subtask-executor24,71424bfefee043c0,f5cdc12f8f4b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=24, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=24, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:19.885+08:00, sub_task_instance_id=24}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:20.262 INFO 42 --- [pool-subtask-executor24,71424bfefee043c0,f5cdc12f8f4b] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2022-12-08 12:05:20.282 INFO 42 --- [pool-subtask-executor24,71424bfefee043c0,f5cdc12f8f4b] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2022-12-08 12:05:20.312 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 26, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:20.334 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:20.0, nextRun=2022-12-08 12:05:20.0, currentDate=Thu Dec 08 12:05:20 CST 2022 2022-12-08 12:05:20.335 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:04:20.0, nextRunTime=2022-12-08 12:05:20.0} 2022-12-08 12:05:20.352 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:05:20.353 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:05:20.353 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:05:20.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:05:20.412 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:05:20.412041+08:00, lastProcessTime=2022-12-08T12:05:10.500192+08:00 2022-12-08 12:05:20.539 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:20.551 INFO 42 --- [pool-subtask-executor24,71424bfefee043c0,f5cdc12f8f4b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 24, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:20.565 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=26, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:05:20.299+08:00, endTime=null} 2022-12-08 12:05:20.576 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:20, status:SUCCESS 2022-12-08 12:05:20.580 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:05:20.412041+08:00, resultsCount=0 2022-12-08 12:05:20.581 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:05:20.412041+08:00, resultsCount=0 2022-12-08 12:05:20.581 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:05:20.412041+08:00 2022-12-08 12:05:20.588 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:20, status:SUCCESS 2022-12-08 12:05:20.607 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:05:20.623 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:05:20.724 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:21, status:SUCCESS 2022-12-08 12:05:20.762 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:21, status:SUCCESS 2022-12-08 12:05:20.880 INFO 42 --- [pool-subtask-executor26,71424bfefee043c0,0cc0214d3616] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=26, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=26, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:20.297+08:00, sub_task_instance_id=26}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:20.895 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:22, status:SUCCESS 2022-12-08 12:05:20.905 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:22, status:SUCCESS 2022-12-08 12:05:21.019 INFO 42 --- [pool-subtask-executor26,71424bfefee043c0,0cc0214d3616] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 26, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:21.042 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:23, status:SUCCESS 2022-12-08 12:05:21.049 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:23, status:SUCCESS 2022-12-08 12:05:21.094 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:21.094 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:21.097 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:21.110 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221206 2022-12-08 12:05:21.114 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:21.114 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:21.117 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221206 values less than (1670256000)) 2022-12-08 12:05:21.133 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:24, status:SUCCESS 2022-12-08 12:05:21.139 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:24, status:SUCCESS 2022-12-08 12:05:21.204 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:25, status:SUCCESS 2022-12-08 12:05:21.210 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:25, status:SUCCESS 2022-12-08 12:05:21.299 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:26, status:SUCCESS 2022-12-08 12:05:21.307 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:26, status:SUCCESS 2022-12-08 12:05:21.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:21.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:21.525 INFO 42 --- [pool-ocp-schedules-13,,5ae95a0dd689] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:05:21.526 INFO 42 --- [pool-ocp-schedules-13,,5ae95a0dd689] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:05:21.677 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:21.677 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:21.679 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 27, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:21.680 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:21.691 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221207 2022-12-08 12:05:21.695 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:21.695 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:21.699 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221207 values less than (1670342400)) 2022-12-08 12:05:21.708 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=27, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:05:21.666+08:00, endTime=null} 2022-12-08 12:05:21.791 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:05:21.802 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:21.806 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:21.837 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:05:22.103 INFO 42 --- [pool-subtask-executor27,71424bfefee043c0,629e21618bb6] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=27, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=27, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:21.665+08:00, sub_task_instance_id=27}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:22.318 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:05:22.365 INFO 42 --- [pool-subtask-executor27,71424bfefee043c0,629e21618bb6] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 27, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:22.623 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:05:22.928 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:27, status:SUCCESS 2022-12-08 12:05:22.937 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:27, status:SUCCESS 2022-12-08 12:05:23.269 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1570, sql=alter table `metric_data_minute` add partition(partition p20221207 values less than (1670342400)) 2022-12-08 12:05:23.275 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:23.276 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:23.279 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:23.296 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221208 2022-12-08 12:05:23.300 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:23.300 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:23.304 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221208 values less than (1670428800)) 2022-12-08 12:05:24.393 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1089, sql=alter table `metric_data_minute` add partition(partition p20221208 values less than (1670428800)) 2022-12-08 12:05:24.406 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:24.406 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:24.411 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:24.430 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221209 2022-12-08 12:05:24.434 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:24.434 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:24.437 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221209 values less than (1670515200)) 2022-12-08 12:05:24.573 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:24.573 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:24.573 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:24.574 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:24.806 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:24.811 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:25.372 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:25.0, nextRun=2022-12-08 12:05:25.0, currentDate=Thu Dec 08 12:05:25 CST 2022 2022-12-08 12:05:25.373 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:04:25.0, nextRunTime=2022-12-08 12:05:25.0} 2022-12-08 12:05:25.438 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:05:25.439 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:05:25.439 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:05:25.842 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 28, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:25.896 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=28, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:05:25.823+08:00, endTime=null} 2022-12-08 12:05:25.973 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1536, sql=alter table `metric_data_minute` add partition(partition p20221209 values less than (1670515200)) 2022-12-08 12:05:25.976 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:25.977 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:25.979 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:25.993 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221210 2022-12-08 12:05:26.000 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:26.001 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:26.004 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221210 values less than (1670601600)) 2022-12-08 12:05:26.083 INFO 42 --- [pool-subtask-executor28,71424bfefee043c0,dd945abbe46f] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=28, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=28, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:25.821+08:00, sub_task_instance_id=28}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 12:05:26.189 INFO 42 --- [pool-subtask-executor28,71424bfefee043c0,dd945abbe46f] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 28, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:26.680 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:26.680 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:26.685 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:26.696 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221211 2022-12-08 12:05:26.700 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:26.700 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:26.703 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221211 values less than (1670688000)) 2022-12-08 12:05:26.940 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:28, status:SUCCESS 2022-12-08 12:05:26.947 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:28, status:SUCCESS 2022-12-08 12:05:27.366 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:27.366 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:27.369 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 12:05:27.392 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:27.392 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:27.395 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:05:27.401 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:27.401 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:27.403 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:05:27.405 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2022-12-08 12:05:27.409 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:05:27.532 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2019 2022-12-08 12:05:27.536 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:27.537 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:27.541 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2019 values less than (1577836800)) 2022-12-08 12:05:27.812 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:27.818 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:27.818 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:27.818 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:28.135 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:05:28.277 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:28.277 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:28.280 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2022-12-08 12:05:28.302 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2020 2022-12-08 12:05:28.307 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:28.307 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:28.310 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2020 values less than (1609459200)) 2022-12-08 12:05:28.940 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:28.940 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:28.946 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2022-12-08 12:05:28.967 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2021 2022-12-08 12:05:28.974 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:28.974 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:28.980 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2021 values less than (1640995200)) 2022-12-08 12:05:29.763 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:29.763 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:29.767 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2022-12-08 12:05:29.786 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2022 2022-12-08 12:05:29.793 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:29.793 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:29.796 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2022 values less than (1672531200)) 2022-12-08 12:05:29.942 INFO 42 --- [pool-ocp-schedules-14,,5640c2e1d60f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:05:30.142 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:30.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:05:30.428 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:05:30.427464+08:00, lastProcessTime=2022-12-08T12:05:20.412041+08:00 2022-12-08 12:05:30.479 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:05:30.576 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:05:30.427464+08:00, resultsCount=0 2022-12-08 12:05:30.577 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:05:30.427464+08:00, resultsCount=0 2022-12-08 12:05:30.577 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:05:30.427464+08:00 2022-12-08 12:05:30.604 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:30.819 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:30.823 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:30.859 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1063, sql=alter table `metric_data_hour` add partition(partition p2022 values less than (1672531200)) 2022-12-08 12:05:30.863 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:30.863 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:30.870 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2022-12-08 12:05:30.883 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2023 2022-12-08 12:05:30.887 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:30.887 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:30.895 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2023 values less than (1704067200)) 2022-12-08 12:05:30.928 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:30.928 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:30.930 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:30.931 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:30.993 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:31.0, nextRun=2022-12-08 12:05:30.0, currentDate=Thu Dec 08 12:05:30 CST 2022 2022-12-08 12:05:30.993 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:04:31.0, nextRunTime=2022-12-08 12:05:30.0} 2022-12-08 12:05:31.035 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:05:31.312 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:03.0, nextRun=2022-12-08 12:05:30.0, currentDate=Thu Dec 08 12:05:31 CST 2022 2022-12-08 12:05:31.313 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:05:03.0, nextRunTime=2022-12-08 12:05:30.0} 2022-12-08 12:05:31.332 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:05:31.333 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:05:31.333 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:05:32.136 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 29, operation:EXECUTE, state: RUNNING 2022-12-08 12:05:32.318 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:05:32.356 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=29, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:05:32.107+08:00, endTime=null} 2022-12-08 12:05:32.658 INFO 42 --- [pool-subtask-executor29,71424bfefee043c0,7470638fcd38] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=29, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=29, task_operation=execute, latest_execution_start_time=2022-12-08T12:05:32.106+08:00, sub_task_instance_id=29}, listMap={}}, executor=192.168.28.62 2022-12-08 12:05:32.658 INFO 42 --- [pool-subtask-executor29,71424bfefee043c0,7470638fcd38] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:05:32.701 INFO 42 --- [pool-subtask-executor29,71424bfefee043c0,7470638fcd38] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:05:32.728 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:05:32.805 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1910, sql=alter table `metric_data_hour` add partition(partition p2023 values less than (1704067200)) 2022-12-08 12:05:32.815 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:32.815 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:32.823 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2022-12-08 12:05:32.843 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:32.843 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:32.846 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:05:32.857 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:32.857 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:32.864 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2022-12-08 12:05:33.169 INFO 42 --- [pool-subtask-executor29,71424bfefee043c0,7470638fcd38] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 29, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:05:33.426 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2019 2022-12-08 12:05:33.429 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:33.429 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:33.432 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2019 values less than (1577836800)) 2022-12-08 12:05:33.824 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:33.828 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:34.952 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:05:34.960 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:05:35.384 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:29, status:SUCCESS 2022-12-08 12:05:35.393 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:29, status:SUCCESS 2022-12-08 12:05:35.930 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:05:36.031 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2599, sql=alter table `metric_data_daily` add partition(partition p2019 values less than (1577836800)) 2022-12-08 12:05:36.034 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:36.034 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:36.037 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2022-12-08 12:05:36.055 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2020 2022-12-08 12:05:36.058 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:36.059 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:36.061 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2020 values less than (1609459200)) 2022-12-08 12:05:36.192 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:05:36.313 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:05:36.829 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:36.835 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:36.996 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:36.996 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:37.002 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2022-12-08 12:05:37.022 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2021 2022-12-08 12:05:37.034 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:37.035 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:37.040 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2021 values less than (1640995200)) 2022-12-08 12:05:37.722 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:05:37.768 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:37.769 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:37.784 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2022-12-08 12:05:37.821 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2022 2022-12-08 12:05:37.825 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:37.826 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:37.831 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2022 values less than (1672531200)) 2022-12-08 12:05:37.921 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:37.921 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:38.390 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:05:39.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1235, sql=alter table `metric_data_daily` add partition(partition p2022 values less than (1672531200)) 2022-12-08 12:05:39.070 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:39.070 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:39.075 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2022-12-08 12:05:39.107 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2023 2022-12-08 12:05:39.111 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:39.111 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:39.122 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2023 values less than (1704067200)) 2022-12-08 12:05:39.836 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:39.842 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:39.849 INFO 42 --- [pool-ocp-schedules-20,,535921592df4] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:05:39.891 INFO 42 --- [pool-ocp-schedules-20,,535921592df4] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:05:39.944 INFO 42 --- [pool-ocp-schedules-3,,d42eef728763] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:05:39.955 INFO 42 --- [pool-ocp-schedules-13,,c018d4ea97e6] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:05:40.038 INFO 42 --- [pool-ocp-schedules-11,,fb3de30b2510] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:05:40.049 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:40.049 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:40.052 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2022-12-08 12:05:40.071 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:40.072 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:40.075 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:05:40.080 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:40.080 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:40.083 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2022-12-08 12:05:40.097 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1669824000 2022-12-08 12:05:40.099 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:40.100 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:40.103 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1669824000 values less than (1669824000)) 2022-12-08 12:05:40.273 INFO 42 --- [pool-ocp-schedules-10,,5ecf12ff851e] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:05:40.277 INFO 42 --- [pool-ocp-schedules-9,,043afcf86072] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:05:40.297 INFO 42 --- [pool-ocp-schedules-12,,6963440f3f9c] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:05:40.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:05:40.411 INFO 42 --- [pool-ocp-schedules-6,,ddc2a8ef985d] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:05:40.412 INFO 42 --- [pool-ocp-schedules-6,,ddc2a8ef985d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:05:40.412 INFO 42 --- [pool-ocp-schedules-6,,ddc2a8ef985d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:05:40.424 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:05:40.424498+08:00, lastProcessTime=2022-12-08T12:05:30.427464+08:00 2022-12-08 12:05:40.480 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:40.578 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:05:40.587 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:05:40.424498+08:00, resultsCount=0 2022-12-08 12:05:40.587 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:05:40.424498+08:00, resultsCount=0 2022-12-08 12:05:40.588 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:05:40.424498+08:00 2022-12-08 12:05:40.662 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:40.694 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:40.695 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:40.698 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:40.719 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1669910400 2022-12-08 12:05:40.728 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:40.728 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:40.732 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 12:05:40.997 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:40.998 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:40.998 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:40.998 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:41.384 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:41.384 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:41.387 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:41.401 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1669996800 2022-12-08 12:05:41.405 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:41.405 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:41.408 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 12:05:41.588 INFO 42 --- [pool-ocp-schedules-7,,dc5dd709cd87] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:05:41.589 INFO 42 --- [pool-ocp-schedules-7,,dc5dd709cd87] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:05:42.371 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:42.371 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:42.376 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:05:42.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:42.396 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670083200 2022-12-08 12:05:42.400 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:42.400 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:42.404 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 12:05:42.843 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:42.849 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:42.911 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:42.911 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:42.915 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:42.927 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670169600 2022-12-08 12:05:42.931 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:42.931 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:42.934 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 12:05:43.169 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:05:43.444 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:43.445 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:43.448 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:43.466 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670256000 2022-12-08 12:05:43.470 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:43.471 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:43.480 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 12:05:43.760 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:05:43.769 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:05:44.008 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:44.009 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:44.012 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:44.028 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670342400 2022-12-08 12:05:44.032 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:44.032 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:44.036 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 12:05:44.063 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:44.084 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:44.375 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:05:44.722 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:44.722 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:44.725 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:44.738 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670428800 2022-12-08 12:05:44.741 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:44.741 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:44.744 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 12:05:45.850 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:45.856 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:46.287 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1543, sql=alter table `sql_aggregate_data` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 12:05:46.292 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:46.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:46.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:46.315 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670515200 2022-12-08 12:05:46.320 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:46.321 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:46.325 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 12:05:47.150 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:47.151 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:47.154 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:47.168 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670601600 2022-12-08 12:05:47.171 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:47.171 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:47.174 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 12:05:47.193 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:47.193 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:47.248 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:47.248 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:48.856 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:48.861 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:49.261 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2087, sql=alter table `sql_aggregate_data` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 12:05:49.265 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:49.266 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:49.272 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:49.293 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670688000 2022-12-08 12:05:49.298 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:49.299 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:49.303 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 12:05:49.760 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:05:49.766 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:05:49.945 INFO 42 --- [pool-ocp-schedules-12,,220b3b0fa898] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:05:50.351 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1048, sql=alter table `sql_aggregate_data` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 12:05:50.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:05:50.356 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:50.356 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:50.360 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 12:05:50.386 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:50.387 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:50.391 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:05:50.399 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:50.399 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:50.404 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2022-12-08 12:05:50.433 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:05:50.431216+08:00, lastProcessTime=2022-12-08T12:05:40.424498+08:00 2022-12-08 12:05:50.526 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2019 2022-12-08 12:05:50.538 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:50.543 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:50.544 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:50.559 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2019 values less than (1577836800)) 2022-12-08 12:05:50.615 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:05:50.677 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:05:50.431216+08:00, resultsCount=0 2022-12-08 12:05:50.678 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:05:50.431216+08:00, resultsCount=0 2022-12-08 12:05:50.678 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:05:50.431216+08:00 2022-12-08 12:05:50.997 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:05:51.193 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:51.197 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:51.480 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:51.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:51.485 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2022-12-08 12:05:51.498 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2020 2022-12-08 12:05:51.501 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:51.502 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:51.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2020 values less than (1609459200)) 2022-12-08 12:05:51.714 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:05:51.862 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:51.867 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:52.285 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:52.286 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:52.289 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2022-12-08 12:05:52.302 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2021 2022-12-08 12:05:52.306 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:52.306 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:52.309 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2021 values less than (1640995200)) 2022-12-08 12:05:52.481 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:05:52.784 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:05:53.238 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:05:53.541 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1232, sql=alter table `ob_hist_partition_stats_compressed` add partition(partition p2021 values less than (1640995200)) 2022-12-08 12:05:53.545 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:53.545 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:53.550 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2022-12-08 12:05:53.563 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2022 2022-12-08 12:05:53.566 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:53.566 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:53.578 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2022 values less than (1672531200)) 2022-12-08 12:05:54.140 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:54.141 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:54.143 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2022-12-08 12:05:54.161 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2023 2022-12-08 12:05:54.166 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:54.166 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:54.169 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2023 values less than (1704067200)) 2022-12-08 12:05:54.336 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:54.339 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:54.371 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:05:54.371 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:05:54.868 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:54.873 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:55.139 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:55.140 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:55.143 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2022-12-08 12:05:55.167 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:55.168 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:55.177 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:05:55.182 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:55.183 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:55.186 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2022-12-08 12:05:55.255 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1669910400 2022-12-08 12:05:55.264 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:55.264 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:55.267 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 12:05:56.301 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1034, sql=alter table `ob_tenant_mini_compaction_info` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 12:05:56.305 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:56.306 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:56.310 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 12:05:56.333 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1669996800 2022-12-08 12:05:56.337 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:56.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:56.342 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 12:05:56.970 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:05:56.978 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:05:57.333 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:57.333 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:57.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 12:05:57.350 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670083200 2022-12-08 12:05:57.354 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:57.355 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:57.359 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 12:05:57.392 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:57.415 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:05:57.584 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:05:57.874 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:05:57.879 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:05:58.598 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1239, sql=alter table `ob_tenant_mini_compaction_info` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 12:05:58.603 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:58.603 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:58.607 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 12:05:58.623 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670169600 2022-12-08 12:05:58.645 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:05:58.645 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:05:58.649 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 12:05:59.947 INFO 42 --- [pool-ocp-schedules-2,,37633b6b2f82] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:06:00.000 INFO 42 --- [pool-ocp-schedules-4,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 12:06:00.010 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:02.0, nextRun=2022-12-08 12:06:00.0, currentDate=Thu Dec 08 12:06:00 CST 2022 2022-12-08 12:06:00.011 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:05:02.0, nextRunTime=2022-12-08 12:06:00.0} 2022-12-08 12:06:00.015 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1366, sql=alter table `ob_tenant_mini_compaction_info` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 12:06:00.021 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:00.021 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:00.035 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 12:06:00.040 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:06:00.041 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:06:00.041 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:06:00.047 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670256000 2022-12-08 12:06:00.055 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:00.055 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:00.062 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 12:06:00.105 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:02.0, nextRun=2022-12-08 12:06:00.0, currentDate=Thu Dec 08 12:06:00 CST 2022 2022-12-08 12:06:00.105 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:05:02.0, nextRunTime=2022-12-08 12:06:00.0} 2022-12-08 12:06:00.134 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:06:00.134 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:06:00.134 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:06:00.198 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:03.0, nextRun=2022-12-08 12:06:00.0, currentDate=Thu Dec 08 12:06:00 CST 2022 2022-12-08 12:06:00.199 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:05:03.0, nextRunTime=2022-12-08 12:06:00.0} 2022-12-08 12:06:00.233 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:06:00.234 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:06:00.234 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:06:00.303 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:31.0, nextRun=2022-12-08 12:06:00.0, currentDate=Thu Dec 08 12:06:00 CST 2022 2022-12-08 12:06:00.304 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:05:31.0, nextRunTime=2022-12-08 12:06:00.0} 2022-12-08 12:06:00.335 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:06:00.335 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:06:00.336 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:06:00.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:06:00.452 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:06:00.451158+08:00, lastProcessTime=2022-12-08T12:05:50.431216+08:00 2022-12-08 12:06:00.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:00.479 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:00.511 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:00.511 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:00.592 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:00.639 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:06:00.451158+08:00, resultsCount=0 2022-12-08 12:06:00.640 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:06:00.451158+08:00, resultsCount=0 2022-12-08 12:06:00.640 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:06:00.451158+08:00 2022-12-08 12:06:00.740 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:06:00.752 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:03.0, nextRun=2022-12-08 12:06:00.0, currentDate=Thu Dec 08 12:06:00 CST 2022 2022-12-08 12:06:00.753 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:05:03.0, nextRunTime=2022-12-08 12:06:00.0} 2022-12-08 12:06:00.770 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 32, operation:EXECUTE, state: RUNNING 2022-12-08 12:06:00.777 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:06:00.778 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:06:00.781 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:06:00.848 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=32, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T12:06:00.751+08:00, endTime=null} 2022-12-08 12:06:00.880 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:00.895 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:01.063 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 30, operation:EXECUTE, state: RUNNING 2022-12-08 12:06:01.132 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=30, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:06:01.045+08:00, endTime=null} 2022-12-08 12:06:01.227 INFO 42 --- [pool-subtask-executor30,71424bfefee043c0,783fd1fe2d77] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=32, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=32, task_operation=execute, latest_execution_start_time=2022-12-08T12:06:00.746+08:00, sub_task_instance_id=32}, listMap={}}, executor=192.168.28.62 2022-12-08 12:06:01.254 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 31, operation:EXECUTE, state: RUNNING 2022-12-08 12:06:01.283 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:01.330 INFO 42 --- [pool-subtask-executor31,71424bfefee043c0,f62311d1c3fd] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=30, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=30, task_operation=execute, latest_execution_start_time=2022-12-08T12:06:01.043+08:00, sub_task_instance_id=30}, listMap={}}, executor=192.168.28.62 2022-12-08 12:06:01.345 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1283, sql=alter table `ob_tenant_mini_compaction_info` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 12:06:01.351 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:01.351 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:01.355 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 12:06:01.369 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670342400 2022-12-08 12:06:01.374 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:01.374 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:01.380 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 12:06:01.570 INFO 42 --- [pool-subtask-executor31,71424bfefee043c0,f62311d1c3fd] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 30, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:06:01.571 INFO 42 --- [pool-subtask-executor30,71424bfefee043c0,783fd1fe2d77] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 32, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:06:01.574 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=31, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T12:06:01.235+08:00, endTime=null} 2022-12-08 12:06:01.957 INFO 42 --- [pool-ocp-schedules-16,,134b6479d647] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:06:01.958 INFO 42 --- [pool-ocp-schedules-16,,134b6479d647] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:06:02.049 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,38e227c243e4] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=31, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=31, task_operation=execute, latest_execution_start_time=2022-12-08T12:06:01.232+08:00, sub_task_instance_id=31}, listMap={}}, executor=192.168.28.62 2022-12-08 12:06:02.121 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:04:02.0, nextRun=2022-12-08 12:06:00.0, currentDate=Thu Dec 08 12:06:02 CST 2022 2022-12-08 12:06:02.121 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 12:04:02.0, nextRunTime=2022-12-08 12:06:00.0} 2022-12-08 12:06:02.128 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,38e227c243e4] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 31, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:06:02.145 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 12:06:02.511 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1131, sql=alter table `ob_tenant_mini_compaction_info` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 12:06:02.515 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:02.515 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:02.518 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 12:06:02.528 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:06:02.529 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670428800 2022-12-08 12:06:02.532 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:02.532 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:02.535 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 12:06:02.665 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 33, operation:EXECUTE, state: RUNNING 2022-12-08 12:06:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,38dd0bcea5ec] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472420, interval=60 2022-12-08 12:06:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,38dd0bcea5ec] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472362, count=0, elapsed=1668801890343 2022-12-08 12:06:02.713 INFO 42 --- [pool-prometheus-minute-schedule-1,,2e8584065f3e] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472420, interval=60 2022-12-08 12:06:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,2e8584065f3e] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472362, count=0, elapsed=1668801890352 2022-12-08 12:06:02.866 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=33, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:06:02.653+08:00, endTime=null} 2022-12-08 12:06:02.988 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 34, operation:EXECUTE, state: RUNNING 2022-12-08 12:06:03.063 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:30, status:SUCCESS 2022-12-08 12:06:03.072 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:30, status:SUCCESS 2022-12-08 12:06:03.097 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=34, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:06:02.965+08:00, endTime=null} 2022-12-08 12:06:03.118 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:06:03.130 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:06:03.176 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,5e837c5643fc] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=33, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=33, task_operation=execute, latest_execution_start_time=2022-12-08T12:06:02.651+08:00, sub_task_instance_id=33}, listMap={}}, executor=192.168.28.62 2022-12-08 12:06:03.176 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,5e837c5643fc] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:06:03.192 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:31, status:SUCCESS 2022-12-08 12:06:03.194 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,5e837c5643fc] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:06:03.199 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:31, status:SUCCESS 2022-12-08 12:06:03.250 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,5e837c5643fc] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 33, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:06:03.320 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:32, status:SUCCESS 2022-12-08 12:06:03.325 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:32, status:SUCCESS 2022-12-08 12:06:03.399 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:06:03.457 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:33, status:SUCCESS 2022-12-08 12:06:03.463 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:33, status:SUCCESS 2022-12-08 12:06:03.615 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1080, sql=alter table `ob_tenant_mini_compaction_info` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 12:06:03.625 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:03.625 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:03.635 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 12:06:03.647 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670515200 2022-12-08 12:06:03.651 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:03.652 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:03.658 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 12:06:03.745 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:03.759 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:03.896 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:03.901 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:04.275 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:06:04.489 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:04.490 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:04.493 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 12:06:04.506 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670601600 2022-12-08 12:06:04.510 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:04.510 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:04.513 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 12:06:04.696 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:34, status:SUCCESS 2022-12-08 12:06:04.702 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:34, status:SUCCESS 2022-12-08 12:06:05.049 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:05.049 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:05.051 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 12:06:05.062 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670688000 2022-12-08 12:06:05.065 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:05.065 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:05.067 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 12:06:05.485 INFO 42 --- [pool-ocp-schedules-4,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 12:06:05.833 INFO 42 --- [pool-ocp-schedules-4,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 12:06:05.950 INFO 42 --- [pool-ocp-schedules-4,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 12:06:06.181 INFO 42 --- [pool-ocp-schedules-4,,] o.s.boot.SpringApplication : Started application in 6.119 seconds (JVM running for 520.769) 2022-12-08 12:06:06.181 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:06:06.357 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:04:35+08:00, updateTime=2022-12-08T12:05:35+08:00, expireTime=null, isLeader=false} 2022-12-08 12:06:06.382 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:06:06.397 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:06.0, nextRun=2022-12-08 12:06:05.0, currentDate=Thu Dec 08 12:06:06 CST 2022 2022-12-08 12:06:06.399 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:05:06.0, nextRunTime=2022-12-08 12:06:05.0} 2022-12-08 12:06:06.425 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:06:06.426 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:06:06.426 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:06:06.461 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:06:06.493 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:06:06.816 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:06.816 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:06.836 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:06.836 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:06.902 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:06.907 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:06.965 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1898, sql=alter table `ob_tenant_mini_compaction_info` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 12:06:06.975 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:06.976 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:06.979 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 12:06:06.990 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:06.991 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:06.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:06:06.999 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:07.000 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:07.002 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2022-12-08 12:06:07.062 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221206 2022-12-08 12:06:07.067 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:07.067 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:07.069 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:06:07.236 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 35, operation:EXECUTE, state: RUNNING 2022-12-08 12:06:07.270 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=35, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:06:07.208+08:00, endTime=null} 2022-12-08 12:06:07.601 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:07.601 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:07.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:07.614 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221207 2022-12-08 12:06:07.618 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:07.618 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:07.621 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:06:07.893 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:06:08.009 INFO 42 --- [pool-ocp-schedules-4,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T12:06:08.009+08:00 2022-12-08 12:06:08.198 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:08.199 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:08.202 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:08.214 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221208 2022-12-08 12:06:08.217 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:08.217 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:08.220 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:06:08.870 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:35, status:SUCCESS 2022-12-08 12:06:08.879 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:35, status:SUCCESS 2022-12-08 12:06:09.195 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:09.196 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:09.200 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:09.215 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221209 2022-12-08 12:06:09.219 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:09.219 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:09.224 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:06:09.446 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:06:09.453 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:06:09.907 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:09.912 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:09.913 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:09.932 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:09.948 INFO 42 --- [pool-ocp-schedules-16,,4b78cf805a56] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:06:10.050 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:06:10.262 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1039, sql=alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:06:10.269 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:10.270 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:10.273 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:10.291 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221210 2022-12-08 12:06:10.294 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:10.294 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:10.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:06:10.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:06:10.415 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:06:10.415749+08:00, lastProcessTime=2022-12-08T12:06:00.451158+08:00 2022-12-08 12:06:10.533 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:06:10.415749+08:00, resultsCount=0 2022-12-08 12:06:10.533 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:06:10.415749+08:00, resultsCount=0 2022-12-08 12:06:10.534 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:06:10.415749+08:00 2022-12-08 12:06:10.741 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:10.799 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:06:11.259 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:11.259 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:11.263 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:11.279 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221211 2022-12-08 12:06:11.289 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:11.289 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:11.294 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:06:11.567 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:12.227 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:12.227 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:12.231 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:12.251 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221212 2022-12-08 12:06:12.254 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:12.254 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:12.257 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:06:12.777 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:06:12.914 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:12.919 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:13.025 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:13.025 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:13.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:13.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:13.376 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1119, sql=alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:06:13.381 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:13.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:13.385 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:13.401 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221213 2022-12-08 12:06:13.407 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:13.408 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:13.411 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:06:13.479 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:06:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,7a230b9c8fa5] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:06:13.720 INFO 42 --- [pool-prometheus-cache-monitor1,,7a230b9c8fa5] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:06:14.224 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:14.225 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:14.228 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:14.246 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221214 2022-12-08 12:06:14.249 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:14.250 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:14.253 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:06:15.046 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:15.046 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:15.050 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:15.068 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221215 2022-12-08 12:06:15.074 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:15.075 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:15.079 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:06:15.261 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:06:15.267 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:06:15.920 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:15.926 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:16.147 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:16.164 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:16.377 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:06:16.515 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1436, sql=alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:06:16.519 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:16.520 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:16.523 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:16.541 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221216 2022-12-08 12:06:16.545 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:16.546 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:16.549 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:06:17.202 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:17.203 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:17.211 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 12:06:17.229 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:17.229 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:17.233 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:06:17.240 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:17.240 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:17.247 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2022-12-08 12:06:17.293 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221130 2022-12-08 12:06:17.296 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:17.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:17.300 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:06:18.275 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:18.276 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:18.282 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:18.300 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221201 2022-12-08 12:06:18.304 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:18.304 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:18.307 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:06:18.817 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:18.817 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:18.820 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:18.837 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221202 2022-12-08 12:06:18.840 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:18.840 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:18.843 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:06:18.926 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:18.932 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:19.253 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:19.254 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:19.258 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:19.259 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:19.369 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:19.370 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:19.373 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:19.385 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221203 2022-12-08 12:06:19.389 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:19.390 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:19.393 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:06:19.949 INFO 42 --- [pool-ocp-schedules-1,,9b12b7db9a20] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:06:20.302 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:20.303 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:20.306 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:20.322 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221204 2022-12-08 12:06:20.325 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:20.325 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:20.328 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:06:20.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:06:20.409 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:06:20.409753+08:00, lastProcessTime=2022-12-08T12:06:10.415749+08:00 2022-12-08 12:06:20.597 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:06:20.409753+08:00, resultsCount=0 2022-12-08 12:06:20.598 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:06:20.409753+08:00, resultsCount=0 2022-12-08 12:06:20.598 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:06:20.409753+08:00 2022-12-08 12:06:20.704 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:20.0, nextRun=2022-12-08 12:06:20.0, currentDate=Thu Dec 08 12:06:20 CST 2022 2022-12-08 12:06:20.705 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:05:20.0, nextRunTime=2022-12-08 12:06:20.0} 2022-12-08 12:06:20.732 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:06:20.732 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:06:20.733 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:06:20.793 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:20.858 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:06:21.078 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:21.079 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:21.083 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:21.099 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221205 2022-12-08 12:06:21.103 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:21.103 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:21.106 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:06:21.545 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 36, operation:EXECUTE, state: RUNNING 2022-12-08 12:06:21.686 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=36, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:06:21.531+08:00, endTime=null} 2022-12-08 12:06:21.707 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:06:21.713 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:06:21.767 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:21.932 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:21.938 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:22.023 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:22.024 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:22.027 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:22.031 INFO 42 --- [pool-ocp-schedules-11,,2994f0728377] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:06:22.031 INFO 42 --- [pool-ocp-schedules-11,,2994f0728377] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:06:22.044 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221206 2022-12-08 12:06:22.048 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:22.049 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:22.052 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:06:22.194 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:36, status:SUCCESS 2022-12-08 12:06:22.201 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:36, status:SUCCESS 2022-12-08 12:06:22.361 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:22.363 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:22.585 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:22.585 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:22.589 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:22.606 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221207 2022-12-08 12:06:22.612 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:22.612 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:22.616 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:06:22.889 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:06:22.926 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:06:23.029 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:06:23.147 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:23.148 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:23.151 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:23.171 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221208 2022-12-08 12:06:23.176 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:23.177 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:23.180 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:06:23.557 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:06:23.695 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:23.695 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:23.699 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:23.713 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221209 2022-12-08 12:06:23.716 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:23.717 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:23.722 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:06:24.221 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:24.222 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:24.226 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:24.237 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221210 2022-12-08 12:06:24.240 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:24.241 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:24.244 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:06:24.939 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:24.945 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:25.424 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:25.425 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:25.449 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:25.449 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:25.600 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1356, sql=alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:06:25.603 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:25.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:25.608 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:25.619 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221211 2022-12-08 12:06:25.622 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:25.623 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:25.626 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:06:26.406 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:26.406 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:26.414 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:26.433 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221212 2022-12-08 12:06:26.474 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:26.474 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:26.483 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:06:26.545 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:25.0, nextRun=2022-12-08 12:06:25.0, currentDate=Thu Dec 08 12:06:26 CST 2022 2022-12-08 12:06:26.546 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:05:25.0, nextRunTime=2022-12-08 12:06:25.0} 2022-12-08 12:06:26.606 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:06:26.607 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:06:26.607 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:06:27.552 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 12:06:27.592 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=39ms, period=120000ms 2022-12-08 12:06:27.633 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 37, operation:EXECUTE, state: RUNNING 2022-12-08 12:06:27.696 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=37, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:06:27.609+08:00, endTime=null} 2022-12-08 12:06:27.946 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:27.962 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:28.264 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:06:28.271 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:06:28.503 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:28.541 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2058, sql=alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:06:28.545 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:28.546 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:28.549 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:28.567 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221213 2022-12-08 12:06:28.571 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:28.571 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:28.575 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:06:28.610 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:28.821 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:37, status:SUCCESS 2022-12-08 12:06:28.829 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:37, status:SUCCESS 2022-12-08 12:06:28.874 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:06:29.215 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:29.215 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:29.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:29.235 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221214 2022-12-08 12:06:29.239 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:29.239 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:29.242 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:06:29.951 INFO 42 --- [pool-ocp-schedules-7,,905b0f896db9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:06:29.996 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:29.997 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:30.000 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:30.016 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221215 2022-12-08 12:06:30.020 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:30.020 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:30.025 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:06:30.181 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:31.0, nextRun=2022-12-08 12:06:30.0, currentDate=Thu Dec 08 12:06:30 CST 2022 2022-12-08 12:06:30.183 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:05:31.0, nextRunTime=2022-12-08 12:06:30.0} 2022-12-08 12:06:30.209 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:06:30.296 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:00.0, nextRun=2022-12-08 12:06:30.0, currentDate=Thu Dec 08 12:06:30 CST 2022 2022-12-08 12:06:30.297 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:06:00.0, nextRunTime=2022-12-08 12:06:30.0} 2022-12-08 12:06:30.323 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:06:30.324 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:06:30.324 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:06:30.356 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:06:30.418 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:06:30.417124+08:00, lastProcessTime=2022-12-08T12:06:20.409753+08:00 2022-12-08 12:06:30.628 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:06:30.417124+08:00, resultsCount=0 2022-12-08 12:06:30.628 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:06:30.417124+08:00, resultsCount=0 2022-12-08 12:06:30.629 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:06:30.417124+08:00 2022-12-08 12:06:30.744 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:30.744 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:30.747 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:30.766 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221216 2022-12-08 12:06:30.770 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:30.770 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:30.774 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:06:30.819 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 38, operation:EXECUTE, state: RUNNING 2022-12-08 12:06:30.832 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:30.851 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=38, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:06:30.801+08:00, endTime=null} 2022-12-08 12:06:30.883 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:06:30.963 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:30.968 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:31.339 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:31.339 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:31.343 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 12:06:31.365 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:31.365 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:31.368 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:06:31.373 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:31.374 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:31.378 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2022-12-08 12:06:31.494 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221123 2022-12-08 12:06:31.499 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:31.499 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:31.502 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 12:06:31.582 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:31.583 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:31.700 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:31.701 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:31.892 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:32.040 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:32.041 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:32.044 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:32.059 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221124 2022-12-08 12:06:32.063 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:32.063 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:32.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 12:06:32.806 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:38, status:SUCCESS 2022-12-08 12:06:32.814 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:38, status:SUCCESS 2022-12-08 12:06:33.111 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:06:33.279 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1213, sql=alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 12:06:33.283 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:33.283 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:33.287 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:33.305 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221125 2022-12-08 12:06:33.309 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:33.309 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:33.314 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 12:06:33.620 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:06:33.970 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:33.976 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:34.103 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:06:34.112 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:06:34.239 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:34.240 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:34.243 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:34.257 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221126 2022-12-08 12:06:34.262 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:34.263 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:34.266 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 12:06:34.713 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:34.779 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:34.946 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:06:34.962 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:34.963 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:34.967 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:34.990 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221127 2022-12-08 12:06:34.994 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:34.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:34.998 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 12:06:36.164 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1166, sql=alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 12:06:36.169 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:36.169 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:36.172 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:36.186 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221128 2022-12-08 12:06:36.189 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:36.190 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:36.193 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 12:06:36.461 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:06:36.548 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:06:36.617 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:06:36.977 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:36.983 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:37.074 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:37.075 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:37.078 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:37.095 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221129 2022-12-08 12:06:37.099 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:37.100 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:37.104 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 12:06:37.770 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:37.771 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:37.908 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:37.908 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:37.964 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:06:38.548 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1444, sql=alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 12:06:38.553 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:38.553 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:38.557 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:38.573 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221130 2022-12-08 12:06:38.579 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:38.579 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:38.583 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:06:39.127 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:39.128 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:39.131 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:39.143 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221201 2022-12-08 12:06:39.147 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:39.147 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:39.150 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:06:39.854 INFO 42 --- [pool-ocp-schedules-2,,1c57b95a15c6] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:06:39.909 INFO 42 --- [pool-ocp-schedules-2,,1c57b95a15c6] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:06:39.942 INFO 42 --- [pool-ocp-schedules-7,,1ef9a5320327] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:06:39.943 INFO 42 --- [pool-ocp-schedules-7,,1ef9a5320327] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:06:39.952 INFO 42 --- [pool-ocp-schedules-10,,3259c5dfcc59] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:06:39.957 INFO 42 --- [pool-ocp-schedules-15,,23c49b3c0c77] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:06:39.984 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:39.988 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:39.989 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:39.990 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:39.993 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:40.013 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221202 2022-12-08 12:06:40.016 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:40.017 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:40.021 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:06:40.055 INFO 42 --- [pool-ocp-schedules-12,,9d55fca956a8] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:06:40.108 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:06:40.114 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:06:40.334 INFO 42 --- [pool-ocp-schedules-1,,fe5f35c27e66] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:06:40.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:06:40.358 INFO 42 --- [pool-ocp-schedules-11,,988d80dcfdea] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:06:40.364 INFO 42 --- [pool-ocp-schedules-9,,3ce08cfc29be] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:06:40.428 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:06:40.428961+08:00, lastProcessTime=2022-12-08T12:06:30.417124+08:00 2022-12-08 12:06:40.559 INFO 42 --- [pool-ocp-schedules-17,,d86b583dbadd] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:06:40.560 INFO 42 --- [pool-ocp-schedules-17,,d86b583dbadd] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:06:40.561 INFO 42 --- [pool-ocp-schedules-17,,d86b583dbadd] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:06:40.611 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:06:40.428961+08:00, resultsCount=0 2022-12-08 12:06:40.612 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:06:40.428961+08:00, resultsCount=0 2022-12-08 12:06:40.613 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:06:40.428961+08:00 2022-12-08 12:06:40.616 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:40.616 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:40.620 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:40.640 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221203 2022-12-08 12:06:40.645 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:40.645 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:40.655 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:06:40.869 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:40.962 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:06:41.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:41.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:41.310 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:41.311 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:41.314 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:41.328 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221204 2022-12-08 12:06:41.331 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:41.332 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:41.336 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:06:41.709 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:06:42.100 INFO 42 --- [pool-ocp-schedules-13,,d98d2f05d95a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:06:42.101 INFO 42 --- [pool-ocp-schedules-13,,d98d2f05d95a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:06:42.232 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:42.233 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:42.237 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:42.252 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221205 2022-12-08 12:06:42.257 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:42.257 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:42.262 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:06:42.315 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:42.901 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:42.902 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:42.906 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:42.920 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221206 2022-12-08 12:06:42.925 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:42.925 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:42.928 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:06:42.989 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:42.994 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:43.162 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:06:43.558 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:43.559 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:43.563 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:43.578 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221207 2022-12-08 12:06:43.582 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:43.582 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:43.586 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:06:43.963 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:06:44.484 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:44.485 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:44.488 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:44.505 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221208 2022-12-08 12:06:44.509 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:44.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:44.523 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:06:44.546 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:44.547 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:44.578 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:44.578 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:45.360 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:45.361 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:45.364 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:45.376 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221209 2022-12-08 12:06:45.380 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:45.380 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:45.384 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:06:45.995 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:46.000 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:46.728 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1344, sql=alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:06:46.733 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:46.733 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:46.740 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:46.760 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221210 2022-12-08 12:06:46.766 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:46.767 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:46.773 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:06:46.944 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:06:46.951 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:06:47.366 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:47.367 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:47.369 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:47.386 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221211 2022-12-08 12:06:47.390 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:47.390 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:47.394 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:06:47.613 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:47.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:48.049 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:06:48.402 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1008, sql=alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:06:48.406 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:48.406 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:48.409 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:48.423 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221212 2022-12-08 12:06:48.427 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:48.427 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:48.430 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:06:49.001 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:49.006 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:49.428 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:49.429 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:49.432 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:49.443 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221213 2022-12-08 12:06:49.447 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:49.447 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:49.451 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:06:49.954 INFO 42 --- [pool-ocp-schedules-9,,cec65381a0b6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:06:50.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:06:50.434 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:06:50.423164+08:00, lastProcessTime=2022-12-08T12:06:40.428961+08:00 2022-12-08 12:06:50.626 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:06:50.423164+08:00, resultsCount=0 2022-12-08 12:06:50.627 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:06:50.423164+08:00, resultsCount=0 2022-12-08 12:06:50.628 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:06:50.423164+08:00 2022-12-08 12:06:50.747 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:50.747 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:50.752 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1301, sql=alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:06:50.761 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:50.762 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:50.766 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:50.786 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:50.786 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:50.788 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221214 2022-12-08 12:06:50.791 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:50.792 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:50.796 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:06:51.010 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:51.046 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:06:51.390 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:51.391 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:51.394 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:51.405 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221215 2022-12-08 12:06:51.409 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:51.409 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:51.413 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:06:52.007 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:52.012 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:52.056 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:52.057 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:52.062 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:52.080 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221216 2022-12-08 12:06:52.084 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:52.084 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:52.088 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:06:52.353 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:06:53.011 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:53.012 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:53.015 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 12:06:53.035 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:53.035 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:53.039 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:06:53.045 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:53.045 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:53.048 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2022-12-08 12:06:53.107 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221108 2022-12-08 12:06:53.111 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:53.111 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:53.115 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221108 values less than (1667952000000000)) 2022-12-08 12:06:53.207 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:06:53.370 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:06:53.430 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:06:53.437 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:06:53.845 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:53.845 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:06:53.962 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:53.963 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:53.966 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:06:53.985 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221109 2022-12-08 12:06:53.989 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:53.989 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:53.993 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221109 values less than (1668038400000000)) 2022-12-08 12:06:54.015 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:06:54.040 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:06:55.013 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:55.018 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:55.414 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1421, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221109 values less than (1668038400000000)) 2022-12-08 12:06:55.418 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:55.419 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:55.425 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:06:55.450 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221110 2022-12-08 12:06:55.454 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:55.455 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:55.459 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221110 values less than (1668124800000000)) 2022-12-08 12:06:56.173 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:56.174 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:56.178 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:06:56.197 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221111 2022-12-08 12:06:56.201 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:56.201 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:56.204 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221111 values less than (1668211200000000)) 2022-12-08 12:06:56.912 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:56.912 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:56.915 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:06:56.916 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:06:57.073 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:57.073 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:57.077 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:06:57.095 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221112 2022-12-08 12:06:57.099 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:57.099 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:57.102 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221112 values less than (1668297600000000)) 2022-12-08 12:06:57.662 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:57.663 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:57.669 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:06:57.686 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221113 2022-12-08 12:06:57.692 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:57.693 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:57.698 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221113 values less than (1668384000000000)) 2022-12-08 12:06:58.019 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:06:58.023 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:06:58.470 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:58.471 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:58.474 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:06:58.486 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221114 2022-12-08 12:06:58.490 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:58.490 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:58.493 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221114 values less than (1668470400000000)) 2022-12-08 12:06:59.201 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:06:59.209 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:06:59.493 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1000, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221114 values less than (1668470400000000)) 2022-12-08 12:06:59.497 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:59.498 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:59.501 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:06:59.520 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221115 2022-12-08 12:06:59.524 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:06:59.524 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:06:59.527 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221115 values less than (1668556800000000)) 2022-12-08 12:06:59.955 INFO 42 --- [pool-ocp-schedules-11,,bd401d064b80] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:07:00.002 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:00.002 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:00.129 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:00.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:00.132 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:00.146 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221116 2022-12-08 12:07:00.152 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:00.152 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:00.156 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221116 values less than (1668643200000000)) 2022-12-08 12:07:00.291 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:07:00.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:07:00.416 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:07:00.415702+08:00, lastProcessTime=2022-12-08T12:06:50.423164+08:00 2022-12-08 12:07:00.545 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:07:00.415702+08:00, resultsCount=0 2022-12-08 12:07:00.546 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:07:00.415702+08:00, resultsCount=0 2022-12-08 12:07:00.546 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:07:00.415702+08:00 2022-12-08 12:07:01.024 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:01.029 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:01.046 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:01.593 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:07:01.756 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:00.0, nextRun=2022-12-08 12:07:00.0, currentDate=Thu Dec 08 12:07:01 CST 2022 2022-12-08 12:07:01.757 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:06:00.0, nextRunTime=2022-12-08 12:07:00.0} 2022-12-08 12:07:01.777 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:07:01.778 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:07:01.778 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:07:01.861 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:00.0, nextRun=2022-12-08 12:07:00.0, currentDate=Thu Dec 08 12:07:01 CST 2022 2022-12-08 12:07:01.862 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:06:00.0, nextRunTime=2022-12-08 12:07:00.0} 2022-12-08 12:07:01.897 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:07:01.898 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:07:01.898 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:07:01.968 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:00.0, nextRun=2022-12-08 12:07:00.0, currentDate=Thu Dec 08 12:07:01 CST 2022 2022-12-08 12:07:01.969 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:06:00.0, nextRunTime=2022-12-08 12:07:00.0} 2022-12-08 12:07:01.992 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:07:01.993 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:07:01.993 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:07:02.073 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:30.0, nextRun=2022-12-08 12:07:00.0, currentDate=Thu Dec 08 12:07:02 CST 2022 2022-12-08 12:07:02.073 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:06:30.0, nextRunTime=2022-12-08 12:07:00.0} 2022-12-08 12:07:02.093 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:07:02.094 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:07:02.094 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:07:02.183 INFO 42 --- [pool-ocp-schedules-8,,8b9d6cea83d9] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:07:02.183 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:01.0, nextRun=2022-12-08 12:07:00.0, currentDate=Thu Dec 08 12:07:02 CST 2022 2022-12-08 12:07:02.184 INFO 42 --- [pool-ocp-schedules-8,,8b9d6cea83d9] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:07:02.184 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:06:01.0, nextRunTime=2022-12-08 12:07:00.0} 2022-12-08 12:07:02.189 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2033, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221116 values less than (1668643200000000)) 2022-12-08 12:07:02.192 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:02.193 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:02.197 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:02.205 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:07:02.206 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:07:02.206 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:07:02.214 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221117 2022-12-08 12:07:02.217 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:02.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:02.221 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221117 values less than (1668729600000000)) 2022-12-08 12:07:02.340 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 39, operation:EXECUTE, state: RUNNING 2022-12-08 12:07:02.413 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:02.618 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=39, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:07:02.322+08:00, endTime=null} 2022-12-08 12:07:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,0265ebf6f558] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472480, interval=60 2022-12-08 12:07:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,0265ebf6f558] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472422, count=0, elapsed=1668801950283 2022-12-08 12:07:02.709 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 40, operation:EXECUTE, state: RUNNING 2022-12-08 12:07:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,412d4bf72d70] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472480, interval=60 2022-12-08 12:07:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,412d4bf72d70] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472422, count=0, elapsed=1668801950292 2022-12-08 12:07:03.124 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=40, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T12:07:02.690+08:00, endTime=null} 2022-12-08 12:07:03.171 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:03.171 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:03.171 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:03.172 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:03.208 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 41, operation:EXECUTE, state: RUNNING 2022-12-08 12:07:03.297 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=41, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T12:07:03.191+08:00, endTime=null} 2022-12-08 12:07:03.371 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:07:03.374 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,ec1dc57408d9] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=40, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=40, task_operation=execute, latest_execution_start_time=2022-12-08T12:07:02.689+08:00, sub_task_instance_id=40}, listMap={}}, executor=192.168.28.62 2022-12-08 12:07:03.390 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 42, operation:EXECUTE, state: RUNNING 2022-12-08 12:07:03.497 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=42, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:07:03.363+08:00, endTime=null} 2022-12-08 12:07:03.531 INFO 42 --- [pool-subtask-executor30,71424bfefee043c0,745d981d27c7] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=41, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=41, task_operation=execute, latest_execution_start_time=2022-12-08T12:07:03.189+08:00, sub_task_instance_id=41}, listMap={}}, executor=192.168.28.62 2022-12-08 12:07:03.600 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,ec1dc57408d9] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 40, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:07:03.701 INFO 42 --- [pool-subtask-executor30,71424bfefee043c0,745d981d27c7] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 41, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:07:03.704 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1483, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221117 values less than (1668729600000000)) 2022-12-08 12:07:03.708 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:03.711 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:03.718 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:03.740 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221118 2022-12-08 12:07:03.748 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:03.748 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:03.751 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221118 values less than (1668816000000000)) 2022-12-08 12:07:04.030 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:04.036 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:04.059 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:07:04.563 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:04.564 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:04.567 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:04.582 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221119 2022-12-08 12:07:04.591 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:04.591 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:04.593 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 43, operation:EXECUTE, state: RUNNING 2022-12-08 12:07:04.594 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221119 values less than (1668902400000000)) 2022-12-08 12:07:04.925 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=43, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:07:04.575+08:00, endTime=null} 2022-12-08 12:07:05.178 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:39, status:SUCCESS 2022-12-08 12:07:05.224 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:06.0, nextRun=2022-12-08 12:07:05.0, currentDate=Thu Dec 08 12:07:05 CST 2022 2022-12-08 12:07:05.261 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:06:06.0, nextRunTime=2022-12-08 12:07:05.0} 2022-12-08 12:07:05.271 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:39, status:SUCCESS 2022-12-08 12:07:05.290 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:07:05.291 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:07:05.291 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:07:05.380 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:40, status:SUCCESS 2022-12-08 12:07:05.387 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:40, status:SUCCESS 2022-12-08 12:07:05.499 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:41, status:SUCCESS 2022-12-08 12:07:05.507 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:41, status:SUCCESS 2022-12-08 12:07:05.645 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:42, status:SUCCESS 2022-12-08 12:07:05.652 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:42, status:SUCCESS 2022-12-08 12:07:05.705 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1111, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221119 values less than (1668902400000000)) 2022-12-08 12:07:05.713 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:05.713 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:05.717 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:05.735 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221120 2022-12-08 12:07:05.739 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:05.739 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:05.743 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221120 values less than (1668988800000000)) 2022-12-08 12:07:05.764 ERROR 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing PLAN_CHANGE_DETECTOR org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=2097200) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=2097200) Table has no partition for value ; (conn=2097200) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=2097200) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.insert(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy412.save(Unknown Source) ~[na:na] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:49) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$ad3ec26.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=2097200) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_312] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_312] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 26 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 40 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 41 common frames omitted 2022-12-08 12:07:05.786 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:43, status:SUCCESS 2022-12-08 12:07:05.795 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:43, status:SUCCESS 2022-12-08 12:07:06.025 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 44, operation:EXECUTE, state: RUNNING 2022-12-08 12:07:06.108 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=44, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:07:06+08:00, endTime=null} 2022-12-08 12:07:06.335 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:07:06.411 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:07:06.470 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:06.471 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:06.474 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:06.489 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221121 2022-12-08 12:07:06.492 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:06.493 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:06.495 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221121 values less than (1669075200000000)) 2022-12-08 12:07:06.548 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:07:06.617 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:07:06.655 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:07:07.037 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:07.041 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:07.063 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:44, status:SUCCESS 2022-12-08 12:07:07.072 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:44, status:SUCCESS 2022-12-08 12:07:07.084 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:07.084 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:07.087 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:07.100 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221122 2022-12-08 12:07:07.104 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:07.104 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:07.109 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221122 values less than (1669161600000000)) 2022-12-08 12:07:08.291 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1182, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221122 values less than (1669161600000000)) 2022-12-08 12:07:08.296 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:08.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:08.301 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:08.317 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221123 2022-12-08 12:07:08.321 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:08.321 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:08.330 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 12:07:08.505 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:07:09.395 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:09.438 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:09.541 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:07:09.784 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1454, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 12:07:09.787 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:09.787 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:09.790 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:09.805 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221124 2022-12-08 12:07:09.809 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:09.809 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:09.812 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 12:07:09.959 INFO 42 --- [pool-ocp-schedules-17,,27a6c00548a9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:07:10.042 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:10.047 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:10.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:07:10.425 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:07:10.424976+08:00, lastProcessTime=2022-12-08T12:07:00.415702+08:00 2022-12-08 12:07:10.586 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:07:10.424976+08:00, resultsCount=0 2022-12-08 12:07:10.586 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:07:10.424976+08:00, resultsCount=0 2022-12-08 12:07:10.587 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:07:10.424976+08:00 2022-12-08 12:07:10.763 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:10.763 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:10.766 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:10.779 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221125 2022-12-08 12:07:10.782 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:10.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:10.784 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 12:07:11.594 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:11.762 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:07:11.855 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1071, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 12:07:11.858 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:11.858 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:11.861 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:11.874 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221126 2022-12-08 12:07:11.878 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:11.879 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:11.883 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 12:07:12.514 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:12.514 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:12.515 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:12.515 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:12.605 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:13.048 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:13.053 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:13.424 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:07:13.424 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1541, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 12:07:13.428 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:13.429 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:13.431 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:13.473 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221127 2022-12-08 12:07:13.477 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:13.477 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:13.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 12:07:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,c5aa5ae89018] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:07:13.720 INFO 42 --- [pool-prometheus-cache-monitor1,,c5aa5ae89018] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:07:14.165 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:07:14.323 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:14.323 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:14.326 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:14.338 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221128 2022-12-08 12:07:14.341 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:14.341 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:14.345 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 12:07:14.731 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:07:14.743 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:07:15.346 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1001, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 12:07:15.350 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:15.351 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:15.354 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:15.370 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221129 2022-12-08 12:07:15.373 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:15.374 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:15.377 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 12:07:15.778 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:15.780 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:15.978 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:07:16.054 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:16.060 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:16.244 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:16.252 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:16.257 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:16.269 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221130 2022-12-08 12:07:16.274 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:16.274 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:16.278 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:07:17.197 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:17.198 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:17.201 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:17.216 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221201 2022-12-08 12:07:17.220 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:17.220 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:17.223 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:07:18.476 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1253, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:07:18.482 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:18.482 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:18.487 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:18.503 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221202 2022-12-08 12:07:18.507 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:18.507 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:18.510 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:07:18.971 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:18.972 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:18.975 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:18.976 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:19.060 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:19.066 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:19.889 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1379, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:07:19.893 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:19.894 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:19.897 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:19.913 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221203 2022-12-08 12:07:19.918 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:19.918 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:19.921 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:07:19.961 INFO 42 --- [pool-ocp-schedules-18,,fcb340ce9272] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:07:20.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:07:20.402 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:07:20.402906+08:00, lastProcessTime=2022-12-08T12:07:10.424976+08:00 2022-12-08 12:07:20.510 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:07:20.402906+08:00, resultsCount=0 2022-12-08 12:07:20.510 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:07:20.402906+08:00, resultsCount=0 2022-12-08 12:07:20.511 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:07:20.402906+08:00 2022-12-08 12:07:20.949 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1028, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:07:20.953 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:20.954 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:20.958 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:20.987 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221204 2022-12-08 12:07:20.993 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:20.993 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:20.999 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:07:21.134 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:21.0, nextRun=2022-12-08 12:07:20.0, currentDate=Thu Dec 08 12:07:21 CST 2022 2022-12-08 12:07:21.135 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:06:21.0, nextRunTime=2022-12-08 12:07:20.0} 2022-12-08 12:07:21.155 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:07:21.156 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:07:21.156 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:07:21.198 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:07:21.205 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:07:21.358 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 45, operation:EXECUTE, state: RUNNING 2022-12-08 12:07:21.390 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=45, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:07:21.339+08:00, endTime=null} 2022-12-08 12:07:21.629 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:21.676 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:21.676 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:21.681 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:21.697 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221205 2022-12-08 12:07:21.701 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:21.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:21.705 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:07:21.812 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:07:22.052 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:45, status:SUCCESS 2022-12-08 12:07:22.059 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:45, status:SUCCESS 2022-12-08 12:07:22.066 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:22.071 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:22.244 INFO 42 --- [pool-ocp-schedules-1,,bddb2daba178] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:07:22.245 INFO 42 --- [pool-ocp-schedules-1,,bddb2daba178] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:07:22.385 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:22.385 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:22.401 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:22.401 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:22.405 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:22.425 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221206 2022-12-08 12:07:22.429 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:22.429 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:22.437 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:07:22.874 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:07:23.027 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:23.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:23.032 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:23.054 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221207 2022-12-08 12:07:23.058 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:23.058 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:23.061 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:07:23.066 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:23.453 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:07:23.892 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:07:24.242 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:07:24.615 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1554, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:07:24.619 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:24.619 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:24.622 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:24.638 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221208 2022-12-08 12:07:24.642 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:24.642 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:24.645 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:07:25.072 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:25.078 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:25.477 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:25.477 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:25.488 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:25.489 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:25.623 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:27.0, nextRun=2022-12-08 12:07:25.0, currentDate=Thu Dec 08 12:07:25 CST 2022 2022-12-08 12:07:25.624 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:06:27.0, nextRunTime=2022-12-08 12:07:25.0} 2022-12-08 12:07:25.673 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:07:25.674 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:07:25.674 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:07:25.798 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1153, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:07:25.804 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:25.804 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:25.810 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:25.826 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221209 2022-12-08 12:07:25.830 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:25.831 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:25.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:07:26.566 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 46, operation:EXECUTE, state: RUNNING 2022-12-08 12:07:26.578 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:26.579 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:26.582 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:26.596 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221210 2022-12-08 12:07:26.599 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:26.599 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:26.600 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=46, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:07:26.551+08:00, endTime=null} 2022-12-08 12:07:26.605 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:07:27.473 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:46, status:SUCCESS 2022-12-08 12:07:27.482 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:46, status:SUCCESS 2022-12-08 12:07:27.572 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:27.573 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:27.576 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:27.597 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221211 2022-12-08 12:07:27.601 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:27.601 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:27.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:07:28.049 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:07:28.057 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:07:28.079 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:28.084 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:28.127 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:28.128 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:28.132 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:28.151 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221212 2022-12-08 12:07:28.154 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:28.155 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:28.169 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:07:28.589 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:28.598 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:28.836 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:28.836 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:28.839 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:28.857 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221213 2022-12-08 12:07:28.860 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:28.861 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:28.865 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:07:29.243 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:07:29.885 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1020, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:07:29.888 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:29.889 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:29.893 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:29.914 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221214 2022-12-08 12:07:29.922 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:29.923 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:29.925 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:07:29.962 INFO 42 --- [pool-ocp-schedules-4,,01fbdebc0af4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:07:30.011 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:07:02.0, nextRun=2022-12-08 12:07:30.0, currentDate=Thu Dec 08 12:07:30 CST 2022 2022-12-08 12:07:30.012 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:07:02.0, nextRunTime=2022-12-08 12:07:30.0} 2022-12-08 12:07:30.031 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:07:30.032 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:07:30.032 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:07:30.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:07:30.417 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:07:30.416206+08:00, lastProcessTime=2022-12-08T12:07:20.402906+08:00 2022-12-08 12:07:30.572 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:07:30.416206+08:00, resultsCount=0 2022-12-08 12:07:30.573 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:07:30.416206+08:00, resultsCount=0 2022-12-08 12:07:30.573 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:07:30.416206+08:00 2022-12-08 12:07:30.729 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 47, operation:EXECUTE, state: RUNNING 2022-12-08 12:07:31.053 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=47, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:07:30.715+08:00, endTime=null} 2022-12-08 12:07:31.085 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:31.090 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:31.566 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1641, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:07:31.570 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:31.571 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:31.574 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:31.587 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221215 2022-12-08 12:07:31.590 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:31.591 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:31.594 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:07:31.683 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:31.732 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:31.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:31.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:31.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:31.968 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:07:32.011 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:30.0, nextRun=2022-12-08 12:07:30.0, currentDate=Thu Dec 08 12:07:32 CST 2022 2022-12-08 12:07:32.012 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:06:30.0, nextRunTime=2022-12-08 12:07:30.0} 2022-12-08 12:07:32.039 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:07:32.356 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:47, status:SUCCESS 2022-12-08 12:07:32.364 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:47, status:SUCCESS 2022-12-08 12:07:32.518 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:32.518 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:32.521 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:32.538 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221216 2022-12-08 12:07:32.543 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:32.543 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:32.546 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:07:33.121 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:33.794 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1248, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:07:33.798 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:33.798 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:33.801 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 12:07:33.825 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:33.825 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:33.829 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:07:33.835 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:33.835 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:33.838 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2022-12-08 12:07:33.892 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:07:33.948 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221123 2022-12-08 12:07:33.960 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:33.961 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:33.965 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 12:07:34.091 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:34.096 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:34.297 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:07:34.670 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:07:34.674 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:34.675 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:34.677 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:07:34.684 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:34.702 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221124 2022-12-08 12:07:34.709 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:34.710 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:34.715 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 12:07:34.981 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:34.981 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:35.347 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:07:35.763 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1048, sql=alter table `ob_hist_sqltext` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 12:07:35.767 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:35.767 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:35.770 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:35.785 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221125 2022-12-08 12:07:35.789 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:35.789 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:35.792 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 12:07:36.578 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:07:36.738 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:07:36.795 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:07:37.033 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1241, sql=alter table `ob_hist_sqltext` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 12:07:37.037 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:37.038 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:37.041 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:37.054 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221126 2022-12-08 12:07:37.058 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:37.058 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:37.061 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 12:07:37.097 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:37.103 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:37.931 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:37.932 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:37.937 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:37.952 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221127 2022-12-08 12:07:37.955 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:37.956 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:37.960 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 12:07:38.042 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:38.042 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:38.042 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:38.043 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:38.659 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:38.660 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:38.663 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:38.680 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221128 2022-12-08 12:07:38.683 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:38.684 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:38.687 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 12:07:39.161 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:07:39.475 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:39.476 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:39.479 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:39.491 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221129 2022-12-08 12:07:39.495 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:39.495 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:39.498 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 12:07:39.851 INFO 42 --- [pool-ocp-schedules-7,,e5bf7e8a0295] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:07:39.907 INFO 42 --- [pool-ocp-schedules-7,,e5bf7e8a0295] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:07:39.958 INFO 42 --- [pool-ocp-schedules-6,,d6f2b29c36d4] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:07:39.963 INFO 42 --- [pool-ocp-schedules-9,,52f59a963793] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:07:40.094 INFO 42 --- [pool-ocp-schedules-10,,c8f0f2cd858a] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:07:40.103 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:40.110 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:40.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:07:40.411 INFO 42 --- [pool-ocp-schedules-8,,e28954929f26] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:07:40.419 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:07:40.418809+08:00, lastProcessTime=2022-12-08T12:07:30.416206+08:00 2022-12-08 12:07:40.436 INFO 42 --- [pool-ocp-schedules-16,,20aa368fbc48] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:07:40.439 INFO 42 --- [pool-ocp-schedules-2,,46b6967b9c64] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:07:40.543 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:07:40.418809+08:00, resultsCount=0 2022-12-08 12:07:40.544 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:07:40.418809+08:00, resultsCount=0 2022-12-08 12:07:40.544 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:07:40.418809+08:00 2022-12-08 12:07:40.548 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:07:40.555 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:07:40.970 INFO 42 --- [pool-ocp-schedules-11,,4b802667a3e9] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:07:40.971 INFO 42 --- [pool-ocp-schedules-11,,4b802667a3e9] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:07:40.972 INFO 42 --- [pool-ocp-schedules-11,,4b802667a3e9] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:07:41.128 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:41.128 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:41.301 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1803, sql=alter table `ob_hist_sqltext` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 12:07:41.305 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:41.305 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:41.308 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:41.327 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221130 2022-12-08 12:07:41.331 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:41.331 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:41.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:07:41.491 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:07:41.968 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:42.067 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:07:42.521 INFO 42 --- [pool-ocp-schedules-4,,c3b018723ab7] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:07:42.521 INFO 42 --- [pool-ocp-schedules-4,,c3b018723ab7] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:07:42.959 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1622, sql=alter table `ob_hist_sqltext` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:07:42.966 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:42.967 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:42.970 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:42.988 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221201 2022-12-08 12:07:43.001 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:43.002 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:43.005 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:07:43.111 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:43.118 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:43.443 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:43.924 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:07:44.221 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1216, sql=alter table `ob_hist_sqltext` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:07:44.225 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:44.225 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:44.228 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:44.242 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221202 2022-12-08 12:07:44.245 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:44.246 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:44.250 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:07:44.326 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:07:44.487 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:44.487 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:44.487 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:44.488 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:45.047 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:45.048 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:45.051 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:45.065 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221203 2022-12-08 12:07:45.068 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:45.069 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:45.071 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:07:46.119 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:46.124 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:46.981 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:07:46.987 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:07:47.115 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2044, sql=alter table `ob_hist_sqltext` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:07:47.118 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:47.119 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:47.122 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:47.133 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221204 2022-12-08 12:07:47.136 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:47.136 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:47.140 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:07:47.561 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:47.561 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:48.447 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:07:49.125 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:49.137 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:49.964 INFO 42 --- [pool-ocp-schedules-7,,0d275a5a3706] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:07:50.023 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2883, sql=alter table `ob_hist_sqltext` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:07:50.027 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:50.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:50.031 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:50.057 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221205 2022-12-08 12:07:50.061 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:50.062 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:50.065 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:07:50.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:07:50.408 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:07:50.408894+08:00, lastProcessTime=2022-12-08T12:07:40.418809+08:00 2022-12-08 12:07:50.525 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:07:50.408894+08:00, resultsCount=0 2022-12-08 12:07:50.527 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:07:50.408894+08:00, resultsCount=0 2022-12-08 12:07:50.527 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:07:50.408894+08:00 2022-12-08 12:07:51.213 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1148, sql=alter table `ob_hist_sqltext` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:07:51.216 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:51.217 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:51.219 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:51.237 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221206 2022-12-08 12:07:51.240 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:51.240 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:51.243 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:07:51.446 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:51.446 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:51.447 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:51.447 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:52.036 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:52.139 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:52.145 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:52.156 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:07:52.262 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1019, sql=alter table `ob_hist_sqltext` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:07:52.267 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:52.268 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:52.281 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:52.298 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221207 2022-12-08 12:07:52.303 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:52.303 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:52.306 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:07:53.103 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:53.103 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:53.106 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:53.122 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221208 2022-12-08 12:07:53.126 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:53.126 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:53.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:07:53.599 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:07:53.934 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:07:53.940 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:07:53.956 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:07:54.188 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:07:54.358 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:07:54.422 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1293, sql=alter table `ob_hist_sqltext` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:07:54.426 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:54.427 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:54.430 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:54.447 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221209 2022-12-08 12:07:54.456 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:54.456 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:54.459 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:07:54.545 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:54.546 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:07:55.039 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:07:55.146 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:55.150 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:55.530 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1071, sql=alter table `ob_hist_sqltext` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:07:55.534 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:55.534 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:55.537 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:55.555 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221210 2022-12-08 12:07:55.572 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:55.572 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:55.576 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:07:56.450 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:56.451 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:56.454 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:56.477 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221211 2022-12-08 12:07:56.481 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:56.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:56.484 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:07:57.607 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:57.607 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:57.643 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:07:57.644 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:07:58.151 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:07:58.157 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:07:58.485 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2001, sql=alter table `ob_hist_sqltext` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:07:58.489 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:58.489 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:58.492 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:07:58.506 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221212 2022-12-08 12:07:58.510 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:07:58.510 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:07:58.515 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:07:59.280 INFO 42 --- [http-nio-8080-exec-1,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring DispatcherServlet 'dispatcherServlet' 2022-12-08 12:07:59.281 INFO 42 --- [http-nio-8080-exec-1,,] o.s.web.servlet.DispatcherServlet : Initializing Servlet 'dispatcherServlet' 2022-12-08 12:07:59.573 INFO 42 --- [http-nio-8080-exec-1,,] o.s.web.servlet.DispatcherServlet : Completed initialization in 292 ms 2022-12-08 12:07:59.967 INFO 42 --- [pool-ocp-schedules-10,,a6ea2f24e896] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:08:00.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:08:00.369 INFO 42 --- [http-nio-8080-exec-1,6f533b2fa19a4e03,f731d6a2fd39] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=127.0.0.1, traceId=6f533b2fa19a4e03, method=OffsetDateTime com.alipay.ocp.server.controller.InfoController.time(), args=] 2022-12-08 12:08:00.412 INFO 42 --- [http-nio-8080-exec-1,6f533b2fa19a4e03,f731d6a2fd39] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=127.0.0.1, traceId=6f533b2fa19a4e03, duration=253 ms] 2022-12-08 12:08:00.887 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2372, sql=alter table `ob_hist_sqltext` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:08:00.904 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:00.904 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:00.942 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:08:00.937580+08:00, lastProcessTime=2022-12-08T12:07:50.408894+08:00 2022-12-08 12:08:00.963 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:08:00.992 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221213 2022-12-08 12:08:00.995 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:00.995 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:00.998 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:08:01.129 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:08:00.937580+08:00, resultsCount=0 2022-12-08 12:08:01.141 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:08:00.937580+08:00, resultsCount=0 2022-12-08 12:08:01.141 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:08:00.937580+08:00 2022-12-08 12:08:01.158 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:01.163 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:01.179 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:08:01.184 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:08:01.212 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:06:02.0, nextRun=2022-12-08 12:08:00.0, currentDate=Thu Dec 08 12:08:01 CST 2022 2022-12-08 12:08:01.213 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 12:06:02.0, nextRunTime=2022-12-08 12:08:00.0} 2022-12-08 12:08:01.246 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 12:08:01.419 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:07:02.0, nextRun=2022-12-08 12:08:00.0, currentDate=Thu Dec 08 12:08:01 CST 2022 2022-12-08 12:08:01.420 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:07:02.0, nextRunTime=2022-12-08 12:08:00.0} 2022-12-08 12:08:01.438 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:08:01.438 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:08:01.439 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:08:02.157 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:02.285 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:07:02.0, nextRun=2022-12-08 12:08:00.0, currentDate=Thu Dec 08 12:08:02 CST 2022 2022-12-08 12:08:02.286 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:07:02.0, nextRunTime=2022-12-08 12:08:00.0} 2022-12-08 12:08:02.338 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:08:02.339 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:08:02.339 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:08:02.354 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:08:02.471 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 48, operation:EXECUTE, state: RUNNING 2022-12-08 12:08:02.481 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:07:02.0, nextRun=2022-12-08 12:08:00.0, currentDate=Thu Dec 08 12:08:02 CST 2022 2022-12-08 12:08:02.482 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:07:02.0, nextRunTime=2022-12-08 12:08:00.0} 2022-12-08 12:08:02.525 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:08:02.525 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:08:02.526 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:08:02.592 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=48, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:08:02.456+08:00, endTime=null} 2022-12-08 12:08:02.618 INFO 42 --- [pool-ocp-schedules-16,,4269d444626a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:08:02.618 INFO 42 --- [pool-ocp-schedules-16,,4269d444626a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:08:02.623 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:07:30.0, nextRun=2022-12-08 12:08:00.0, currentDate=Thu Dec 08 12:08:02 CST 2022 2022-12-08 12:08:02.624 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:07:30.0, nextRunTime=2022-12-08 12:08:00.0} 2022-12-08 12:08:02.654 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:08:02.655 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:08:02.655 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:08:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,7d89e1fb41ef] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472540, interval=60 2022-12-08 12:08:02.706 INFO 42 --- [pool-prometheus-minute-schedule-2,,7d89e1fb41ef] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472482, count=0, elapsed=1668802010224 2022-12-08 12:08:02.713 INFO 42 --- [pool-prometheus-minute-schedule-1,,c63d0d913df2] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472540, interval=60 2022-12-08 12:08:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,c63d0d913df2] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472482, count=0, elapsed=1668802010232 2022-12-08 12:08:02.791 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:07:02.0, nextRun=2022-12-08 12:08:00.0, currentDate=Thu Dec 08 12:08:02 CST 2022 2022-12-08 12:08:02.792 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:07:02.0, nextRunTime=2022-12-08 12:08:00.0} 2022-12-08 12:08:02.811 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:08:02.812 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:08:02.812 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:08:03.275 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2277, sql=alter table `ob_hist_sqltext` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:08:03.281 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:03.281 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:03.285 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:08:03.302 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221214 2022-12-08 12:08:03.306 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:03.306 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:03.310 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:08:03.656 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:03.680 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 49, operation:EXECUTE, state: RUNNING 2022-12-08 12:08:03.718 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:48, status:SUCCESS 2022-12-08 12:08:03.728 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:48, status:SUCCESS 2022-12-08 12:08:03.790 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=49, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T12:08:03.665+08:00, endTime=null} 2022-12-08 12:08:03.854 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 50, operation:EXECUTE, state: RUNNING 2022-12-08 12:08:03.894 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=50, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T12:08:03.842+08:00, endTime=null} 2022-12-08 12:08:03.972 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 51, operation:EXECUTE, state: RUNNING 2022-12-08 12:08:04.012 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=51, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:08:03.961+08:00, endTime=null} 2022-12-08 12:08:04.035 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:08:04.054 INFO 42 --- [pool-subtask-executor30,71424bfefee043c0,74f55ac9bf52] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=50, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=50, task_operation=execute, latest_execution_start_time=2022-12-08T12:08:03.841+08:00, sub_task_instance_id=50}, listMap={}}, executor=192.168.28.62 2022-12-08 12:08:04.087 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 52, operation:EXECUTE, state: RUNNING 2022-12-08 12:08:04.116 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:04.116 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:04.118 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:08:04.124 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:04.125 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:04.129 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221215 2022-12-08 12:08:04.132 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:04.132 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:04.135 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:08:04.138 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=52, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:08:04.073+08:00, endTime=null} 2022-12-08 12:08:04.150 INFO 42 --- [pool-subtask-executor30,71424bfefee043c0,74f55ac9bf52] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 50, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:08:04.163 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:04.168 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,7916e6e3adff] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=51, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=51, task_operation=execute, latest_execution_start_time=2022-12-08T12:08:03.960+08:00, sub_task_instance_id=51}, listMap={}}, executor=192.168.28.62 2022-12-08 12:08:04.169 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,7916e6e3adff] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:08:04.169 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:04.182 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,7916e6e3adff] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:08:04.302 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,7916e6e3adff] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 51, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:08:04.364 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:08:04.432 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:08:05.109 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:49, status:SUCCESS 2022-12-08 12:08:05.117 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:49, status:SUCCESS 2022-12-08 12:08:05.232 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:50, status:SUCCESS 2022-12-08 12:08:05.242 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:50, status:SUCCESS 2022-12-08 12:08:05.246 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1111, sql=alter table `ob_hist_sqltext` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:08:05.249 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:05.250 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:05.253 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:08:05.272 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221216 2022-12-08 12:08:05.277 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:05.278 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:05.281 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:08:05.357 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:51, status:SUCCESS 2022-12-08 12:08:05.367 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:51, status:SUCCESS 2022-12-08 12:08:05.484 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:52, status:SUCCESS 2022-12-08 12:08:05.492 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:52, status:SUCCESS 2022-12-08 12:08:05.538 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:07:05.0, nextRun=2022-12-08 12:08:05.0, currentDate=Thu Dec 08 12:08:05 CST 2022 2022-12-08 12:08:05.539 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:07:05.0, nextRunTime=2022-12-08 12:08:05.0} 2022-12-08 12:08:05.564 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:08:05.565 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:08:05.566 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:08:06.174 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:06.174 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:06.177 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 12:08:06.195 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:06.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:06.198 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:08:06.203 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:06.204 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:06.206 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2022-12-08 12:08:06.228 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 53, operation:EXECUTE, state: RUNNING 2022-12-08 12:08:06.247 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221130 2022-12-08 12:08:06.252 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:06.252 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:06.255 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:08:06.713 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=53, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:08:06.209+08:00, endTime=null} 2022-12-08 12:08:06.738 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:08:06.795 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:08:06.856 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:08:07.169 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:07.174 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:07.204 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:07.204 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:07.206 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:07.206 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:07.278 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1023, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:08:07.281 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:07.281 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:07.284 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:07.298 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221201 2022-12-08 12:08:07.301 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:07.301 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:07.305 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:08:08.553 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:53, status:SUCCESS 2022-12-08 12:08:08.560 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:53, status:SUCCESS 2022-12-08 12:08:08.757 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1452, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:08:08.766 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:08.767 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:08.771 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:08.786 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221202 2022-12-08 12:08:08.789 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:08.790 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:08.797 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:08:09.217 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:08:09.478 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:09.478 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:09.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:09.497 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221203 2022-12-08 12:08:09.506 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:09.506 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:09.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:08:09.830 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:08:09.836 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:08:09.968 INFO 42 --- [pool-ocp-schedules-17,,039e90295491] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:08:10.175 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:10.180 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:10.269 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:10.311 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:10.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:08:10.393 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:10.394 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:10.397 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:10.411 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221204 2022-12-08 12:08:10.415 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:10.415 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:10.418 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:08:10.418391+08:00, lastProcessTime=2022-12-08T12:08:00.937580+08:00 2022-12-08 12:08:10.419 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:08:10.461 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:08:10.544 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:08:10.418391+08:00, resultsCount=0 2022-12-08 12:08:10.544 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:08:10.418391+08:00, resultsCount=0 2022-12-08 12:08:10.545 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:08:10.418391+08:00 2022-12-08 12:08:10.988 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:10.989 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:10.992 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:11.003 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221205 2022-12-08 12:08:11.007 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:11.007 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:11.010 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:08:12.355 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:12.398 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1388, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:08:12.404 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:12.404 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:12.407 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:12.419 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221206 2022-12-08 12:08:12.422 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:12.423 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:12.426 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:08:12.928 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:08:13.181 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:13.196 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:13.336 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:13.337 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:13.385 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:13.386 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,0abfda0287f9] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:08:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,0abfda0287f9] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:08:13.762 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:14.086 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:08:14.490 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:08:14.605 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2179, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:08:14.608 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:14.609 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:14.612 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:14.632 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221207 2022-12-08 12:08:14.647 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:14.648 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:14.651 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:08:15.779 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:08:15.785 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:08:15.968 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1317, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:08:15.972 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:15.972 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:15.976 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:15.990 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221208 2022-12-08 12:08:15.995 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:15.996 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:15.999 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:08:16.197 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:16.201 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:16.417 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:16.716 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:16.716 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:16.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:16.734 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221209 2022-12-08 12:08:16.737 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:16.737 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:16.740 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:08:16.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:17.417 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:08:17.542 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:17.543 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:17.547 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:17.567 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221210 2022-12-08 12:08:17.571 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:17.571 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:17.574 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:08:18.637 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1063, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:08:18.640 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:18.641 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:18.644 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:18.661 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221211 2022-12-08 12:08:18.667 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:18.667 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:18.670 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:08:19.202 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:19.206 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:19.537 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:19.538 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:19.717 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1047, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:08:19.720 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:19.720 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:19.723 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:19.740 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221212 2022-12-08 12:08:19.743 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:19.744 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:19.747 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:08:19.970 INFO 42 --- [pool-ocp-schedules-6,,234774608723] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:08:19.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:19.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:20.158 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:07:21.0, nextRun=2022-12-08 12:08:20.0, currentDate=Thu Dec 08 12:08:20 CST 2022 2022-12-08 12:08:20.159 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:07:21.0, nextRunTime=2022-12-08 12:08:20.0} 2022-12-08 12:08:20.179 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:08:20.180 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:08:20.180 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:08:20.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:08:20.380 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:20.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:20.384 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:20.400 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221213 2022-12-08 12:08:20.405 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:20.405 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:20.408 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:08:20.432 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:08:20.430282+08:00, lastProcessTime=2022-12-08T12:08:10.418391+08:00 2022-12-08 12:08:20.589 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:08:20.430282+08:00, resultsCount=0 2022-12-08 12:08:20.590 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:08:20.430282+08:00, resultsCount=0 2022-12-08 12:08:20.590 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:08:20.430282+08:00 2022-12-08 12:08:20.983 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 54, operation:EXECUTE, state: RUNNING 2022-12-08 12:08:21.037 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=54, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:08:20.970+08:00, endTime=null} 2022-12-08 12:08:21.100 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:21.100 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:21.103 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:21.117 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221214 2022-12-08 12:08:21.120 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:21.121 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:21.123 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:08:21.848 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:21.849 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:21.852 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:21.866 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221215 2022-12-08 12:08:21.869 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:21.870 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:21.873 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:08:22.115 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:54, status:SUCCESS 2022-12-08 12:08:22.123 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:54, status:SUCCESS 2022-12-08 12:08:22.207 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:22.215 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:22.702 INFO 42 --- [pool-ocp-schedules-15,,1b8490c24629] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:08:22.703 INFO 42 --- [pool-ocp-schedules-15,,1b8490c24629] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:08:22.753 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:08:22.760 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:08:22.928 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:23.039 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:23.071 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:08:23.175 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1302, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:08:23.179 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:23.180 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:23.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:23.200 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221216 2022-12-08 12:08:23.208 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:23.208 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:23.220 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:08:24.013 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:24.223 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1002, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:08:24.228 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:24.229 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:24.232 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 12:08:24.256 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:24.257 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:24.260 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:08:24.266 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:24.266 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:24.270 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2022-12-08 12:08:24.292 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:08:24.312 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221130 2022-12-08 12:08:24.315 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:24.315 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:24.318 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:08:24.348 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:08:24.573 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:08:25.007 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:25.007 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:25.010 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:25.022 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221201 2022-12-08 12:08:25.026 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:25.026 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:25.029 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:08:25.216 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:25.221 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:25.716 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:25.790 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:07:26.0, nextRun=2022-12-08 12:08:25.0, currentDate=Thu Dec 08 12:08:25 CST 2022 2022-12-08 12:08:25.791 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:07:26.0, nextRunTime=2022-12-08 12:08:25.0} 2022-12-08 12:08:25.833 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:08:25.833 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:08:25.833 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:08:25.886 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:08:25.948 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:25.949 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:25.951 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:25.962 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221202 2022-12-08 12:08:25.967 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:25.968 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:25.970 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:08:26.100 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:26.100 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:26.186 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 55, operation:EXECUTE, state: RUNNING 2022-12-08 12:08:26.219 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=55, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:08:26.164+08:00, endTime=null} 2022-12-08 12:08:26.533 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:26.533 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:26.537 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:26.556 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221203 2022-12-08 12:08:26.562 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:26.563 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:26.566 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:08:26.779 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:55, status:SUCCESS 2022-12-08 12:08:26.787 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:55, status:SUCCESS 2022-12-08 12:08:27.268 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:27.269 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:27.272 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:27.289 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221204 2022-12-08 12:08:27.297 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:27.298 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:27.301 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:08:27.321 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 12:08:27.334 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=13ms, period=120000ms 2022-12-08 12:08:28.110 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:28.110 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:28.113 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:28.131 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221205 2022-12-08 12:08:28.135 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:28.136 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:28.140 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:08:28.222 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:28.227 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:28.714 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:28.714 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:28.718 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:28.734 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221206 2022-12-08 12:08:28.750 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:28.751 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:28.754 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:08:28.768 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:28.769 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:29.282 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:29.282 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:29.288 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:29.304 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221207 2022-12-08 12:08:29.308 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:29.308 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:29.314 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:08:29.971 INFO 42 --- [pool-ocp-schedules-15,,46aed7421ed1] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:08:30.128 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:07:32.0, nextRun=2022-12-08 12:08:30.0, currentDate=Thu Dec 08 12:08:30 CST 2022 2022-12-08 12:08:30.129 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:07:32.0, nextRunTime=2022-12-08 12:08:30.0} 2022-12-08 12:08:30.155 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:08:30.269 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:03.0, nextRun=2022-12-08 12:08:30.0, currentDate=Thu Dec 08 12:08:30 CST 2022 2022-12-08 12:08:30.271 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:08:03.0, nextRunTime=2022-12-08 12:08:30.0} 2022-12-08 12:08:30.292 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:08:30.293 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:08:30.293 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:08:30.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:08:30.409 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:08:30.409161+08:00, lastProcessTime=2022-12-08T12:08:20.430282+08:00 2022-12-08 12:08:30.532 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:08:30.409161+08:00, resultsCount=0 2022-12-08 12:08:30.532 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:08:30.409161+08:00, resultsCount=0 2022-12-08 12:08:30.533 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:08:30.409161+08:00 2022-12-08 12:08:30.589 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1276, sql=alter table `ob_hist_plan_cache_plan` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:08:30.592 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:30.592 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:30.598 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:30.617 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221208 2022-12-08 12:08:30.620 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:30.621 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:30.625 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:08:31.134 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:08:31.140 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:08:31.228 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:31.235 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:31.377 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 56, operation:EXECUTE, state: RUNNING 2022-12-08 12:08:31.434 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=56, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:08:31.359+08:00, endTime=null} 2022-12-08 12:08:31.571 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:31.572 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:31.575 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:31.590 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221209 2022-12-08 12:08:31.593 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:31.593 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:31.595 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:08:31.843 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:32.150 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:32.150 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:32.153 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:32.174 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221210 2022-12-08 12:08:32.178 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:32.178 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:32.181 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:08:32.236 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:32.693 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:56, status:SUCCESS 2022-12-08 12:08:32.701 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:56, status:SUCCESS 2022-12-08 12:08:32.736 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:08:32.869 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:32.869 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:32.873 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:32.900 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221211 2022-12-08 12:08:32.905 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:32.906 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:32.909 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:08:32.967 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:33.141 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:08:33.519 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:33.519 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:33.523 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:33.538 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221212 2022-12-08 12:08:33.541 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:33.542 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:33.545 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:08:34.066 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:34.115 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:34.116 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:34.119 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:34.133 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221213 2022-12-08 12:08:34.139 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:34.139 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:34.143 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:08:34.235 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:34.242 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:34.415 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:08:34.639 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:08:34.903 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:34.904 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:34.990 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:34.991 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:34.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:35.010 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221214 2022-12-08 12:08:35.014 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:35.014 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:35.017 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:08:35.299 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:35.299 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:35.895 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:35.895 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:35.898 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:35.910 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221215 2022-12-08 12:08:35.913 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:35.914 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:35.919 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:08:36.732 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:36.733 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:36.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:36.761 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221216 2022-12-08 12:08:36.765 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:36.765 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:36.768 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:08:36.779 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:08:36.856 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:08:36.891 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:08:37.243 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:37.251 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:37.268 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:37.268 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:37.272 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 12:08:37.316 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:37.317 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:37.322 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:08:37.329 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:37.329 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:37.332 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2022-12-08 12:08:37.377 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221130 2022-12-08 12:08:37.385 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:37.385 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:37.389 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:08:38.201 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:08:38.207 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:08:38.649 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:38.868 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1479, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:08:38.871 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:38.872 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:38.875 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:38.887 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221201 2022-12-08 12:08:38.891 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:38.891 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:38.894 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:08:39.317 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:08:39.848 INFO 42 --- [pool-ocp-schedules-12,,e46f8f3acbdd] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:08:39.877 INFO 42 --- [pool-ocp-schedules-12,,e46f8f3acbdd] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:08:39.944 INFO 42 --- [pool-ocp-schedules-9,,5f6b1483f3e5] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:08:39.945 INFO 42 --- [pool-ocp-schedules-9,,5f6b1483f3e5] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:08:39.959 INFO 42 --- [pool-ocp-schedules-4,,483f18b22fb9] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:08:39.972 INFO 42 --- [pool-ocp-schedules-18,,61e29e7495c2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:08:40.099 INFO 42 --- [pool-ocp-schedules-13,,eac5b17ba3af] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:08:40.252 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:40.259 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:40.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:08:40.426 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:08:40.426465+08:00, lastProcessTime=2022-12-08T12:08:30.409161+08:00 2022-12-08 12:08:40.459 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1565, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:08:40.466 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:40.467 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:40.471 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:40.481 INFO 42 --- [pool-ocp-schedules-15,,94a8b617c2ce] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:08:40.489 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221202 2022-12-08 12:08:40.493 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:40.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:40.498 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:08:40.502 INFO 42 --- [pool-ocp-schedules-7,,4ba6705b7e6c] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:08:40.502 INFO 42 --- [pool-ocp-schedules-17,,6ea0d624ff9d] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:08:40.555 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:08:40.426465+08:00, resultsCount=0 2022-12-08 12:08:40.555 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:08:40.426465+08:00, resultsCount=0 2022-12-08 12:08:40.555 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:08:40.426465+08:00 2022-12-08 12:08:41.066 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:41.339 INFO 42 --- [pool-ocp-schedules-12,,a64b4738c29d] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:08:41.339 INFO 42 --- [pool-ocp-schedules-12,,a64b4738c29d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:08:41.340 INFO 42 --- [pool-ocp-schedules-12,,a64b4738c29d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:08:41.345 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:08:41.674 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1176, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:08:41.678 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:41.679 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:41.682 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:41.699 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221203 2022-12-08 12:08:41.703 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:41.703 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:41.707 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:08:41.744 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:41.744 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:42.921 INFO 42 --- [pool-ocp-schedules-4,,bd8430d0c33a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:08:42.922 INFO 42 --- [pool-ocp-schedules-4,,bd8430d0c33a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:08:43.031 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:43.204 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:08:43.245 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1538, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:08:43.249 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:43.249 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:43.252 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:43.260 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:43.264 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221204 2022-12-08 12:08:43.265 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:43.267 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:43.267 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:43.270 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:08:44.066 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:44.067 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:44.071 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:44.085 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221205 2022-12-08 12:08:44.088 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:44.089 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:44.092 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:08:44.097 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:44.272 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:44.272 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:44.685 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:08:44.715 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:08:44.781 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:44.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:44.784 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:44.795 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221206 2022-12-08 12:08:44.799 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:44.800 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:44.802 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:08:45.707 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:45.707 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:45.711 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:45.729 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221207 2022-12-08 12:08:45.732 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:45.733 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:45.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:08:46.266 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:46.273 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:46.544 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:08:46.550 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:08:46.566 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:46.567 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:46.569 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:46.582 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221208 2022-12-08 12:08:46.585 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:46.585 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:46.588 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:08:47.322 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:47.561 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:47.562 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:47.565 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:47.579 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221209 2022-12-08 12:08:47.583 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:47.584 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:47.586 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:08:47.855 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:48.160 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:08:48.441 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:48.443 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:48.446 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:48.460 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221210 2022-12-08 12:08:48.463 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:48.463 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:48.466 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:08:49.267 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:49.268 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:49.272 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:49.273 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:49.278 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:49.289 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221211 2022-12-08 12:08:49.293 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:49.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:49.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:08:49.973 INFO 42 --- [pool-ocp-schedules-19,,07cf72896ba6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:08:50.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:08:50.402 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1106, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:08:50.409 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:50.410 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:50.415 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:50.417 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:50.418 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:50.434 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221212 2022-12-08 12:08:50.435 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:08:50.432886+08:00, lastProcessTime=2022-12-08T12:08:40.426465+08:00 2022-12-08 12:08:50.438 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:50.439 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:50.442 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:08:50.628 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:08:50.432886+08:00, resultsCount=0 2022-12-08 12:08:50.629 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:08:50.432886+08:00, resultsCount=0 2022-12-08 12:08:50.629 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:08:50.432886+08:00 2022-12-08 12:08:50.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:50.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:51.464 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1022, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:08:51.472 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:51.473 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:51.476 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:51.489 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221213 2022-12-08 12:08:51.504 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:51.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:51.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:08:52.279 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:52.279 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:52.280 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:52.283 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:52.284 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:52.298 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221214 2022-12-08 12:08:52.301 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:52.302 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:52.306 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:08:53.066 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:53.067 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:53.071 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:53.101 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221215 2022-12-08 12:08:53.105 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:53.105 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:53.109 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:08:53.141 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:53.248 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:08:53.322 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:08:53.329 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:08:53.496 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:53.913 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:53.913 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:53.922 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:53.934 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221216 2022-12-08 12:08:53.938 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:53.938 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:53.941 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:08:54.088 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:08:54.119 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:08:54.426 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:08:54.643 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:08:54.732 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:08:54.758 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:08:55.132 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1191, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:08:55.135 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:55.135 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:55.138 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 12:08:55.151 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:55.152 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:55.155 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:08:55.160 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:55.161 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:55.163 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2022-12-08 12:08:55.285 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:55.290 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:55.327 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221130 2022-12-08 12:08:55.331 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:55.331 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:55.335 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:08:56.008 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:56.009 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:56.012 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:08:56.032 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221201 2022-12-08 12:08:56.036 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:56.036 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:56.039 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:08:56.553 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:56.554 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:56.729 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:56.729 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:56.735 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:08:56.749 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221202 2022-12-08 12:08:56.752 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:56.752 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:56.755 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:08:57.176 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:08:57.177 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:08:57.349 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:57.350 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:57.353 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:08:57.368 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221203 2022-12-08 12:08:57.387 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:57.388 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:57.398 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:08:58.291 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:08:58.297 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:08:58.322 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:58.323 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:58.325 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:08:58.338 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221204 2022-12-08 12:08:58.341 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:58.342 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:58.345 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:08:59.087 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:59.088 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:59.090 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:08:59.101 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221205 2022-12-08 12:08:59.104 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:08:59.105 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:08:59.107 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:08:59.717 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:08:59.723 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:08:59.974 INFO 42 --- [pool-ocp-schedules-14,,bd7186e89fea] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:09:00.001 INFO 42 --- [pool-ocp-schedules-12,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 12:09:00.009 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:00.009 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:00.013 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:00.030 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221206 2022-12-08 12:09:00.034 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:00.034 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:00.038 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:09:00.237 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:00.507 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:09:00.591 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:09:00.589726+08:00, lastProcessTime=2022-12-08T12:08:50.432886+08:00 2022-12-08 12:09:00.758 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:00.759 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:00.764 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:00.787 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221207 2022-12-08 12:09:00.791 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:00.792 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:00.795 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:09:00.806 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:09:00.589726+08:00, resultsCount=0 2022-12-08 12:09:00.806 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:09:00.589726+08:00, resultsCount=0 2022-12-08 12:09:00.807 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:09:00.589726+08:00 2022-12-08 12:09:00.843 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:01.0, nextRun=2022-12-08 12:09:00.0, currentDate=Thu Dec 08 12:09:00 CST 2022 2022-12-08 12:09:00.844 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:08:01.0, nextRunTime=2022-12-08 12:09:00.0} 2022-12-08 12:09:00.871 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:09:00.872 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:09:00.872 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:09:00.945 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:02.0, nextRun=2022-12-08 12:09:00.0, currentDate=Thu Dec 08 12:09:00 CST 2022 2022-12-08 12:09:00.946 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:08:02.0, nextRunTime=2022-12-08 12:09:00.0} 2022-12-08 12:09:00.989 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:09:00.990 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:09:00.990 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:09:01.115 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:02.0, nextRun=2022-12-08 12:09:00.0, currentDate=Thu Dec 08 12:09:01 CST 2022 2022-12-08 12:09:01.115 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:08:02.0, nextRunTime=2022-12-08 12:09:00.0} 2022-12-08 12:09:01.151 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:09:01.152 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:09:01.153 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:09:01.230 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:30.0, nextRun=2022-12-08 12:09:00.0, currentDate=Thu Dec 08 12:09:01 CST 2022 2022-12-08 12:09:01.230 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:08:30.0, nextRunTime=2022-12-08 12:09:00.0} 2022-12-08 12:09:01.251 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:09:01.252 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:09:01.252 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:09:01.298 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:01.303 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:01.332 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:03.0, nextRun=2022-12-08 12:09:00.0, currentDate=Thu Dec 08 12:09:01 CST 2022 2022-12-08 12:09:01.333 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:08:03.0, nextRunTime=2022-12-08 12:09:00.0} 2022-12-08 12:09:01.369 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:09:01.370 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:09:01.370 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:09:01.504 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:01.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:01.507 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:01.523 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221208 2022-12-08 12:09:01.526 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:01.526 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:01.529 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:09:01.991 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 57, operation:EXECUTE, state: RUNNING 2022-12-08 12:09:02.080 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=57, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:09:01.972+08:00, endTime=null} 2022-12-08 12:09:02.169 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 58, operation:EXECUTE, state: RUNNING 2022-12-08 12:09:02.226 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=58, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T12:09:02.152+08:00, endTime=null} 2022-12-08 12:09:02.337 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 59, operation:EXECUTE, state: RUNNING 2022-12-08 12:09:02.427 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=59, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T12:09:02.320+08:00, endTime=null} 2022-12-08 12:09:02.469 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,eb78ce5e6a3c] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=58, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=58, task_operation=execute, latest_execution_start_time=2022-12-08T12:09:02.150+08:00, sub_task_instance_id=58}, listMap={}}, executor=192.168.28.62 2022-12-08 12:09:02.471 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:02.472 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:02.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:02.500 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221209 2022-12-08 12:09:02.504 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:02.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:02.508 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:09:02.542 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 60, operation:EXECUTE, state: RUNNING 2022-12-08 12:09:02.590 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,eb78ce5e6a3c] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 58, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:09:02.640 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=60, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:09:02.516+08:00, endTime=null} 2022-12-08 12:09:02.666 INFO 42 --- [pool-subtask-executor30,71424bfefee043c0,38a481ebe7ad] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=59, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=59, task_operation=execute, latest_execution_start_time=2022-12-08T12:09:02.318+08:00, sub_task_instance_id=59}, listMap={}}, executor=192.168.28.62 2022-12-08 12:09:02.674 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:02.705 INFO 42 --- [pool-prometheus-minute-schedule-1,,b46f44b92eb1] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472600, interval=60 2022-12-08 12:09:02.705 INFO 42 --- [pool-prometheus-minute-schedule-1,,b46f44b92eb1] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472542, count=0, elapsed=1668802070163 2022-12-08 12:09:02.713 INFO 42 --- [pool-prometheus-minute-schedule-1,,b933a5e49792] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472600, interval=60 2022-12-08 12:09:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,b933a5e49792] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472542, count=0, elapsed=1668802070172 2022-12-08 12:09:02.786 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 61, operation:EXECUTE, state: RUNNING 2022-12-08 12:09:02.840 INFO 42 --- [pool-subtask-executor30,71424bfefee043c0,38a481ebe7ad] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 59, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:09:02.868 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:09:02.924 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=61, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:09:02.762+08:00, endTime=null} 2022-12-08 12:09:03.093 INFO 42 --- [pool-ocp-schedules-2,,65e08290df15] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:09:03.094 INFO 42 --- [pool-ocp-schedules-2,,65e08290df15] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:09:03.175 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:03.281 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:09:03.319 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:03.320 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:03.374 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:57, status:SUCCESS 2022-12-08 12:09:03.394 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:57, status:SUCCESS 2022-12-08 12:09:03.485 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:03.486 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:03.488 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:03.498 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221210 2022-12-08 12:09:03.501 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:03.501 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:03.503 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:09:03.564 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:58, status:SUCCESS 2022-12-08 12:09:03.577 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:58, status:SUCCESS 2022-12-08 12:09:03.671 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:59, status:SUCCESS 2022-12-08 12:09:03.677 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:59, status:SUCCESS 2022-12-08 12:09:03.761 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:60, status:SUCCESS 2022-12-08 12:09:03.768 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:60, status:SUCCESS 2022-12-08 12:09:03.884 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:61, status:SUCCESS 2022-12-08 12:09:03.911 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:61, status:SUCCESS 2022-12-08 12:09:04.093 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:04.093 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:04.097 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:04.111 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221211 2022-12-08 12:09:04.119 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:04.120 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:04.131 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:09:04.164 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:04.304 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:04.308 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:04.719 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:04.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:04.722 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:04.732 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221212 2022-12-08 12:09:04.735 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:04.735 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:04.737 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:09:04.776 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:09:04.803 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:09:05.336 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:05.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:05.339 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:05.352 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221213 2022-12-08 12:09:05.355 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:05.355 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:05.358 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:09:05.625 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:06.0, nextRun=2022-12-08 12:09:05.0, currentDate=Thu Dec 08 12:09:05 CST 2022 2022-12-08 12:09:05.629 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:08:06.0, nextRunTime=2022-12-08 12:09:05.0} 2022-12-08 12:09:05.657 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:09:05.657 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:09:05.658 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:09:05.788 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:05.788 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:05.825 ERROR 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing PLAN_CHANGE_DETECTOR org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=2097200) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=2097200) Table has no partition for value ; (conn=2097200) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=2097200) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.insert(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy412.save(Unknown Source) ~[na:na] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:49) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$ad3ec26.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=2097200) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_312] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_312] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 26 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 40 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 41 common frames omitted 2022-12-08 12:09:05.949 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:05.949 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:05.952 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:05.964 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221214 2022-12-08 12:09:05.967 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:05.967 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:05.969 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:09:06.143 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 62, operation:EXECUTE, state: RUNNING 2022-12-08 12:09:06.213 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=62, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:09:06.118+08:00, endTime=null} 2022-12-08 12:09:06.390 INFO 42 --- [pool-ocp-schedules-12,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 12:09:06.541 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:06.542 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:06.545 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:06.559 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221215 2022-12-08 12:09:06.563 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:06.563 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:06.566 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:09:06.802 INFO 42 --- [pool-ocp-schedules-12,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 12:09:06.828 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:09:06.892 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:09:06.895 INFO 42 --- [pool-ocp-schedules-12,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 12:09:06.954 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:09:07.162 INFO 42 --- [pool-ocp-schedules-12,,] o.s.boot.SpringApplication : Started application in 7.087 seconds (JVM running for 701.75) 2022-12-08 12:09:07.162 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:07.162 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:07.165 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:07.195 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221216 2022-12-08 12:09:07.198 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:07.199 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:07.203 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:09:07.309 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:07.321 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:07.507 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:62, status:SUCCESS 2022-12-08 12:09:07.514 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:62, status:SUCCESS 2022-12-08 12:09:07.819 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:07.820 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:07.822 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 12:09:07.835 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:07.835 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:07.838 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:09:07.843 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:07.843 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:07.846 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2022-12-08 12:09:07.879 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221108 2022-12-08 12:09:07.890 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:07.891 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:07.894 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221108 values less than (1667952000000000)) 2022-12-08 12:09:08.082 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:09:08.094 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:09:08.598 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:08.598 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:08.602 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:08.620 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221109 2022-12-08 12:09:08.624 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:08.625 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:08.628 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221109 values less than (1668038400000000)) 2022-12-08 12:09:08.843 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:09.073 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:09.073 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:09.076 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:09.089 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221110 2022-12-08 12:09:09.092 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:09.092 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:09.095 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221110 values less than (1668124800000000)) 2022-12-08 12:09:09.098 INFO 42 --- [pool-ocp-schedules-12,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T12:09:09.098+08:00 2022-12-08 12:09:09.526 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:09.558 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:09.558 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:09.560 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:09.574 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221111 2022-12-08 12:09:09.577 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:09.577 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:09.580 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221111 values less than (1668211200000000)) 2022-12-08 12:09:09.713 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:09:09.861 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:09:09.975 INFO 42 --- [pool-ocp-schedules-11,,37fad5198a3f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:09:10.028 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:10.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:10.031 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:10.048 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221112 2022-12-08 12:09:10.052 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:10.052 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:10.055 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221112 values less than (1668297600000000)) 2022-12-08 12:09:10.322 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:10.327 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:10.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:09:10.405 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:09:10.405907+08:00, lastProcessTime=2022-12-08T12:09:00.589726+08:00 2022-12-08 12:09:10.538 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:09:10.405907+08:00, resultsCount=0 2022-12-08 12:09:10.538 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:09:10.405907+08:00, resultsCount=0 2022-12-08 12:09:10.538 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:09:10.405907+08:00 2022-12-08 12:09:10.608 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:10.608 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:10.612 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:10.635 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221113 2022-12-08 12:09:10.640 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:10.640 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:10.643 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221113 values less than (1668384000000000)) 2022-12-08 12:09:11.189 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:11.190 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:11.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:11.209 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221114 2022-12-08 12:09:11.213 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:11.213 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:11.216 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221114 values less than (1668470400000000)) 2022-12-08 12:09:11.758 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:11.785 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:11.788 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:11.801 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221115 2022-12-08 12:09:11.804 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:11.804 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:11.807 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221115 values less than (1668556800000000)) 2022-12-08 12:09:11.924 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:11.925 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:12.567 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:12.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:12.651 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:12.652 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:12.658 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:12.669 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221116 2022-12-08 12:09:12.672 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:12.673 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:12.677 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221116 values less than (1668643200000000)) 2022-12-08 12:09:13.281 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:13.310 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:13.311 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:13.315 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:13.327 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:13.332 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:13.333 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221117 2022-12-08 12:09:13.339 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:13.339 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:13.342 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221117 values less than (1668729600000000)) 2022-12-08 12:09:13.362 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:09:13.720 INFO 42 --- [pool-prometheus-cache-monitor1,,227609843e02] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:09:13.720 INFO 42 --- [pool-prometheus-cache-monitor1,,227609843e02] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:09:13.852 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:13.853 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:13.856 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:13.869 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221118 2022-12-08 12:09:13.872 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:13.872 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:13.876 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221118 values less than (1668816000000000)) 2022-12-08 12:09:14.198 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:14.489 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:14.490 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:14.493 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:14.509 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221119 2022-12-08 12:09:14.512 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:14.513 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:14.517 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221119 values less than (1668902400000000)) 2022-12-08 12:09:14.824 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:09:15.025 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:09:15.041 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:09:15.060 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:09:15.158 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:15.159 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:15.163 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:15.179 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221120 2022-12-08 12:09:15.183 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:15.183 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:15.188 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221120 values less than (1668988800000000)) 2022-12-08 12:09:15.248 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:15.651 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:15.736 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:09:15.795 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:15.795 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:15.799 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:15.821 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221121 2022-12-08 12:09:15.824 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:15.825 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:15.828 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221121 values less than (1669075200000000)) 2022-12-08 12:09:16.332 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:16.339 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:16.697 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:16.698 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:16.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:16.717 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221122 2022-12-08 12:09:16.724 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:16.724 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:16.727 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221122 values less than (1669161600000000)) 2022-12-08 12:09:17.357 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:17.357 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:17.360 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:17.374 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221123 2022-12-08 12:09:17.394 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:17.395 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:17.399 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 12:09:18.389 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:18.390 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:18.654 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1255, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 12:09:18.658 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:18.659 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:18.662 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:18.678 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221124 2022-12-08 12:09:18.681 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:18.682 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:18.685 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 12:09:18.731 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:18.732 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:19.208 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:19.208 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:19.211 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:19.223 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221125 2022-12-08 12:09:19.226 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:19.227 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:19.230 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 12:09:19.340 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:19.350 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:19.963 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:19.963 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:19.971 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:19.977 INFO 42 --- [pool-ocp-schedules-10,,688f0a20a087] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:09:19.988 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221126 2022-12-08 12:09:19.996 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:19.996 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:19.999 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 12:09:20.355 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:09:20.422 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:09:20.423135+08:00, lastProcessTime=2022-12-08T12:09:10.405907+08:00 2022-12-08 12:09:20.518 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:09:20.423135+08:00, resultsCount=0 2022-12-08 12:09:20.519 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:09:20.423135+08:00, resultsCount=0 2022-12-08 12:09:20.519 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:09:20.423135+08:00 2022-12-08 12:09:20.523 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:20.523 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:20.527 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:20.541 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221127 2022-12-08 12:09:20.545 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:20.545 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:20.549 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 12:09:20.795 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:20.0, nextRun=2022-12-08 12:09:20.0, currentDate=Thu Dec 08 12:09:20 CST 2022 2022-12-08 12:09:20.796 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:08:20.0, nextRunTime=2022-12-08 12:09:20.0} 2022-12-08 12:09:20.817 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:09:20.817 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:09:20.817 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:09:20.884 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:09:20.892 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:09:21.079 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:21.080 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:21.083 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:21.100 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221128 2022-12-08 12:09:21.110 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:21.110 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:21.114 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 12:09:21.484 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:21.581 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 63, operation:EXECUTE, state: RUNNING 2022-12-08 12:09:21.657 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=63, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:09:21.554+08:00, endTime=null} 2022-12-08 12:09:21.767 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:21.768 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:21.770 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:21.779 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221129 2022-12-08 12:09:21.782 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:21.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:21.785 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 12:09:21.817 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:21.986 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:09:22.307 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:22.307 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:22.310 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:22.323 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221130 2022-12-08 12:09:22.326 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:22.326 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:22.330 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:09:22.350 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:22.355 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:22.570 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:63, status:SUCCESS 2022-12-08 12:09:22.577 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:63, status:SUCCESS 2022-12-08 12:09:22.930 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:22.930 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:22.934 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:22.950 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221201 2022-12-08 12:09:22.954 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:22.954 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:22.969 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:09:23.145 INFO 42 --- [pool-ocp-schedules-1,,01bfd549b82f] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:09:23.146 INFO 42 --- [pool-ocp-schedules-1,,01bfd549b82f] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:09:23.362 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:23.447 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:09:23.732 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:23.733 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:23.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:23.748 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221202 2022-12-08 12:09:23.751 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:23.751 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:23.755 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:09:24.253 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:24.558 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:24.558 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:24.732 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:09:24.864 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:24.865 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:24.868 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:09:25.004 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1249, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:09:25.007 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:25.008 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:25.011 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:25.028 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221203 2022-12-08 12:09:25.032 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:25.032 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:25.035 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:09:25.161 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:09:25.356 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:25.367 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:25.651 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:25.651 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:25.656 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:25.669 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221204 2022-12-08 12:09:25.672 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:25.673 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:25.676 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:09:26.257 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:26.257 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:26.261 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:26.285 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221205 2022-12-08 12:09:26.288 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:26.289 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:26.292 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:09:26.378 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:26.0, nextRun=2022-12-08 12:09:25.0, currentDate=Thu Dec 08 12:09:26 CST 2022 2022-12-08 12:09:26.380 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:08:26.0, nextRunTime=2022-12-08 12:09:25.0} 2022-12-08 12:09:26.447 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:09:26.447 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:09:26.448 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:09:26.795 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 64, operation:EXECUTE, state: RUNNING 2022-12-08 12:09:26.860 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=64, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:09:26.779+08:00, endTime=null} 2022-12-08 12:09:26.975 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:26.975 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:26.978 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:26.994 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221206 2022-12-08 12:09:26.997 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:26.997 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:27.000 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:09:27.131 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:09:27.137 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:09:27.671 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:27.833 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:27.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:27.834 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:64, status:SUCCESS 2022-12-08 12:09:27.840 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:27.843 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:64, status:SUCCESS 2022-12-08 12:09:27.860 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221207 2022-12-08 12:09:27.867 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:27.868 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:27.873 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:09:27.934 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:28.225 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:09:28.367 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:28.372 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:28.815 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:28.815 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:28.819 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:28.837 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221208 2022-12-08 12:09:28.841 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:28.842 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:28.845 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:09:29.978 INFO 42 --- [pool-ocp-schedules-2,,bc9ca6fa27e5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:09:30.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:09:30.403 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:09:30.403812+08:00, lastProcessTime=2022-12-08T12:09:20.423135+08:00 2022-12-08 12:09:30.535 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:09:30.403812+08:00, resultsCount=0 2022-12-08 12:09:30.536 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:09:30.403812+08:00, resultsCount=0 2022-12-08 12:09:30.538 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:09:30.403812+08:00 2022-12-08 12:09:30.579 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:30.0, nextRun=2022-12-08 12:09:30.0, currentDate=Thu Dec 08 12:09:30 CST 2022 2022-12-08 12:09:30.580 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:08:30.0, nextRunTime=2022-12-08 12:09:30.0} 2022-12-08 12:09:30.608 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:09:30.739 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:09:01.0, nextRun=2022-12-08 12:09:30.0, currentDate=Thu Dec 08 12:09:30 CST 2022 2022-12-08 12:09:30.740 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:09:01.0, nextRunTime=2022-12-08 12:09:30.0} 2022-12-08 12:09:30.762 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:09:30.762 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:09:30.762 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:09:30.808 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:30.809 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:30.989 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 65, operation:EXECUTE, state: RUNNING 2022-12-08 12:09:31.008 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:31.008 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:31.187 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=65, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:09:30.974+08:00, endTime=null} 2022-12-08 12:09:31.373 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:31.379 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:31.409 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2564, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:09:31.412 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:31.413 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:31.416 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:31.437 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221209 2022-12-08 12:09:31.440 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:31.441 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:31.444 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:09:31.647 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:65, status:SUCCESS 2022-12-08 12:09:31.653 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:65, status:SUCCESS 2022-12-08 12:09:31.948 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:31.949 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:31.952 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:31.966 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221210 2022-12-08 12:09:31.970 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:31.970 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:31.973 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:09:32.550 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:32.551 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:32.556 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:32.582 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221211 2022-12-08 12:09:32.586 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:32.586 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:32.589 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:09:33.447 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:33.466 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:33.466 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:33.469 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:33.484 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221212 2022-12-08 12:09:33.487 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:33.488 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:33.491 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:09:33.582 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:09:33.586 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:09:33.592 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:09:34.095 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:34.095 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:34.115 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:34.130 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221213 2022-12-08 12:09:34.133 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:34.134 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:34.134 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:34.137 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:09:34.196 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:34.380 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:34.386 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:34.538 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:34.737 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:34.738 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:34.740 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:34.752 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221214 2022-12-08 12:09:34.755 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:34.756 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:34.761 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:09:34.767 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:09:34.922 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:09:35.215 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:09:35.610 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:35.611 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:35.614 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:35.626 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221215 2022-12-08 12:09:35.629 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:35.629 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:35.632 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:09:36.210 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:36.210 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:36.213 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:36.224 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221216 2022-12-08 12:09:36.228 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:36.229 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:36.232 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:09:36.854 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:36.855 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:36.856 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:09:36.858 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 12:09:36.884 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:36.885 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:36.888 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:09:36.894 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:36.894 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:36.897 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2022-12-08 12:09:37.024 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221108 2022-12-08 12:09:37.026 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:09:37.030 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:37.030 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:37.034 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221108 values less than (1667952000000000)) 2022-12-08 12:09:37.085 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:05:06+08:00, updateTime=2022-12-08T12:09:06+08:00, expireTime=null, isLeader=false} 2022-12-08 12:09:37.161 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:04:36+08:00, updateTime=2022-12-08T12:09:06+08:00, expireTime=null, isLeader=false} 2022-12-08 12:09:37.169 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 12:09:37.210 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:09:37.222 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:09:37.258 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:37.259 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:37.292 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:37.292 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:37.387 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:37.392 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:38.325 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1291, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221108 values less than (1667952000000000)) 2022-12-08 12:09:38.330 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:38.330 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:38.332 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:38.347 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221109 2022-12-08 12:09:38.354 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:38.354 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:38.359 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221109 values less than (1668038400000000)) 2022-12-08 12:09:39.762 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:09:39.837 INFO 42 --- [pool-ocp-schedules-6,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 12:09:39.856 INFO 42 --- [pool-ocp-schedules-12,,56423a170e42] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:09:39.918 INFO 42 --- [pool-ocp-schedules-12,,56423a170e42] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:09:39.960 INFO 42 --- [pool-ocp-schedules-8,,3acca50c1ab2] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:09:39.979 INFO 42 --- [pool-ocp-schedules-1,,8e007b202ee9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:09:40.104 INFO 42 --- [pool-ocp-schedules-15,,ccb8c22dc6e4] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:09:40.214 INFO 42 --- [pool-ocp-schedules-16,,5100ca6cdba4] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 12:09:40.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:09:40.368 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:09:40.376 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:09:40.393 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:40.403 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:40.451 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:09:40.449587+08:00, lastProcessTime=2022-12-08T12:09:30.403812+08:00 2022-12-08 12:09:40.635 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:40.667 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:09:40.449587+08:00, resultsCount=0 2022-12-08 12:09:40.668 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:09:40.449587+08:00, resultsCount=0 2022-12-08 12:09:40.668 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:09:40.449587+08:00 2022-12-08 12:09:40.686 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:40.691 INFO 42 --- [pool-ocp-schedules-3,,8648838f955d] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:09:40.693 INFO 42 --- [pool-ocp-schedules-13,,9d9417ea03f9] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:09:40.706 INFO 42 --- [pool-ocp-schedules-14,,702c06ecb618] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:09:40.970 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2611, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221109 values less than (1668038400000000)) 2022-12-08 12:09:40.973 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:40.974 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:40.977 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:40.988 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221110 2022-12-08 12:09:40.992 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:40.992 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:40.995 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221110 values less than (1668124800000000)) 2022-12-08 12:09:41.170 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:09:41.485 INFO 42 --- [pool-ocp-schedules-7,,80b9dd680b98] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:09:41.486 INFO 42 --- [pool-ocp-schedules-7,,80b9dd680b98] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:09:41.486 INFO 42 --- [pool-ocp-schedules-7,,80b9dd680b98] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:09:42.690 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1695, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221110 values less than (1668124800000000)) 2022-12-08 12:09:42.700 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:42.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:42.709 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:42.727 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221111 2022-12-08 12:09:42.732 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:42.733 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:42.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221111 values less than (1668211200000000)) 2022-12-08 12:09:43.200 INFO 42 --- [pool-ocp-schedules-18,,1ff8b86d5a6b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:09:43.201 INFO 42 --- [pool-ocp-schedules-18,,1ff8b86d5a6b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:09:43.404 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:43.410 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:43.503 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:43.612 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:09:43.799 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:43.799 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:43.800 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:43.800 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:43.807 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1071, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221111 values less than (1668211200000000)) 2022-12-08 12:09:43.814 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:43.814 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:43.817 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:43.830 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221112 2022-12-08 12:09:43.835 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:43.835 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:43.838 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221112 values less than (1668297600000000)) 2022-12-08 12:09:44.569 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:44.585 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:44.586 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:44.589 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:44.602 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221113 2022-12-08 12:09:44.605 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:44.605 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:44.608 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221113 values less than (1668384000000000)) 2022-12-08 12:09:45.155 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:09:45.249 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:09:45.436 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:45.437 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:45.440 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:45.453 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221114 2022-12-08 12:09:45.456 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:45.457 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:45.460 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221114 values less than (1668470400000000)) 2022-12-08 12:09:46.209 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:46.210 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:46.213 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:46.231 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221115 2022-12-08 12:09:46.235 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:46.236 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:46.239 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221115 values less than (1668556800000000)) 2022-12-08 12:09:46.311 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:09:46.322 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:09:46.410 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:46.422 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:46.899 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:46.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:47.092 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:47.093 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:47.096 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:47.110 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221116 2022-12-08 12:09:47.113 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:47.113 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:47.117 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221116 values less than (1668643200000000)) 2022-12-08 12:09:47.435 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:09:47.982 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:47.982 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:47.986 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:48.003 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221117 2022-12-08 12:09:48.006 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:48.007 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:48.010 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221117 values less than (1668729600000000)) 2022-12-08 12:09:48.908 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:48.909 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:48.912 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:48.931 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221118 2022-12-08 12:09:48.935 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:48.936 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:48.939 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221118 values less than (1668816000000000)) 2022-12-08 12:09:49.423 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:49.428 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:49.963 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:49.963 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:49.964 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:49.964 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:49.980 INFO 42 --- [pool-ocp-schedules-18,,8bd076bc0868] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:09:50.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:09:50.417 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:09:50.409156+08:00, lastProcessTime=2022-12-08T12:09:40.449587+08:00 2022-12-08 12:09:50.442 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1503, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221118 values less than (1668816000000000)) 2022-12-08 12:09:50.445 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:50.445 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:50.448 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:50.463 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221119 2022-12-08 12:09:50.466 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:50.466 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:50.468 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221119 values less than (1668902400000000)) 2022-12-08 12:09:50.568 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:09:50.409156+08:00, resultsCount=0 2022-12-08 12:09:50.568 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:09:50.409156+08:00, resultsCount=0 2022-12-08 12:09:50.568 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:09:50.409156+08:00 2022-12-08 12:09:51.416 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:51.417 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:51.423 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:51.435 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221120 2022-12-08 12:09:51.438 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:51.438 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:51.441 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221120 values less than (1668988800000000)) 2022-12-08 12:09:52.428 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:52.433 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:52.607 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:09:52.610 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1169, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221120 values less than (1668988800000000)) 2022-12-08 12:09:52.614 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:52.614 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:52.614 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:09:52.617 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:52.630 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221121 2022-12-08 12:09:52.633 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:52.633 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:52.636 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221121 values less than (1669075200000000)) 2022-12-08 12:09:53.055 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:53.058 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:53.236 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:09:53.540 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:53.652 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:09:53.775 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1139, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221121 values less than (1669075200000000)) 2022-12-08 12:09:53.778 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:53.779 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:53.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:53.793 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221122 2022-12-08 12:09:53.796 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:53.797 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:53.799 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221122 values less than (1669161600000000)) 2022-12-08 12:09:54.722 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:09:54.996 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:09:55.036 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1237, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221122 values less than (1669161600000000)) 2022-12-08 12:09:55.043 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:55.044 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:55.048 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:55.063 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221123 2022-12-08 12:09:55.066 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:55.067 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:55.071 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 12:09:55.193 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:09:55.285 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:09:55.434 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:55.439 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:56.236 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:56.236 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:09:56.237 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:56.237 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:09:57.038 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1967, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 12:09:57.042 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:57.043 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:57.048 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:57.067 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221124 2022-12-08 12:09:57.071 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:57.072 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:57.079 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 12:09:58.440 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:09:58.445 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:09:58.514 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:09:58.520 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:09:58.885 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1806, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 12:09:58.889 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:58.890 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:58.894 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:09:58.920 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221125 2022-12-08 12:09:58.923 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:09:58.924 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:09:58.927 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 12:09:59.596 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:59.597 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:09:59.982 INFO 42 --- [pool-ocp-schedules-13,,7b0bff69d6ce] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:10:00.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:10:00.804 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:10:00.819 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:10:00.818998+08:00, lastProcessTime=2022-12-08T12:09:50.409156+08:00 2022-12-08 12:10:00.854 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:00 CST 2022 2022-12-08 12:10:00.855 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=12, name=Refresh agent config, templateName=RefreshAgentConfigSchedule, scheduleRule=0 */10 * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:00.890 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Refresh agent config, nodeCount=1, taskCount=1 2022-12-08 12:10:00.891 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:00.891 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Refresh agent config, taskDefinitionId=12, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:00.947 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:10:00.818998+08:00, resultsCount=0 2022-12-08 12:10:00.948 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:10:00.818998+08:00, resultsCount=0 2022-12-08 12:10:00.948 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:10:00.818998+08:00 2022-12-08 12:10:01.079 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2152, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 12:10:01.082 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:01.083 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:01.086 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:01.102 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221126 2022-12-08 12:10:01.107 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:01.107 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:01.111 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 12:10:01.182 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:08:01.0, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:01 CST 2022 2022-12-08 12:10:01.185 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 12:08:01.0, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:01.211 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 12:10:01.280 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:01 CST 2022 2022-12-08 12:10:01.281 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=15, name=Sync system event, templateName=SyncSystemEventSchedule, scheduleRule=0 */10 * * * *, lastRunTime=null, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:01.309 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync system event 2022-12-08 12:10:01.362 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:01.0, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:01 CST 2022 2022-12-08 12:10:01.363 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 12:05:01.0, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:01.386 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 12:10:01.387 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:01.387 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:01.446 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:01.452 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:01.473 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:02.0, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:01 CST 2022 2022-12-08 12:10:01.473 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 12:05:02.0, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:01.642 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 12:10:01.642 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 12:10:01.682 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:09:01.0, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:01 CST 2022 2022-12-08 12:10:01.683 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:09:01.0, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:01.700 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:10:01.701 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:01.701 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:01.760 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:09:01.0, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:01 CST 2022 2022-12-08 12:10:01.760 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:09:01.0, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:01.793 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:10:01.793 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:01.793 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:01.839 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:09:01.0, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:01 CST 2022 2022-12-08 12:10:01.840 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:09:01.0, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:01.865 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 66, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:01.865 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:10:01.866 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:01.866 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:01.902 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=66, name=Refresh all agent config, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.RefreshAllAgentConfigTask, seriesId=0, startTime=2022-12-08T12:10:01.848+08:00, endTime=null} 2022-12-08 12:10:01.924 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:09:31.0, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:01 CST 2022 2022-12-08 12:10:01.925 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:09:31.0, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:01.930 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:01.930 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:01.933 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:01.941 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:10:01.941 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:01.941 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:01.945 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221127 2022-12-08 12:10:01.948 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:01.949 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:01.951 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 12:10:01.986 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 67, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:02.016 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:05:03.0, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:02 CST 2022 2022-12-08 12:10:02.017 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 12:05:03.0, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:02.039 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 12:10:02.040 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:02.040 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:02.057 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=67, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T12:10:01.971+08:00, endTime=null} 2022-12-08 12:10:02.115 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 68, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:02.363 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:09:01.0, nextRun=2022-12-08 12:10:00.0, currentDate=Thu Dec 08 12:10:02 CST 2022 2022-12-08 12:10:02.364 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:09:01.0, nextRunTime=2022-12-08 12:10:00.0} 2022-12-08 12:10:02.396 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:10:02.396 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:02.396 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:02.400 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=68, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:10:02.105+08:00, endTime=null} 2022-12-08 12:10:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,ca195fdb4970] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472660, interval=60 2022-12-08 12:10:02.706 INFO 42 --- [pool-prometheus-minute-schedule-2,,ca195fdb4970] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472602, count=0, elapsed=1668802130104 2022-12-08 12:10:02.713 INFO 42 --- [pool-prometheus-minute-schedule-1,,530e4688fb9c] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472660, interval=60 2022-12-08 12:10:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,530e4688fb9c] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472602, count=0, elapsed=1668802130112 2022-12-08 12:10:02.873 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:66, status:SUCCESS 2022-12-08 12:10:02.884 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:66, status:SUCCESS 2022-12-08 12:10:02.930 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,935c0bd043ec] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=68, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=68, task_operation=execute, latest_execution_start_time=2022-12-08T12:10:02.104+08:00, sub_task_instance_id=68}, listMap={}}, executor=192.168.28.62 2022-12-08 12:10:03.022 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:67, status:SUCCESS 2022-12-08 12:10:03.032 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:67, status:SUCCESS 2022-12-08 12:10:03.055 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,935c0bd043ec] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 68, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:10:03.512 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 69, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:03.515 INFO 42 --- [pool-ocp-schedules-17,,9af446ebde13] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:10:03.516 INFO 42 --- [pool-ocp-schedules-17,,9af446ebde13] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:10:03.571 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:03.622 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=69, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T12:10:03.496+08:00, endTime=null} 2022-12-08 12:10:03.711 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 70, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:03.773 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=70, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T12:10:03.688+08:00, endTime=null} 2022-12-08 12:10:03.797 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:03.798 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:03.799 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:03.799 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:03.846 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,d42435806bc1] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=69, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=69, task_operation=execute, latest_execution_start_time=2022-12-08T12:10:03.494+08:00, sub_task_instance_id=69}, listMap={}}, executor=192.168.28.62 2022-12-08 12:10:03.859 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 71, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:03.934 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1983, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 12:10:03.937 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:03.937 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:03.940 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:03.950 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,d42435806bc1] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 69, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:10:03.955 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221128 2022-12-08 12:10:03.955 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=71, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:10:03.843+08:00, endTime=null} 2022-12-08 12:10:03.958 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:03.958 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:03.961 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 12:10:03.981 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:10:04.038 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 72, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:04.073 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=72, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T12:10:04.013+08:00, endTime=null} 2022-12-08 12:10:04.154 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 73, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:04.204 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=73, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:10:04.139+08:00, endTime=null} 2022-12-08 12:10:04.232 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,06dc73a31783] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=72, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=72, task_operation=execute, latest_execution_start_time=2022-12-08T12:10:04.012+08:00, sub_task_instance_id=72}, listMap={}}, executor=192.168.28.62 2022-12-08 12:10:04.233 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,06dc73a31783] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2022-12-08 12:10:04.248 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,06dc73a31783] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2022-12-08 12:10:04.364 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,06dc73a31783] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 72, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:10:04.453 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:04.456 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:04.764 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:05.062 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1101, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 12:10:05.067 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:05.067 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:05.071 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:05.081 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221129 2022-12-08 12:10:05.084 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:05.085 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:05.092 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 12:10:05.209 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:68, status:SUCCESS 2022-12-08 12:10:05.220 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:68, status:SUCCESS 2022-12-08 12:10:05.235 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:10:05.354 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:10:05.428 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:69, status:SUCCESS 2022-12-08 12:10:05.435 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:69, status:SUCCESS 2022-12-08 12:10:05.446 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:09:06.0, nextRun=2022-12-08 12:10:05.0, currentDate=Thu Dec 08 12:10:05 CST 2022 2022-12-08 12:10:05.447 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:09:06.0, nextRunTime=2022-12-08 12:10:05.0} 2022-12-08 12:10:05.490 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:10:05.491 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:05.491 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:05.703 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:70, status:SUCCESS 2022-12-08 12:10:05.709 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:70, status:SUCCESS 2022-12-08 12:10:05.984 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:71, status:SUCCESS 2022-12-08 12:10:05.992 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:71, status:SUCCESS 2022-12-08 12:10:06.094 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:72, status:SUCCESS 2022-12-08 12:10:06.100 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:72, status:SUCCESS 2022-12-08 12:10:06.174 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T12:04:06.007, end=2022-12-08T12:09:06.007} 2022-12-08 12:10:06.176 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T12:04:06.015, end=2022-12-08T12:09:06.015} 2022-12-08 12:10:06.196 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:73, status:SUCCESS 2022-12-08 12:10:06.215 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:73, status:SUCCESS 2022-12-08 12:10:06.229 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 12:10:06.234 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 12:10:06.416 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1324, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 12:10:06.420 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:06.420 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:06.423 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:06.435 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221130 2022-12-08 12:10:06.446 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:06.446 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:06.449 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:10:06.451 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 74, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:06.453 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:10:06.458 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:10:06.813 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=74, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:10:06.439+08:00, endTime=null} 2022-12-08 12:10:06.928 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:06.928 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:07.026 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:10:07.256 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:06:06+08:00, updateTime=2022-12-08T12:09:36+08:00, expireTime=null, isLeader=false} 2022-12-08 12:10:07.264 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:10:07.316 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:10:07.335 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:10:07.363 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:10:07.457 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:07.470 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:07.757 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:74, status:SUCCESS 2022-12-08 12:10:07.766 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:74, status:SUCCESS 2022-12-08 12:10:08.020 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1571, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:10:08.024 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:08.025 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:08.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:08.044 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221201 2022-12-08 12:10:08.048 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:08.049 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:08.053 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:10:09.159 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1106, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:10:09.163 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:09.163 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:09.166 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:09.179 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221202 2022-12-08 12:10:09.182 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:09.182 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:09.185 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:10:09.984 INFO 42 --- [pool-ocp-schedules-11,,522265d4211b] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:10:10.125 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:10:10.207 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:10.208 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:10.211 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:10.212 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:10.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1152, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:10:10.341 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:10.342 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:10.345 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:10.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:10:10.361 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221203 2022-12-08 12:10:10.364 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:10.364 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:10.367 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:10:10.419 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:10:10.419202+08:00, lastProcessTime=2022-12-08T12:10:00.818998+08:00 2022-12-08 12:10:10.471 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:10.475 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:10.543 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:10:10.419202+08:00, resultsCount=0 2022-12-08 12:10:10.544 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:10:10.419202+08:00, resultsCount=0 2022-12-08 12:10:10.544 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:10:10.419202+08:00 2022-12-08 12:10:11.204 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:11.205 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:11.208 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:11.222 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221204 2022-12-08 12:10:11.231 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:11.231 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:11.234 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:10:12.558 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:10:12.564 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:10:12.813 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1579, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:10:12.817 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:12.817 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:12.820 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:12.833 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221205 2022-12-08 12:10:12.836 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:12.837 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:12.839 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:10:13.273 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:13.305 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:13.476 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:13.486 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:13.631 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:13.632 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:13.635 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:13.651 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221206 2022-12-08 12:10:13.657 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:13.657 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:13.658 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:10:13.660 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:10:13.660 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,7cdc0f4bab72] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:10:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,7cdc0f4bab72] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:10:14.040 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:10:14.849 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:14.895 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1235, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:10:14.898 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:14.899 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:14.902 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:14.917 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221207 2022-12-08 12:10:14.920 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:14.920 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:14.923 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:10:15.328 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:10:15.428 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:10:16.363 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1440, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:10:16.366 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:16.366 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:16.369 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:16.375 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:16.375 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:16.375 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:16.375 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:16.386 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221208 2022-12-08 12:10:16.391 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:16.392 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:16.395 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:10:16.486 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:16.491 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:18.167 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1772, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:10:18.171 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:18.172 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:18.175 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:18.190 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221209 2022-12-08 12:10:18.194 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:18.194 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:18.197 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:10:18.892 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:10:18.899 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:10:19.075 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:19.076 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:19.079 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:19.096 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221210 2022-12-08 12:10:19.099 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:19.099 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:19.102 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:10:19.492 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:19.496 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:19.587 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:19.587 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:19.986 INFO 42 --- [pool-ocp-schedules-10,,4506b73e1203] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:10:20.083 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:10:20.206 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:09:21.0, nextRun=2022-12-08 12:10:20.0, currentDate=Thu Dec 08 12:10:20 CST 2022 2022-12-08 12:10:20.207 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:09:21.0, nextRunTime=2022-12-08 12:10:20.0} 2022-12-08 12:10:20.236 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:10:20.237 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:20.237 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:20.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:10:20.364 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1262, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:10:20.368 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:20.368 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:20.371 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:20.394 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221211 2022-12-08 12:10:20.397 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:20.398 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:20.404 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:10:20.446 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:10:20.446250+08:00, lastProcessTime=2022-12-08T12:10:10.419202+08:00 2022-12-08 12:10:20.575 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:10:20.446250+08:00, resultsCount=0 2022-12-08 12:10:20.576 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:10:20.446250+08:00, resultsCount=0 2022-12-08 12:10:20.576 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:10:20.446250+08:00 2022-12-08 12:10:21.058 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 75, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:21.138 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=75, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:10:21.042+08:00, endTime=null} 2022-12-08 12:10:21.739 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1335, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:10:21.743 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:21.744 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:21.758 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:21.772 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221212 2022-12-08 12:10:21.776 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:21.776 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:21.779 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:10:22.497 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:22.501 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:22.570 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:75, status:SUCCESS 2022-12-08 12:10:22.577 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:75, status:SUCCESS 2022-12-08 12:10:22.717 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:22.717 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:22.717 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:22.718 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:22.753 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:22.753 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:22.756 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:22.772 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221213 2022-12-08 12:10:22.777 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:22.778 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:22.781 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:10:23.629 INFO 42 --- [pool-ocp-schedules-11,,aec9647fc0b1] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:10:23.630 INFO 42 --- [pool-ocp-schedules-11,,aec9647fc0b1] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:10:23.703 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:24.073 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:10:24.155 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1374, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:10:24.159 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:24.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:24.163 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:24.179 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221214 2022-12-08 12:10:24.182 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:24.182 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:24.185 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:10:25.059 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:25.059 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:25.062 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:25.080 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221215 2022-12-08 12:10:25.083 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:25.084 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:25.086 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:10:25.175 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:25.208 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:10:25.282 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:10:25.290 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:10:25.502 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:25.507 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:25.679 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:10:25.772 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:10:25.926 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:25.926 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:25.928 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:25.943 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221216 2022-12-08 12:10:25.946 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:25.947 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:25.949 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:10:26.043 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:26.043 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:26.282 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:09:26.0, nextRun=2022-12-08 12:10:25.0, currentDate=Thu Dec 08 12:10:26 CST 2022 2022-12-08 12:10:26.283 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:09:26.0, nextRunTime=2022-12-08 12:10:25.0} 2022-12-08 12:10:26.328 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:10:26.328 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:26.329 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:26.397 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:10:27.065 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1116, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:10:27.068 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:27.069 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:27.072 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 12:10:27.088 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:27.088 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:27.091 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:10:27.095 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:27.095 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:27.098 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2022-12-08 12:10:27.134 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221130 2022-12-08 12:10:27.138 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:27.138 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:27.141 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:10:27.284 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 76, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:27.321 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 12:10:27.340 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=19ms, period=120000ms 2022-12-08 12:10:27.354 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=76, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:10:27.270+08:00, endTime=null} 2022-12-08 12:10:27.547 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:27.548 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:27.555 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:27.571 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221201 2022-12-08 12:10:27.574 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:27.574 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:27.576 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:10:28.062 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:28.063 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:28.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:28.082 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221202 2022-12-08 12:10:28.086 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:28.086 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:28.089 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:10:28.507 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:28.529 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:28.607 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:28.608 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:28.611 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:28.625 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221203 2022-12-08 12:10:28.629 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:28.629 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:28.633 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:10:28.695 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:76, status:SUCCESS 2022-12-08 12:10:28.703 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:76, status:SUCCESS 2022-12-08 12:10:29.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:29.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:29.290 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:29.290 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:29.604 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:29.605 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:29.608 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:29.621 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221204 2022-12-08 12:10:29.624 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:29.624 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:29.627 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:10:29.987 INFO 42 --- [pool-ocp-schedules-8,,a60b523a6391] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:10:30.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:10:30.442 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:10:30.442855+08:00, lastProcessTime=2022-12-08T12:10:20.446250+08:00 2022-12-08 12:10:30.597 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:10:30.442855+08:00, resultsCount=0 2022-12-08 12:10:30.598 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:10:30.442855+08:00, resultsCount=0 2022-12-08 12:10:30.598 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:10:30.442855+08:00 2022-12-08 12:10:30.734 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:09:31.0, nextRun=2022-12-08 12:10:30.0, currentDate=Thu Dec 08 12:10:30 CST 2022 2022-12-08 12:10:30.735 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:09:31.0, nextRunTime=2022-12-08 12:10:30.0} 2022-12-08 12:10:30.772 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:10:30.845 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1218, sql=alter table `ob_hist_active_session_stat_0` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:10:30.849 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:30.850 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:30.854 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:30.871 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221205 2022-12-08 12:10:30.876 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:30.876 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:30.881 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:10:30.915 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:02.0, nextRun=2022-12-08 12:10:30.0, currentDate=Thu Dec 08 12:10:30 CST 2022 2022-12-08 12:10:30.916 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:10:02.0, nextRunTime=2022-12-08 12:10:30.0} 2022-12-08 12:10:30.938 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:10:30.938 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:10:30.938 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:10:31.290 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:31.291 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:31.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:31.308 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221206 2022-12-08 12:10:31.312 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:31.312 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:31.314 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:10:31.471 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 77, operation:EXECUTE, state: RUNNING 2022-12-08 12:10:31.508 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=77, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:10:31.459+08:00, endTime=null} 2022-12-08 12:10:31.530 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:31.534 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:31.538 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:10:31.543 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:10:31.722 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:31.722 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:31.725 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:31.740 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221207 2022-12-08 12:10:31.742 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:31.743 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:31.748 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:10:32.157 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:32.157 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:32.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:32.176 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221208 2022-12-08 12:10:32.179 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:32.179 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:32.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:10:32.374 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:32.374 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:32.625 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:32.625 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:32.630 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:32.646 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221209 2022-12-08 12:10:32.669 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:32.670 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:32.673 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:10:32.691 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:10:33.235 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:77, status:SUCCESS 2022-12-08 12:10:33.241 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:77, status:SUCCESS 2022-12-08 12:10:33.752 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:33.953 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1280, sql=alter table `ob_hist_active_session_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:10:33.961 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:33.961 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:33.964 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:33.983 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221210 2022-12-08 12:10:33.987 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:33.987 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:33.992 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:10:34.101 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:10:34.535 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:34.543 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:34.699 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:34.699 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:34.702 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:34.719 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221211 2022-12-08 12:10:34.723 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:34.723 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:34.726 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:10:35.208 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:35.387 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:35.387 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:35.395 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:35.416 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221212 2022-12-08 12:10:35.420 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:35.420 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:35.423 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:10:35.437 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:35.437 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:35.466 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:35.466 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:35.752 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:10:35.994 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:35.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:35.998 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:36.014 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221213 2022-12-08 12:10:36.018 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:36.018 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:36.022 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:10:36.199 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:10:36.861 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:36.862 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:36.865 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:36.881 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221214 2022-12-08 12:10:36.884 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:36.884 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:36.887 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:10:37.316 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:10:37.421 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:10:37.509 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:10:37.544 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:37.549 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:37.668 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:37.669 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:37.672 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:37.692 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221215 2022-12-08 12:10:37.695 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:37.696 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:37.699 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:10:38.163 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:38.164 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:38.167 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:38.177 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:10:38.182 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:10:38.182 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221216 2022-12-08 12:10:38.185 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:38.186 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:38.189 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:10:38.497 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:38.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:38.664 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:38.665 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:38.669 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 12:10:38.685 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:38.685 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:38.689 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:10:38.695 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:38.695 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:38.698 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2022-12-08 12:10:38.761 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:10:38.803 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202209 2022-12-08 12:10:38.806 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:38.806 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:38.810 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:10:39.219 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:39.219 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:39.222 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2022-12-08 12:10:39.232 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202210 2022-12-08 12:10:39.235 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:39.236 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:39.239 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:10:39.847 INFO 42 --- [pool-ocp-schedules-12,,f6bca0053406] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:10:39.878 INFO 42 --- [pool-ocp-schedules-12,,f6bca0053406] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:10:39.946 INFO 42 --- [pool-ocp-schedules-11,,973565407f6d] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:10:39.946 INFO 42 --- [pool-ocp-schedules-11,,973565407f6d] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:10:39.962 INFO 42 --- [pool-ocp-schedules-5,,7f7fa35f11c6] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:10:39.988 INFO 42 --- [pool-ocp-schedules-19,,214a45f7518f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:10:40.134 INFO 42 --- [pool-ocp-schedules-13,,9581a05162f2] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:10:40.264 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:10:40.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:10:40.404 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:10:40.404+08:00, lastProcessTime=2022-12-08T12:10:30.442855+08:00 2022-12-08 12:10:40.498 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:10:40.404+08:00, resultsCount=0 2022-12-08 12:10:40.499 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:10:40.404+08:00, resultsCount=0 2022-12-08 12:10:40.499 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:10:40.404+08:00 2022-12-08 12:10:40.549 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:40.554 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:40.858 INFO 42 --- [pool-ocp-schedules-12,,725321d8b093] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:10:40.858 INFO 42 --- [pool-ocp-schedules-16,,fde736c229fc] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:10:40.860 INFO 42 --- [pool-ocp-schedules-1,,39668077a834] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:10:41.428 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2189, sql=alter table `ob_hist_snapshot` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:10:41.431 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:41.431 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:41.434 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2022-12-08 12:10:41.447 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202211 2022-12-08 12:10:41.451 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:41.451 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:41.454 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:10:41.547 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:41.547 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:41.568 INFO 42 --- [pool-ocp-schedules-9,,a00c54e8edf6] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:10:41.569 INFO 42 --- [pool-ocp-schedules-9,,a00c54e8edf6] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:10:41.569 INFO 42 --- [pool-ocp-schedules-9,,a00c54e8edf6] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:10:41.605 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:41.606 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:41.928 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:41.928 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:41.931 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2022-12-08 12:10:41.946 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202212 2022-12-08 12:10:41.951 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:41.951 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:41.955 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:10:42.334 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:42.335 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:42.338 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2022-12-08 12:10:42.356 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:42.356 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:42.359 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:10:42.367 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:42.367 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:42.370 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2022-12-08 12:10:42.461 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202209 2022-12-08 12:10:42.464 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:42.464 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:42.467 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:10:42.955 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:42.955 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:42.959 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2022-12-08 12:10:42.986 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202210 2022-12-08 12:10:42.990 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:42.990 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:42.993 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:10:43.555 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:43.560 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:43.584 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:43.585 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:43.588 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2022-12-08 12:10:43.603 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202211 2022-12-08 12:10:43.606 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:43.606 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:43.609 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:10:43.676 INFO 42 --- [pool-ocp-schedules-12,,27f45be4526c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:10:43.676 INFO 42 --- [pool-ocp-schedules-12,,27f45be4526c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:10:43.781 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:43.935 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:10:43.941 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:10:44.206 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:44.206 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:44.210 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2022-12-08 12:10:44.224 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202212 2022-12-08 12:10:44.228 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:44.229 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:44.232 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:10:44.439 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:10:44.594 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:44.618 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:44.618 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:44.622 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2022-12-08 12:10:44.644 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:44.644 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:44.647 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:10:44.653 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:44.653 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:44.656 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2022-12-08 12:10:44.659 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:44.696 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202209 2022-12-08 12:10:44.700 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:44.700 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:44.703 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:10:45.029 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:10:45.266 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:45.267 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:45.271 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2022-12-08 12:10:45.288 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202210 2022-12-08 12:10:45.292 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:45.292 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:45.295 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:10:45.295 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:45.833 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:10:46.110 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:46.111 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:46.114 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2022-12-08 12:10:46.130 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202211 2022-12-08 12:10:46.134 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:46.134 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:46.138 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:10:46.480 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:10:46.560 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:46.566 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:46.585 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:46.586 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:46.589 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2022-12-08 12:10:46.600 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202212 2022-12-08 12:10:46.603 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:46.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:46.607 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:10:47.060 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:47.060 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:47.064 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2022-12-08 12:10:47.081 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:47.081 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:47.085 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:10:47.090 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:47.091 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:47.096 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2022-12-08 12:10:47.119 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202209 2022-12-08 12:10:47.122 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:47.122 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:47.125 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:10:47.648 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:47.649 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:47.736 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:47.737 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:48.104 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:48.104 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:48.107 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2022-12-08 12:10:48.121 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202210 2022-12-08 12:10:48.128 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:48.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:48.133 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:10:48.571 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:48.572 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:48.575 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2022-12-08 12:10:48.592 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202211 2022-12-08 12:10:48.597 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:48.597 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:48.606 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:10:49.566 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:49.571 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:49.989 INFO 42 --- [pool-ocp-schedules-11,,10a09ad71aa8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:10:50.057 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1451, sql=alter table `ob_hist_server` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:10:50.061 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:50.061 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:50.069 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2022-12-08 12:10:50.088 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202212 2022-12-08 12:10:50.091 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:50.092 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:50.096 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:10:50.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:10:50.403 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:10:50.403291+08:00, lastProcessTime=2022-12-08T12:10:40.404+08:00 2022-12-08 12:10:50.502 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:10:50.403291+08:00, resultsCount=0 2022-12-08 12:10:50.502 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:10:50.403291+08:00, resultsCount=0 2022-12-08 12:10:50.502 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:10:50.403291+08:00 2022-12-08 12:10:51.125 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:10:51.145 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:10:51.905 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1809, sql=alter table `ob_hist_server` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:10:51.909 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:51.909 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:51.912 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2022-12-08 12:10:51.931 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:51.931 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:51.935 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:10:51.942 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:51.943 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:51.946 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2022-12-08 12:10:52.061 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202209 2022-12-08 12:10:52.065 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:52.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:52.070 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:10:52.553 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:52.553 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:52.556 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2022-12-08 12:10:52.567 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202210 2022-12-08 12:10:52.578 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:52.581 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:52.581 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:52.583 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:52.587 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:10:53.324 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:53.325 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:53.331 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2022-12-08 12:10:53.348 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202211 2022-12-08 12:10:53.352 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:53.352 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:53.355 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:10:53.848 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:54.111 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:54.158 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:10:54.164 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:54.165 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:54.168 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2022-12-08 12:10:54.185 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202212 2022-12-08 12:10:54.189 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:54.190 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:54.193 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:10:54.469 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:10:54.641 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:10:54.973 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:54.974 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:54.977 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2022-12-08 12:10:54.992 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:54.992 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:54.995 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:10:55.002 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:55.002 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:55.005 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2022-12-08 12:10:55.095 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202209 2022-12-08 12:10:55.099 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:55.099 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:55.102 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:10:55.584 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:55.592 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:55.606 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:55.606 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:10:55.606 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:55.610 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2022-12-08 12:10:55.635 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202210 2022-12-08 12:10:55.640 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:55.641 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:55.645 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:10:55.696 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:10:55.870 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:10:56.536 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:10:56.590 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:56.590 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:56.593 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2022-12-08 12:10:56.611 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202211 2022-12-08 12:10:56.614 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:56.615 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:56.618 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:10:57.233 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:57.234 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:57.280 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:10:57.280 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:10:57.620 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1002, sql=alter table `ob_hist_sysstat` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:10:57.629 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:57.629 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:57.632 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2022-12-08 12:10:57.648 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202212 2022-12-08 12:10:57.653 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:57.653 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:57.657 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:10:58.546 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:58.547 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:58.553 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2022-12-08 12:10:58.573 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:58.573 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:58.576 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:10:58.582 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:58.583 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:58.586 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2022-12-08 12:10:58.593 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:10:58.597 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:10:58.666 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202209 2022-12-08 12:10:58.670 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:58.670 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:58.677 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:10:59.357 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:59.358 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:59.361 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2022-12-08 12:10:59.376 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202210 2022-12-08 12:10:59.380 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:59.380 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:59.383 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:10:59.817 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:59.818 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:59.822 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2022-12-08 12:10:59.838 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202211 2022-12-08 12:10:59.841 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:10:59.842 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:10:59.847 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:10:59.882 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:10:59.888 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:10:59.990 INFO 42 --- [pool-ocp-schedules-13,,27a49f471747] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:11:00.189 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:02.0, nextRun=2022-12-08 12:11:00.0, currentDate=Thu Dec 08 12:11:00 CST 2022 2022-12-08 12:11:00.190 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:10:02.0, nextRunTime=2022-12-08 12:11:00.0} 2022-12-08 12:11:00.213 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:11:00.213 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:11:00.213 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:11:00.294 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:02.0, nextRun=2022-12-08 12:11:00.0, currentDate=Thu Dec 08 12:11:00 CST 2022 2022-12-08 12:11:00.294 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:10:02.0, nextRunTime=2022-12-08 12:11:00.0} 2022-12-08 12:11:00.316 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:00.316 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:00.320 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2022-12-08 12:11:00.323 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:11:00.324 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:11:00.324 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:11:00.328 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:00.336 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202212 2022-12-08 12:11:00.340 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:00.341 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:00.344 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:00.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:11:00.377 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:00.402 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:02.0, nextRun=2022-12-08 12:11:00.0, currentDate=Thu Dec 08 12:11:00 CST 2022 2022-12-08 12:11:00.403 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:10:02.0, nextRunTime=2022-12-08 12:11:00.0} 2022-12-08 12:11:00.422 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:11:00.422470+08:00, lastProcessTime=2022-12-08T12:10:50.403291+08:00 2022-12-08 12:11:00.445 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:11:00.445 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:11:00.445 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:11:00.478 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:11:00.494 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:31.0, nextRun=2022-12-08 12:11:00.0, currentDate=Thu Dec 08 12:11:00 CST 2022 2022-12-08 12:11:00.495 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:10:31.0, nextRunTime=2022-12-08 12:11:00.0} 2022-12-08 12:11:00.517 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:11:00.518 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:11:00.518 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:11:00.541 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:11:00.422470+08:00, resultsCount=0 2022-12-08 12:11:00.542 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:11:00.422470+08:00, resultsCount=0 2022-12-08 12:11:00.542 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:11:00.422470+08:00 2022-12-08 12:11:00.651 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:02.0, nextRun=2022-12-08 12:11:00.0, currentDate=Thu Dec 08 12:11:00 CST 2022 2022-12-08 12:11:00.651 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:10:02.0, nextRunTime=2022-12-08 12:11:00.0} 2022-12-08 12:11:00.678 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:11:00.678 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:11:00.678 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:11:00.840 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:00.841 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:00.845 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2022-12-08 12:11:00.865 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:00.866 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:00.878 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:00.885 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:00.885 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:00.889 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2022-12-08 12:11:00.955 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 80, operation:EXECUTE, state: RUNNING 2022-12-08 12:11:00.993 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202209 2022-12-08 12:11:00.996 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:00.996 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:01.000 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:01.019 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=80, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T12:11:00.939+08:00, endTime=null} 2022-12-08 12:11:01.091 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 81, operation:EXECUTE, state: RUNNING 2022-12-08 12:11:01.136 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=81, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:11:01.075+08:00, endTime=null} 2022-12-08 12:11:01.217 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 82, operation:EXECUTE, state: RUNNING 2022-12-08 12:11:01.257 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=82, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:11:01.200+08:00, endTime=null} 2022-12-08 12:11:01.330 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,1ed7793cc677] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=81, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=81, task_operation=execute, latest_execution_start_time=2022-12-08T12:11:01.074+08:00, sub_task_instance_id=81}, listMap={}}, executor=192.168.28.62 2022-12-08 12:11:01.331 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,1ed7793cc677] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:11:01.338 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 78, operation:EXECUTE, state: RUNNING 2022-12-08 12:11:01.346 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,1ed7793cc677] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:11:01.393 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=78, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:11:01.324+08:00, endTime=null} 2022-12-08 12:11:01.499 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,1ed7793cc677] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 81, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:11:01.508 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:01.509 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 79, operation:EXECUTE, state: RUNNING 2022-12-08 12:11:01.575 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:01.579 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2022-12-08 12:11:01.595 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202210 2022-12-08 12:11:01.598 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:01.599 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:01.599 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:01.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:11:01.606 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:01.656 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=79, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T12:11:01.471+08:00, endTime=null} 2022-12-08 12:11:01.897 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,31ec1c6b2acb] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=79, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=79, task_operation=execute, latest_execution_start_time=2022-12-08T12:11:01.469+08:00, sub_task_instance_id=79}, listMap={}}, executor=192.168.28.62 2022-12-08 12:11:01.973 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,31ec1c6b2acb] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 79, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:11:02.161 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:02.161 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:02.165 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2022-12-08 12:11:02.177 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202211 2022-12-08 12:11:02.181 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:02.182 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:02.185 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:11:02.583 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:78, status:SUCCESS 2022-12-08 12:11:02.590 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:78, status:SUCCESS 2022-12-08 12:11:02.638 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:02.638 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:02.642 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2022-12-08 12:11:02.658 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202212 2022-12-08 12:11:02.664 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:02.664 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:02.668 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:02.705 INFO 42 --- [pool-prometheus-minute-schedule-1,,a2f4cbde98b5] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472720, interval=60 2022-12-08 12:11:02.706 INFO 42 --- [pool-prometheus-minute-schedule-1,,a2f4cbde98b5] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472662, count=0, elapsed=1668802190044 2022-12-08 12:11:02.713 INFO 42 --- [pool-prometheus-minute-schedule-2,,c7620cf53074] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472720, interval=60 2022-12-08 12:11:02.714 INFO 42 --- [pool-prometheus-minute-schedule-2,,c7620cf53074] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472662, count=0, elapsed=1668802190052 2022-12-08 12:11:02.735 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:79, status:SUCCESS 2022-12-08 12:11:02.743 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:79, status:SUCCESS 2022-12-08 12:11:02.852 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:80, status:SUCCESS 2022-12-08 12:11:02.861 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:80, status:SUCCESS 2022-12-08 12:11:02.992 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:81, status:SUCCESS 2022-12-08 12:11:03.001 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:81, status:SUCCESS 2022-12-08 12:11:03.180 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:03.181 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:03.185 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2022-12-08 12:11:03.203 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:03.203 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:03.204 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:82, status:SUCCESS 2022-12-08 12:11:03.206 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:03.211 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:03.212 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:03.212 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:82, status:SUCCESS 2022-12-08 12:11:03.215 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2022-12-08 12:11:03.306 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202209 2022-12-08 12:11:03.310 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:03.310 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:03.313 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:03.405 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:03.405 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:03.454 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:03.454 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:03.897 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:04.294 INFO 42 --- [pool-ocp-schedules-19,,231f74ddeac8] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:11:04.295 INFO 42 --- [pool-ocp-schedules-19,,231f74ddeac8] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:11:04.607 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:04.620 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:04.710 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1397, sql=alter table `ob_hist_cache` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:04.714 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:04.714 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:04.717 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2022-12-08 12:11:04.719 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:11:04.731 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202210 2022-12-08 12:11:04.734 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:04.734 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:04.737 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:11:05.402 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:05.0, nextRun=2022-12-08 12:11:05.0, currentDate=Thu Dec 08 12:11:05 CST 2022 2022-12-08 12:11:05.403 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:10:05.0, nextRunTime=2022-12-08 12:11:05.0} 2022-12-08 12:11:05.422 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:11:05.423 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:11:05.423 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:11:05.488 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:05.489 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:05.493 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2022-12-08 12:11:05.508 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202211 2022-12-08 12:11:05.513 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:05.514 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:05.517 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:11:05.681 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:05.769 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 83, operation:EXECUTE, state: RUNNING 2022-12-08 12:11:05.856 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=83, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:11:05.753+08:00, endTime=null} 2022-12-08 12:11:05.918 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:11:05.920 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:11:05.928 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:11:06.028 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T12:07:05.846, end=2022-12-08T12:09:05.846} 2022-12-08 12:11:06.046 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 12:11:06.068 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,4031c86d8034] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=83, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=83, task_operation=execute, latest_execution_start_time=2022-12-08T12:11:05.751+08:00, sub_task_instance_id=83}, listMap={}}, executor=192.168.28.62 2022-12-08 12:11:06.136 INFO 42 --- [pool-subtask-executor32,71424bfefee043c0,4031c86d8034] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 83, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:11:06.308 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:06.309 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:06.312 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2022-12-08 12:11:06.335 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202212 2022-12-08 12:11:06.339 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:06.339 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:06.342 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:06.453 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:83, status:SUCCESS 2022-12-08 12:11:06.460 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:83, status:SUCCESS 2022-12-08 12:11:06.888 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:06.888 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:06.889 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:11:06.891 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2022-12-08 12:11:06.904 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:06.905 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:06.907 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:06.913 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:06.913 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:06.916 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2022-12-08 12:11:07.016 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202209 2022-12-08 12:11:07.029 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:07.029 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:07.032 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:07.262 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:07.263 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:07.421 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:11:07.509 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:11:07.580 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:11:07.597 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:11:07.620 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:07.621 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:07.621 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:07.624 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2022-12-08 12:11:07.624 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:07.644 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202210 2022-12-08 12:11:07.647 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:07.647 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:07.651 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:11:08.115 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:08.116 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:08.119 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2022-12-08 12:11:08.132 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202211 2022-12-08 12:11:08.144 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:08.144 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:08.148 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:11:08.697 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:08.697 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:08.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2022-12-08 12:11:08.719 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202212 2022-12-08 12:11:08.723 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:08.724 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:08.726 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:09.607 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:09.607 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:09.610 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2022-12-08 12:11:09.626 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:09.626 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:09.631 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:09.636 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:09.637 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:09.639 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2022-12-08 12:11:09.725 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202209 2022-12-08 12:11:09.736 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:09.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:09.740 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:09.991 INFO 42 --- [pool-ocp-schedules-11,,6e73ed708b5c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:11:10.246 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:10.246 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:10.249 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2022-12-08 12:11:10.266 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202210 2022-12-08 12:11:10.270 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:10.270 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:10.274 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:11:10.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:11:10.365 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:10.366 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:10.366 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:10.367 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:10.443 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:11:10.443672+08:00, lastProcessTime=2022-12-08T12:11:00.422470+08:00 2022-12-08 12:11:10.566 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:11:10.443672+08:00, resultsCount=0 2022-12-08 12:11:10.566 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:11:10.443672+08:00, resultsCount=0 2022-12-08 12:11:10.567 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:11:10.443672+08:00 2022-12-08 12:11:10.625 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:10.633 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:10.742 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:11:10.807 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:10.808 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:10.811 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2022-12-08 12:11:10.827 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202211 2022-12-08 12:11:10.831 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:10.831 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:10.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:11:11.390 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:11.391 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:11.394 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2022-12-08 12:11:11.408 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202212 2022-12-08 12:11:11.412 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:11.412 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:11.416 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:11.940 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:11.941 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:11.945 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2022-12-08 12:11:11.964 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:11.965 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:11.968 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:11.979 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:11.980 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:11.982 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2022-12-08 12:11:12.067 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202209 2022-12-08 12:11:12.071 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:12.071 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:12.074 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:12.612 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:12.612 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:12.616 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2022-12-08 12:11:12.631 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202210 2022-12-08 12:11:12.635 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:12.635 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:12.638 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:11:12.773 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:11:12.780 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:11:13.139 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:13.139 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:13.142 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2022-12-08 12:11:13.152 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202211 2022-12-08 12:11:13.155 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:13.156 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:13.159 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:11:13.446 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:13.445 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:13.548 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:13.548 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:13.551 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2022-12-08 12:11:13.565 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202212 2022-12-08 12:11:13.569 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:13.569 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:13.572 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:13.634 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:13.640 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,ac30aef199d7] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:11:13.720 INFO 42 --- [pool-prometheus-cache-monitor1,,ac30aef199d7] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:11:13.910 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:11:14.237 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:14.238 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:14.241 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2022-12-08 12:11:14.259 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:14.260 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:14.263 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:14.268 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:14.268 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:14.271 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2022-12-08 12:11:14.295 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:14.349 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202209 2022-12-08 12:11:14.354 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:14.354 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:14.356 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:15.044 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:11:15.451 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1095, sql=alter table `ob_hist_clog` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:15.456 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:15.456 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:15.459 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2022-12-08 12:11:15.473 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202210 2022-12-08 12:11:15.478 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:15.478 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:15.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:11:15.850 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:16.082 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:11:16.187 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:16.188 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:16.191 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2022-12-08 12:11:16.207 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202211 2022-12-08 12:11:16.211 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:16.211 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:16.215 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:11:16.550 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:16.551 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:16.562 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:16.562 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:16.641 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:16.646 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:16.679 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:16.679 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:16.684 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2022-12-08 12:11:16.700 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202212 2022-12-08 12:11:16.703 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:16.704 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:16.707 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:17.199 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:11:17.721 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1014, sql=alter table `ob_hist_clog` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:17.725 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:17.726 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:17.729 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2022-12-08 12:11:17.748 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:17.749 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:17.752 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:17.758 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:17.758 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:17.764 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2022-12-08 12:11:17.843 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202209 2022-12-08 12:11:17.848 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:17.848 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:17.852 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:18.480 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:18.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:18.484 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2022-12-08 12:11:18.502 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202210 2022-12-08 12:11:18.506 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:18.506 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:18.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:11:18.988 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:18.988 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:18.991 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2022-12-08 12:11:19.008 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202211 2022-12-08 12:11:19.017 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:19.017 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:19.021 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:11:19.113 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:11:19.118 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:11:19.481 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:19.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:19.485 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2022-12-08 12:11:19.500 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202212 2022-12-08 12:11:19.504 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:19.504 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:19.507 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:19.646 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:19.650 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:19.937 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:19.938 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:19.992 INFO 42 --- [pool-ocp-schedules-2,,6bfeac5a702d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:11:20.149 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:20.150 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:20.154 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2022-12-08 12:11:20.174 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:20.174 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:20.179 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:20.184 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:20.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:20.188 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2022-12-08 12:11:20.224 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:11:20.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:11:20.367 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202209 2022-12-08 12:11:20.370 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:20.370 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:20.374 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:20.448 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:11:20.448592+08:00, lastProcessTime=2022-12-08T12:11:10.443672+08:00 2022-12-08 12:11:20.575 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:11:20.448592+08:00, resultsCount=0 2022-12-08 12:11:20.576 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:11:20.448592+08:00, resultsCount=0 2022-12-08 12:11:20.576 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:11:20.448592+08:00 2022-12-08 12:11:21.162 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:21.163 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:21.166 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2022-12-08 12:11:21.179 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202210 2022-12-08 12:11:21.182 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:21.183 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:21.186 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:11:21.189 INFO 42 --- [pool-task-coordinator2,,] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:20.0, nextRun=2022-12-08 12:11:20.0, currentDate=Thu Dec 08 12:11:21 CST 2022 2022-12-08 12:11:21.190 INFO 42 --- [pool-task-coordinator2,,] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:10:20.0, nextRunTime=2022-12-08 12:11:20.0} 2022-12-08 12:11:21.206 INFO 42 --- [pool-task-coordinator2,,] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:11:21.207 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:11:21.207 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:11:21.598 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:21.599 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:21.602 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2022-12-08 12:11:21.616 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202211 2022-12-08 12:11:21.621 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:21.621 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:21.625 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:11:21.994 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:21.995 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:21.998 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2022-12-08 12:11:22.014 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202212 2022-12-08 12:11:22.018 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:22.018 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:22.023 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:22.141 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 84, operation:EXECUTE, state: RUNNING 2022-12-08 12:11:22.182 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=84, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:11:22.127+08:00, endTime=null} 2022-12-08 12:11:22.398 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,897f34ae9930] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=84, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=84, task_operation=execute, latest_execution_start_time=2022-12-08T12:11:22.125+08:00, sub_task_instance_id=84}, listMap={}}, executor=192.168.28.62 2022-12-08 12:11:22.521 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:22.521 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:22.524 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2022-12-08 12:11:22.543 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:22.543 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:22.546 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:22.553 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:22.553 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:22.556 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2022-12-08 12:11:22.559 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,897f34ae9930] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 84, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:11:22.647 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202209 2022-12-08 12:11:22.651 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:22.651 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:22.651 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:22.655 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 12:11:22.655 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:23.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:23.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:23.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:23.005 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:23.047 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:23.048 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:23.051 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2022-12-08 12:11:23.067 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202210 2022-12-08 12:11:23.071 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:23.071 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:23.074 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 12:11:23.405 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:84, status:SUCCESS 2022-12-08 12:11:23.415 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:84, status:SUCCESS 2022-12-08 12:11:23.513 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:23.514 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:23.516 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2022-12-08 12:11:23.528 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202211 2022-12-08 12:11:23.531 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:23.532 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:23.536 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:11:24.330 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:24.543 INFO 42 --- [pool-ocp-schedules-4,,65ee308ddbe3] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:11:24.543 INFO 42 --- [pool-ocp-schedules-4,,65ee308ddbe3] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:11:24.743 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1207, sql=alter table `ob_hist_system_event` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 12:11:24.746 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:24.747 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:24.750 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2022-12-08 12:11:24.760 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202212 2022-12-08 12:11:24.763 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:24.764 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:24.767 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 12:11:25.102 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:25.103 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:25.106 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2022-12-08 12:11:25.123 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:25.123 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:25.126 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:25.130 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:25.131 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:25.133 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2022-12-08 12:11:25.148 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:11:25.334 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221123 2022-12-08 12:11:25.338 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:25.338 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:25.341 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 12:11:25.554 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:11:25.560 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:11:25.655 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:25.659 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:25.683 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:26.0, nextRun=2022-12-08 12:11:25.0, currentDate=Thu Dec 08 12:11:25 CST 2022 2022-12-08 12:11:25.684 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:10:26.0, nextRunTime=2022-12-08 12:11:25.0} 2022-12-08 12:11:25.727 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:11:25.727 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:11:25.728 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:11:25.849 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:25.850 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:25.853 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:25.864 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:11:25.864 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221124 2022-12-08 12:11:25.870 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:25.870 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:25.873 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 12:11:26.091 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:26.097 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:26.143 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:26.214 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:11:26.255 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:11:26.308 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 85, operation:EXECUTE, state: RUNNING 2022-12-08 12:11:26.363 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=85, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:11:26.296+08:00, endTime=null} 2022-12-08 12:11:26.557 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,127358169d28] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=85, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=85, task_operation=execute, latest_execution_start_time=2022-12-08T12:11:26.294+08:00, sub_task_instance_id=85}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 12:11:26.751 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:26.752 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:26.755 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:26.766 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221125 2022-12-08 12:11:26.769 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:26.769 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:26.772 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 12:11:27.333 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,127358169d28] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 85, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:11:27.357 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:11:27.683 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:85, status:SUCCESS 2022-12-08 12:11:27.691 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:85, status:SUCCESS 2022-12-08 12:11:28.043 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1271, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 12:11:28.046 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:28.046 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:28.049 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:28.062 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221126 2022-12-08 12:11:28.066 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:28.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:28.069 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 12:11:28.660 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:28.665 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:28.687 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:28.687 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:28.690 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:28.701 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221127 2022-12-08 12:11:28.706 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:28.706 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:28.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 12:11:29.212 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:29.212 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:29.214 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:29.214 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:29.584 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:29.585 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:29.588 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:29.608 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221128 2022-12-08 12:11:29.613 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:29.613 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:29.616 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 12:11:29.993 INFO 42 --- [pool-ocp-schedules-15,,5446d549b447] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:11:30.196 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:30.196 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:30.200 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:30.213 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221129 2022-12-08 12:11:30.217 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:30.217 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:30.220 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 12:11:30.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:11:30.381 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:31.0, nextRun=2022-12-08 12:11:30.0, currentDate=Thu Dec 08 12:11:30 CST 2022 2022-12-08 12:11:30.382 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:10:31.0, nextRunTime=2022-12-08 12:11:30.0} 2022-12-08 12:11:30.413 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:11:30.414 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:11:30.414172+08:00, lastProcessTime=2022-12-08T12:11:20.448592+08:00 2022-12-08 12:11:30.515 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:11:00.0, nextRun=2022-12-08 12:11:30.0, currentDate=Thu Dec 08 12:11:30 CST 2022 2022-12-08 12:11:30.516 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:11:00.0, nextRunTime=2022-12-08 12:11:30.0} 2022-12-08 12:11:30.541 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:11:30.542 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:11:30.542 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:11:30.558 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:11:30.414172+08:00, resultsCount=0 2022-12-08 12:11:30.559 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:11:30.414172+08:00, resultsCount=0 2022-12-08 12:11:30.559 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:11:30.414172+08:00 2022-12-08 12:11:31.309 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1089, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 12:11:31.313 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:31.313 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:31.316 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:31.333 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221130 2022-12-08 12:11:31.337 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:31.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:31.340 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:11:31.514 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 86, operation:EXECUTE, state: RUNNING 2022-12-08 12:11:31.618 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=86, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:11:31.498+08:00, endTime=null} 2022-12-08 12:11:31.665 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:31.677 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:31.723 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:11:31.730 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:11:31.904 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,fc09d0f5ee5e] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=86, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=86, task_operation=execute, latest_execution_start_time=2022-12-08T12:11:31.496+08:00, sub_task_instance_id=86}, listMap={}}, executor=192.168.28.62 2022-12-08 12:11:31.907 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,fc09d0f5ee5e] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:11:31.924 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,fc09d0f5ee5e] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:11:32.014 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,fc09d0f5ee5e] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 86, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:11:32.467 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:32.480 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:32.519 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1179, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 12:11:32.524 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:32.524 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:32.530 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:32.549 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221201 2022-12-08 12:11:32.553 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:32.553 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:32.556 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:11:32.832 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:86, status:SUCCESS 2022-12-08 12:11:32.840 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:86, status:SUCCESS 2022-12-08 12:11:32.961 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:11:33.447 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:33.448 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:33.450 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:33.462 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221202 2022-12-08 12:11:33.465 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:33.465 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:33.468 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:11:33.985 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:33.985 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:33.988 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:33.999 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221203 2022-12-08 12:11:34.001 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:34.002 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:34.004 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:11:34.543 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:34.549 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:34.549 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:34.552 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:34.562 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221204 2022-12-08 12:11:34.567 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:34.567 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:34.570 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:11:34.678 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:34.682 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:35.335 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:11:35.616 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:35.616 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:35.619 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:35.620 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:35.733 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1163, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:11:35.736 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:35.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:35.739 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:35.748 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221205 2022-12-08 12:11:35.751 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:35.751 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:35.754 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:11:36.256 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:36.326 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:11:36.596 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:36.596 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:36.599 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:36.615 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221206 2022-12-08 12:11:36.618 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:36.619 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:36.621 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:11:37.506 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:11:37.577 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:11:37.682 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:37.687 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:38.012 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:11:38.124 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:09:37+08:00, updateTime=2022-12-08T12:11:07+08:00, expireTime=null, isLeader=false} 2022-12-08 12:11:38.229 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:09:37+08:00, updateTime=2022-12-08T12:11:07+08:00, expireTime=null, isLeader=false} 2022-12-08 12:11:38.238 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 12:11:38.283 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:11:38.289 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:11:38.301 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1680, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:11:38.305 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:38.305 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:38.309 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:38.321 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221207 2022-12-08 12:11:38.325 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:38.325 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:38.325 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:11:38.328 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:11:38.346 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:11:38.936 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:38.936 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:39.421 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:11:39.564 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1236, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:11:39.569 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:39.569 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:39.574 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:39.603 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221208 2022-12-08 12:11:39.607 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:39.607 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:39.618 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:11:39.848 INFO 42 --- [pool-ocp-schedules-5,,b755edae6f57] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:11:39.882 INFO 42 --- [pool-ocp-schedules-5,,b755edae6f57] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:11:39.963 INFO 42 --- [pool-ocp-schedules-8,,4d284724221c] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:11:39.994 INFO 42 --- [pool-ocp-schedules-13,,561fe448950a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:11:40.138 INFO 42 --- [pool-ocp-schedules-11,,26af1b624332] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:11:40.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:11:40.420 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:11:40.419296+08:00, lastProcessTime=2022-12-08T12:11:30.414172+08:00 2022-12-08 12:11:40.545 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:11:40.419296+08:00, resultsCount=0 2022-12-08 12:11:40.546 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:11:40.419296+08:00, resultsCount=0 2022-12-08 12:11:40.546 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:11:40.419296+08:00 2022-12-08 12:11:40.688 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:40.692 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:40.946 INFO 42 --- [pool-ocp-schedules-20,,2c99ce1c5425] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:11:40.949 INFO 42 --- [pool-ocp-schedules-8,,75b16b868269] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:11:40.951 INFO 42 --- [pool-ocp-schedules-9,,e754355ed559] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:11:41.040 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1422, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:11:41.044 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:41.044 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:41.047 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:41.062 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221209 2022-12-08 12:11:41.066 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:41.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:41.069 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:11:41.143 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:11:41.665 INFO 42 --- [pool-ocp-schedules-7,,76b12e8d06fa] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:11:41.665 INFO 42 --- [pool-ocp-schedules-7,,76b12e8d06fa] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:11:41.666 INFO 42 --- [pool-ocp-schedules-7,,76b12e8d06fa] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:11:41.703 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:41.703 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:41.706 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:41.718 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221210 2022-12-08 12:11:41.721 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:41.721 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:41.724 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:11:42.214 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:42.214 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:42.214 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:42.214 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:43.252 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1528, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:11:43.256 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:43.257 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:43.260 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:43.275 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221211 2022-12-08 12:11:43.278 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:43.278 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:43.282 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:11:43.693 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:43.705 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:43.964 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:43.965 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:43.972 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:43.984 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221212 2022-12-08 12:11:43.987 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:43.988 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:43.999 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:11:44.619 INFO 42 --- [pool-ocp-schedules-5,,c8367a5a5229] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:11:44.620 INFO 42 --- [pool-ocp-schedules-5,,c8367a5a5229] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:11:44.636 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:11:44.641 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:11:44.874 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:44.875 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:44.888 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:44.903 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221213 2022-12-08 12:11:44.907 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:44.907 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:44.911 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:11:44.917 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:45.327 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:45.328 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:45.402 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:11:45.827 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:11:46.291 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:46.706 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:46.712 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:46.783 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:11:46.945 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2034, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:11:46.948 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:46.948 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:46.951 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:46.964 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221214 2022-12-08 12:11:46.967 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:46.968 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:46.972 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:11:48.017 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:11:48.388 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1416, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:11:48.392 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:48.392 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:48.395 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:48.407 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221215 2022-12-08 12:11:48.411 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:48.411 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:48.414 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:11:48.823 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:48.823 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:48.824 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:48.824 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:49.012 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:49.013 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:49.016 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 12:11:49.040 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:49.040 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:49.044 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:11:49.052 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:49.052 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:49.055 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_0 2022-12-08 12:11:49.183 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221201 2022-12-08 12:11:49.201 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:49.201 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:49.205 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 12:11:49.713 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:49.719 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:49.995 INFO 42 --- [pool-ocp-schedules-6,,ca38136b2686] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:11:50.081 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:50.082 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:50.086 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:11:50.101 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221202 2022-12-08 12:11:50.105 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:50.105 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:50.108 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 12:11:50.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:11:50.404 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:11:50.404691+08:00, lastProcessTime=2022-12-08T12:11:40.419296+08:00 2022-12-08 12:11:50.514 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:11:50.404691+08:00, resultsCount=0 2022-12-08 12:11:50.514 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:11:50.404691+08:00, resultsCount=0 2022-12-08 12:11:50.515 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:11:50.404691+08:00 2022-12-08 12:11:50.956 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:50.956 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:50.960 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:11:50.973 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221203 2022-12-08 12:11:50.977 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:50.977 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:50.980 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 12:11:51.233 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:11:51.238 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:11:51.971 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:51.972 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:51.975 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:11:51.988 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221204 2022-12-08 12:11:51.991 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:51.992 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:51.997 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 12:11:52.170 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:52.171 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:52.386 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:11:52.719 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:52.725 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:52.909 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:52.910 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:52.914 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:11:52.933 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221205 2022-12-08 12:11:52.938 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:52.939 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:52.942 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:11:54.673 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1731, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 12:11:54.677 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:54.677 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:54.681 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:11:54.695 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221206 2022-12-08 12:11:54.701 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:54.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:54.707 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:11:55.011 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:55.244 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:55.244 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:55.281 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:11:55.281 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:11:55.725 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:55.730 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:56.010 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:11:56.182 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:11:56.724 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2017, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 12:11:56.728 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:56.728 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:56.731 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:11:56.746 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221207 2022-12-08 12:11:56.749 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:56.750 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:56.753 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:11:56.783 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:11:57.184 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:11:57.675 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:11:57.684 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:11:57.798 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1045, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 12:11:57.802 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:57.803 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:57.807 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:11:57.825 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221208 2022-12-08 12:11:57.834 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:57.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:57.839 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:11:58.156 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:11:58.331 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:58.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:11:58.731 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:11:58.735 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:11:58.915 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:11:58.948 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1109, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 12:11:58.951 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:58.952 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:58.954 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:11:58.966 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221209 2022-12-08 12:11:58.969 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:58.969 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:58.983 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 12:11:59.831 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:59.832 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:59.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:11:59.846 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221210 2022-12-08 12:11:59.850 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:11:59.850 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:11:59.853 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:11:59.997 INFO 42 --- [pool-ocp-schedules-17,,c16bf80cdab1] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:12:00.000 INFO 42 --- [pool-ocp-schedules-9,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 12:12:00.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:12:00.421 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:12:00.420256+08:00, lastProcessTime=2022-12-08T12:11:50.404691+08:00 2022-12-08 12:12:00.584 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:12:00.420256+08:00, resultsCount=0 2022-12-08 12:12:00.584 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:12:00.420256+08:00, resultsCount=0 2022-12-08 12:12:00.585 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:12:00.420256+08:00 2022-12-08 12:12:00.649 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:01.0, nextRun=2022-12-08 12:12:00.0, currentDate=Thu Dec 08 12:12:00 CST 2022 2022-12-08 12:12:00.650 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 12:10:01.0, nextRunTime=2022-12-08 12:12:00.0} 2022-12-08 12:12:00.674 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 12:12:00.785 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:11:00.0, nextRun=2022-12-08 12:12:00.0, currentDate=Thu Dec 08 12:12:00 CST 2022 2022-12-08 12:12:00.786 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:11:00.0, nextRunTime=2022-12-08 12:12:00.0} 2022-12-08 12:12:00.801 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:12:00.801 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:12:00.802 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:00.852 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:11:00.0, nextRun=2022-12-08 12:12:00.0, currentDate=Thu Dec 08 12:12:00 CST 2022 2022-12-08 12:12:00.852 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:11:00.0, nextRunTime=2022-12-08 12:12:00.0} 2022-12-08 12:12:00.875 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:12:00.876 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:12:00.876 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:00.934 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:11:00.0, nextRun=2022-12-08 12:12:00.0, currentDate=Thu Dec 08 12:12:00 CST 2022 2022-12-08 12:12:00.935 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:11:00.0, nextRunTime=2022-12-08 12:12:00.0} 2022-12-08 12:12:00.960 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:12:00.961 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:12:00.961 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:00.969 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1116, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 12:12:00.972 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:00.972 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:00.975 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:12:00.990 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221211 2022-12-08 12:12:00.994 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:00.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:01.006 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:12:01.011 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:11:31.0, nextRun=2022-12-08 12:12:00.0, currentDate=Thu Dec 08 12:12:01 CST 2022 2022-12-08 12:12:01.012 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:11:31.0, nextRunTime=2022-12-08 12:12:00.0} 2022-12-08 12:12:01.032 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:12:01.032 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:12:01.032 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:01.046 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 87, operation:EXECUTE, state: RUNNING 2022-12-08 12:12:01.101 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=87, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:12:01.036+08:00, endTime=null} 2022-12-08 12:12:01.108 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:11:01.0, nextRun=2022-12-08 12:12:00.0, currentDate=Thu Dec 08 12:12:01 CST 2022 2022-12-08 12:12:01.108 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:11:01.0, nextRunTime=2022-12-08 12:12:00.0} 2022-12-08 12:12:01.124 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:12:01.124 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:12:01.125 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:01.166 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 88, operation:EXECUTE, state: RUNNING 2022-12-08 12:12:01.255 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=88, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T12:12:01.155+08:00, endTime=null} 2022-12-08 12:12:01.280 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,a576a2faf32c] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=87, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=87, task_operation=execute, latest_execution_start_time=2022-12-08T12:12:01.035+08:00, sub_task_instance_id=87}, listMap={}}, executor=192.168.28.62 2022-12-08 12:12:01.365 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,a576a2faf32c] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 87, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:12:01.404 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:01.404 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:01.714 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:01.715 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:01.736 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:01.741 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:02.020 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1014, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 12:12:02.024 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:02.025 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:02.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:12:02.043 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221212 2022-12-08 12:12:02.048 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:02.049 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:02.052 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:12:02.299 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:87, status:SUCCESS 2022-12-08 12:12:02.318 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:87, status:SUCCESS 2022-12-08 12:12:02.349 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 89, operation:EXECUTE, state: RUNNING 2022-12-08 12:12:02.685 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=89, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T12:12:02.334+08:00, endTime=null} 2022-12-08 12:12:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,23bcee7aaaa5] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472780, interval=60 2022-12-08 12:12:02.706 INFO 42 --- [pool-prometheus-minute-schedule-2,,23bcee7aaaa5] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472722, count=0, elapsed=1668802249984 2022-12-08 12:12:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,5e4ec507fb6e] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472780, interval=60 2022-12-08 12:12:02.715 INFO 42 --- [pool-prometheus-minute-schedule-1,,5e4ec507fb6e] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472722, count=0, elapsed=1668802249993 2022-12-08 12:12:02.726 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:88, status:SUCCESS 2022-12-08 12:12:02.734 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:88, status:SUCCESS 2022-12-08 12:12:02.790 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 90, operation:EXECUTE, state: RUNNING 2022-12-08 12:12:02.894 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=90, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:12:02.767+08:00, endTime=null} 2022-12-08 12:12:03.001 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 91, operation:EXECUTE, state: RUNNING 2022-12-08 12:12:03.172 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=91, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:12:02.984+08:00, endTime=null} 2022-12-08 12:12:03.218 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,5509772f3efa] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=90, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=90, task_operation=execute, latest_execution_start_time=2022-12-08T12:12:02.765+08:00, sub_task_instance_id=90}, listMap={}}, executor=192.168.28.62 2022-12-08 12:12:03.219 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,5509772f3efa] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:12:03.236 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,5509772f3efa] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:12:03.288 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,5509772f3efa] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 90, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:12:03.560 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1508, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 12:12:03.780 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:03.781 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:03.784 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:12:03.796 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221213 2022-12-08 12:12:03.798 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:03.798 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:03.801 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:12:04.237 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 12:12:04.0, currentDate=Thu Dec 08 12:12:04 CST 2022 2022-12-08 12:12:04.237 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1, name=Partitioning daemon, templateName=PartitioningDaemonSchedule, scheduleRule=4 12 */1 * * *, lastRunTime=null, nextRunTime=2022-12-08 12:12:04.0} 2022-12-08 12:12:04.256 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:12:04.263 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:12:04.265 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Partition rollover daemon, nodeCount=1, taskCount=1 2022-12-08 12:12:04.266 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:12:04.266 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Partition rollover daemon, taskDefinitionId=1, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:04.346 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:89, status:SUCCESS 2022-12-08 12:12:04.357 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:89, status:SUCCESS 2022-12-08 12:12:04.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:04.484 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:90, status:SUCCESS 2022-12-08 12:12:04.490 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:90, status:SUCCESS 2022-12-08 12:12:04.608 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:91, status:SUCCESS 2022-12-08 12:12:04.615 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:91, status:SUCCESS 2022-12-08 12:12:04.696 INFO 42 --- [pool-ocp-schedules-12,,a12f05f1daae] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:12:04.696 INFO 42 --- [pool-ocp-schedules-12,,a12f05f1daae] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:12:04.742 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:04.746 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:04.801 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:04.965 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:12:04.996 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1195, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 12:12:05.009 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:05.009 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:05.012 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:12:05.025 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221214 2022-12-08 12:12:05.028 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:05.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:05.031 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 12:12:05.098 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:05.321 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 92, operation:EXECUTE, state: RUNNING 2022-12-08 12:12:05.387 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=92, name=Partition rollover daemon, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.partitioning.PartitioningDaemonSchedule$Task, seriesId=0, startTime=2022-12-08T12:12:05.284+08:00, endTime=null} 2022-12-08 12:12:05.720 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:11:05.0, nextRun=2022-12-08 12:12:05.0, currentDate=Thu Dec 08 12:12:05 CST 2022 2022-12-08 12:12:05.721 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:11:05.0, nextRunTime=2022-12-08 12:12:05.0} 2022-12-08 12:12:05.737 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:12:05.737 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:12:05.737 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:05.988 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:05.989 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:05.991 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:12:06.003 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221215 2022-12-08 12:12:06.006 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:06.006 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:06.010 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:12:06.164 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:12:06.461 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 93, operation:EXECUTE, state: RUNNING 2022-12-08 12:12:06.518 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=93, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:12:06.447+08:00, endTime=null} 2022-12-08 12:12:06.834 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:06.990 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,8c6511a97216] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=93, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=93, task_operation=execute, latest_execution_start_time=2022-12-08T12:12:06.445+08:00, sub_task_instance_id=93}, listMap={}}, executor=192.168.28.62 2022-12-08 12:12:07.099 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,8c6511a97216] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 93, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:12:07.176 INFO 42 --- [pool-ocp-schedules-9,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 12:12:07.245 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1235, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 12:12:07.256 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:07.257 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:07.260 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:12:07.271 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221216 2022-12-08 12:12:07.274 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:07.275 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:07.278 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 12:12:07.285 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:12:07.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:07.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:07.606 INFO 42 --- [pool-ocp-schedules-9,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 12:12:07.747 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:07.752 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:07.754 INFO 42 --- [pool-ocp-schedules-9,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 12:12:07.982 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:07.982 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:08.012 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:12:08.048 INFO 42 --- [pool-ocp-schedules-9,,] o.s.boot.SpringApplication : Started application in 7.979 seconds (JVM running for 882.637) 2022-12-08 12:12:08.175 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:10:07+08:00, updateTime=2022-12-08T12:11:37+08:00, expireTime=null, isLeader=false} 2022-12-08 12:12:08.185 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:12:08.236 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:12:08.237 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:12:08.242 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 12:12:08.244 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:12:08.258 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2022-12-08 12:12:08.319 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.o.c.t.e.c.worker.RunningTaskWorker : Mark failed task, entity=TaskInstanceEntity{id=92, name=Partition rollover daemon, taskDefinitionId=1, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:08.326 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:12:08.396 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:12:08.436 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:92, status:FAILED 2022-12-08 12:12:08.444 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:92, status:FAILED 2022-12-08 12:12:08.595 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:93, status:SUCCESS 2022-12-08 12:12:08.601 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:93, status:SUCCESS 2022-12-08 12:12:09.797 INFO 42 --- [pool-ocp-schedules-9,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T12:12:09.797+08:00 2022-12-08 12:12:09.998 INFO 42 --- [pool-ocp-schedules-11,,3e4b5e6be3be] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:12:10.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:12:10.410 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:12:10.409113+08:00, lastProcessTime=2022-12-08T12:12:00.420256+08:00 2022-12-08 12:12:10.484 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:12:10.490 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:12:10.554 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:12:10.409113+08:00, resultsCount=0 2022-12-08 12:12:10.555 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:12:10.409113+08:00, resultsCount=0 2022-12-08 12:12:10.555 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:12:10.409113+08:00 2022-12-08 12:12:10.633 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:10.753 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:10.756 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:11.192 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:11.261 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:12:11.612 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:12:13.707 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:13.708 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,ea35cf478d32] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:12:13.720 INFO 42 --- [pool-prometheus-cache-monitor1,,ea35cf478d32] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:12:13.757 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:13.761 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:14.566 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:14.567 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:15.274 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:16.204 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:12:16.762 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:16.766 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:16.848 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:12:16.859 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:12:16.961 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:17.333 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:12:17.849 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:18.312 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:12:19.767 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:19.773 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:19.999 INFO 42 --- [pool-ocp-schedules-2,,5a704fc30cdc] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:12:20.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:12:20.410 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:12:20.409638+08:00, lastProcessTime=2022-12-08T12:12:10.409113+08:00 2022-12-08 12:12:20.604 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:12:20.409638+08:00, resultsCount=0 2022-12-08 12:12:20.605 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:12:20.409638+08:00, resultsCount=0 2022-12-08 12:12:20.605 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:12:20.409638+08:00 2022-12-08 12:12:21.279 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:11:21.0, nextRun=2022-12-08 12:12:20.0, currentDate=Thu Dec 08 12:12:21 CST 2022 2022-12-08 12:12:21.280 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:11:21.0, nextRunTime=2022-12-08 12:12:20.0} 2022-12-08 12:12:21.340 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:12:21.342 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:12:21.343 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:21.785 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 94, operation:EXECUTE, state: RUNNING 2022-12-08 12:12:22.056 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=94, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:12:21.749+08:00, endTime=null} 2022-12-08 12:12:22.235 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,342401bd9bb2] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=94, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=94, task_operation=execute, latest_execution_start_time=2022-12-08T12:12:21.748+08:00, sub_task_instance_id=94}, listMap={}}, executor=192.168.28.62 2022-12-08 12:12:22.305 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,342401bd9bb2] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 94, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:12:22.774 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:22.779 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:23.174 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:94, status:SUCCESS 2022-12-08 12:12:23.182 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:94, status:SUCCESS 2022-12-08 12:12:25.079 INFO 42 --- [pool-ocp-schedules-11,,c0dbd654b8e0] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:12:25.079 INFO 42 --- [pool-ocp-schedules-11,,c0dbd654b8e0] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:12:25.562 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:25.779 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:25.783 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:26.453 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:12:26.802 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:12:26.839 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:11:26.0, nextRun=2022-12-08 12:12:25.0, currentDate=Thu Dec 08 12:12:26 CST 2022 2022-12-08 12:12:26.840 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:11:26.0, nextRunTime=2022-12-08 12:12:25.0} 2022-12-08 12:12:26.885 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:12:26.885 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:12:26.886 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:27.198 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:27.241 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 95, operation:EXECUTE, state: RUNNING 2022-12-08 12:12:27.363 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=95, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:12:27.231+08:00, endTime=null} 2022-12-08 12:12:27.440 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 12:12:27.451 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=11ms, period=120000ms 2022-12-08 12:12:27.468 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:12:27.523 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,1c4c90e5fffd] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=95, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=95, task_operation=execute, latest_execution_start_time=2022-12-08T12:12:27.230+08:00, sub_task_instance_id=95}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 12:12:27.656 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,1c4c90e5fffd] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 95, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:12:27.837 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 12:12:28.350 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:12:28.784 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:28.788 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:28.878 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:95, status:SUCCESS 2022-12-08 12:12:28.883 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:95, status:SUCCESS 2022-12-08 12:12:30.027 INFO 42 --- [pool-ocp-schedules-8,,ce90c436c5ee] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:12:30.214 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:11:30.0, nextRun=2022-12-08 12:12:30.0, currentDate=Thu Dec 08 12:12:30 CST 2022 2022-12-08 12:12:30.215 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:11:30.0, nextRunTime=2022-12-08 12:12:30.0} 2022-12-08 12:12:30.231 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:12:30.295 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:01.0, nextRun=2022-12-08 12:12:30.0, currentDate=Thu Dec 08 12:12:30 CST 2022 2022-12-08 12:12:30.296 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:12:01.0, nextRunTime=2022-12-08 12:12:30.0} 2022-12-08 12:12:30.311 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:12:30.312 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:12:30.313 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:12:30.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:12:30.397 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:12:30.397887+08:00, lastProcessTime=2022-12-08T12:12:20.409638+08:00 2022-12-08 12:12:30.443 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 96, operation:EXECUTE, state: RUNNING 2022-12-08 12:12:30.480 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=96, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:12:30.432+08:00, endTime=null} 2022-12-08 12:12:30.485 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:12:30.397887+08:00, resultsCount=0 2022-12-08 12:12:30.486 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:12:30.397887+08:00, resultsCount=0 2022-12-08 12:12:30.486 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:12:30.397887+08:00 2022-12-08 12:12:30.608 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,2569f495e317] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=96, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=96, task_operation=execute, latest_execution_start_time=2022-12-08T12:12:30.430+08:00, sub_task_instance_id=96}, listMap={}}, executor=192.168.28.62 2022-12-08 12:12:30.608 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,2569f495e317] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:12:30.619 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,2569f495e317] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:12:30.674 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,2569f495e317] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 96, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:12:31.487 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:96, status:SUCCESS 2022-12-08 12:12:31.492 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:96, status:SUCCESS 2022-12-08 12:12:31.789 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:31.793 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:33.879 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:12:33.885 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:12:34.793 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:34.798 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:35.763 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:36.802 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:12:36.840 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:36.841 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:37.074 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:12:37.350 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:37.505 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:12:37.798 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:37.802 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:38.273 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:12:38.363 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:12:38.465 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:12:38.493 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:12:39.847 INFO 42 --- [pool-ocp-schedules-18,,9916ccef53c6] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:12:39.889 INFO 42 --- [pool-ocp-schedules-18,,9916ccef53c6] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:12:39.894 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:39.895 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:39.937 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:39.938 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:39.947 INFO 42 --- [pool-ocp-schedules-12,,611cb9200926] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:12:39.947 INFO 42 --- [pool-ocp-schedules-12,,611cb9200926] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:12:39.964 INFO 42 --- [pool-ocp-schedules-15,,951a6b2a47d6] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:12:40.030 INFO 42 --- [pool-ocp-schedules-13,,32f2a72826e4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:12:40.144 INFO 42 --- [pool-ocp-schedules-5,,dbbfcc85c8e4] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:12:40.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:12:40.415 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:12:40.414847+08:00, lastProcessTime=2022-12-08T12:12:30.397887+08:00 2022-12-08 12:12:40.525 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:12:40.414847+08:00, resultsCount=0 2022-12-08 12:12:40.526 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:12:40.414847+08:00, resultsCount=0 2022-12-08 12:12:40.526 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:12:40.414847+08:00 2022-12-08 12:12:40.803 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:40.807 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:41.023 INFO 42 --- [pool-ocp-schedules-13,,322c4e575edf] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:12:41.024 INFO 42 --- [pool-ocp-schedules-20,,0058a40760ca] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:12:41.031 INFO 42 --- [pool-ocp-schedules-16,,67da638ee8c8] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:12:41.753 INFO 42 --- [pool-ocp-schedules-6,,59d14025f07b] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:12:41.754 INFO 42 --- [pool-ocp-schedules-6,,59d14025f07b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:12:41.755 INFO 42 --- [pool-ocp-schedules-6,,59d14025f07b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:12:42.198 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:12:42.247 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:12:42.254 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:12:43.252 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:43.253 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:43.351 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:12:43.808 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:43.813 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:45.148 INFO 42 --- [pool-ocp-schedules-4,,2296d58e227e] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:12:45.149 INFO 42 --- [pool-ocp-schedules-4,,2296d58e227e] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:12:45.797 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:46.307 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:46.308 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:46.348 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:46.349 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:46.813 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:46.818 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:46.837 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:12:47.574 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:47.703 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:12:48.502 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:12:48.514 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:12:48.520 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:12:49.449 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:49.450 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:49.819 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:49.824 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:49.843 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:12:50.031 INFO 42 --- [pool-ocp-schedules-12,,99e26d4fbb93] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:12:50.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:12:50.440 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:12:50.441088+08:00, lastProcessTime=2022-12-08T12:12:40.414847+08:00 2022-12-08 12:12:50.571 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:12:50.441088+08:00, resultsCount=0 2022-12-08 12:12:50.572 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:12:50.441088+08:00, resultsCount=0 2022-12-08 12:12:50.572 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:12:50.441088+08:00 2022-12-08 12:12:52.527 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:52.529 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:52.558 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:52.558 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:52.825 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:52.829 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:55.050 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:12:55.057 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:12:55.648 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:55.654 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:12:55.828 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:55.830 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:55.835 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:12:56.152 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:12:57.252 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:12:57.606 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:12:57.703 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:12:57.788 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:12:58.704 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:58.705 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:58.747 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:12:58.752 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:12:58.753 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:12:58.835 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:12:58.840 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:00.032 INFO 42 --- [pool-ocp-schedules-19,,a923eacf0ed9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:13:00.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:13:00.444 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:13:00.442581+08:00, lastProcessTime=2022-12-08T12:12:50.441088+08:00 2022-12-08 12:13:00.591 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:13:00.442581+08:00, resultsCount=0 2022-12-08 12:13:00.591 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:13:00.442581+08:00, resultsCount=0 2022-12-08 12:13:00.592 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:13:00.442581+08:00 2022-12-08 12:13:00.760 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:01.0, nextRun=2022-12-08 12:13:00.0, currentDate=Thu Dec 08 12:13:00 CST 2022 2022-12-08 12:13:00.761 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:12:01.0, nextRunTime=2022-12-08 12:13:00.0} 2022-12-08 12:13:00.784 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:13:00.785 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:13:00.785 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:13:00.900 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:01.0, nextRun=2022-12-08 12:13:00.0, currentDate=Thu Dec 08 12:13:00 CST 2022 2022-12-08 12:13:00.901 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:12:01.0, nextRunTime=2022-12-08 12:13:00.0} 2022-12-08 12:13:00.927 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:13:00.927 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:13:00.928 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:13:00.975 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:01.0, nextRun=2022-12-08 12:13:00.0, currentDate=Thu Dec 08 12:13:00 CST 2022 2022-12-08 12:13:00.976 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:12:01.0, nextRunTime=2022-12-08 12:13:00.0} 2022-12-08 12:13:00.995 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:13:00.996 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:13:00.996 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:13:01.019 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 97, operation:EXECUTE, state: RUNNING 2022-12-08 12:13:01.064 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:30.0, nextRun=2022-12-08 12:13:00.0, currentDate=Thu Dec 08 12:13:01 CST 2022 2022-12-08 12:13:01.065 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:12:30.0, nextRunTime=2022-12-08 12:13:00.0} 2022-12-08 12:13:01.070 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=97, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:13:01.007+08:00, endTime=null} 2022-12-08 12:13:01.079 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:13:01.079 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:13:01.079 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:13:01.126 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 98, operation:EXECUTE, state: RUNNING 2022-12-08 12:13:01.358 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=98, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T12:13:01.115+08:00, endTime=null} 2022-12-08 12:13:01.365 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:01.0, nextRun=2022-12-08 12:13:00.0, currentDate=Thu Dec 08 12:13:01 CST 2022 2022-12-08 12:13:01.366 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:12:01.0, nextRunTime=2022-12-08 12:13:00.0} 2022-12-08 12:13:01.384 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:13:01.386 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:13:01.386 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:13:01.435 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,70a164b430c8] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=97, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=97, task_operation=execute, latest_execution_start_time=2022-12-08T12:13:01.006+08:00, sub_task_instance_id=97}, listMap={}}, executor=192.168.28.62 2022-12-08 12:13:01.602 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,70a164b430c8] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 97, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:13:01.658 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:13:01.664 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:13:01.806 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:01.837 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:01.841 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:01.846 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:02.268 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:13:02.444 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 99, operation:EXECUTE, state: RUNNING 2022-12-08 12:13:02.485 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=99, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T12:13:02.429+08:00, endTime=null} 2022-12-08 12:13:02.552 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 100, operation:EXECUTE, state: RUNNING 2022-12-08 12:13:02.613 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=100, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:13:02.539+08:00, endTime=null} 2022-12-08 12:13:02.679 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 101, operation:EXECUTE, state: RUNNING 2022-12-08 12:13:02.705 INFO 42 --- [pool-prometheus-minute-schedule-1,,280ce8979bae] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472840, interval=60 2022-12-08 12:13:02.705 INFO 42 --- [pool-prometheus-minute-schedule-1,,280ce8979bae] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472782, count=0, elapsed=1668802309923 2022-12-08 12:13:02.714 INFO 42 --- [pool-prometheus-minute-schedule-2,,61df5f0d9753] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472840, interval=60 2022-12-08 12:13:02.714 INFO 42 --- [pool-prometheus-minute-schedule-2,,61df5f0d9753] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472782, count=0, elapsed=1668802309932 2022-12-08 12:13:02.799 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=101, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:13:02.667+08:00, endTime=null} 2022-12-08 12:13:02.885 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,19e8d3120f2e] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=100, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=100, task_operation=execute, latest_execution_start_time=2022-12-08T12:13:02.538+08:00, sub_task_instance_id=100}, listMap={}}, executor=192.168.28.62 2022-12-08 12:13:02.885 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,19e8d3120f2e] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:13:02.901 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,19e8d3120f2e] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:13:03.264 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,19e8d3120f2e] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 100, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:13:03.286 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:97, status:SUCCESS 2022-12-08 12:13:03.297 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:97, status:SUCCESS 2022-12-08 12:13:03.465 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:98, status:SUCCESS 2022-12-08 12:13:03.471 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:98, status:SUCCESS 2022-12-08 12:13:03.570 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:99, status:SUCCESS 2022-12-08 12:13:03.577 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:99, status:SUCCESS 2022-12-08 12:13:03.668 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:100, status:SUCCESS 2022-12-08 12:13:03.674 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:100, status:SUCCESS 2022-12-08 12:13:03.783 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:101, status:SUCCESS 2022-12-08 12:13:03.790 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:101, status:SUCCESS 2022-12-08 12:13:04.847 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:04.858 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:04.938 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:04.938 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:04.983 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:04.983 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:05.230 INFO 42 --- [pool-ocp-schedules-7,,bb716b773bd5] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:13:05.230 INFO 42 --- [pool-ocp-schedules-7,,bb716b773bd5] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:13:05.870 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:06.091 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:06.0, nextRun=2022-12-08 12:13:05.0, currentDate=Thu Dec 08 12:13:06 CST 2022 2022-12-08 12:13:06.092 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:12:06.0, nextRunTime=2022-12-08 12:13:05.0} 2022-12-08 12:13:06.107 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:13:06.108 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:13:06.108 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:13:06.402 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T12:09:05.846, end=2022-12-08T12:11:06.161} 2022-12-08 12:13:06.438 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 12:13:06.913 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 102, operation:EXECUTE, state: RUNNING 2022-12-08 12:13:07.013 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=102, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:13:06.895+08:00, endTime=null} 2022-12-08 12:13:07.565 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:13:07.571 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:13:07.697 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:13:07.858 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:07.864 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:07.944 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:08.070 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:08.071 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:08.075 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:13:08.315 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:13:08.419 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:13:08.474 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:13:08.585 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:102, status:SUCCESS 2022-12-08 12:13:08.592 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:102, status:SUCCESS 2022-12-08 12:13:08.633 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:13:08.795 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:13:10.034 INFO 42 --- [pool-ocp-schedules-16,,42ca02b11275] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:13:10.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:13:10.411 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:13:10.412084+08:00, lastProcessTime=2022-12-08T12:13:00.442581+08:00 2022-12-08 12:13:10.523 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:13:10.412084+08:00, resultsCount=0 2022-12-08 12:13:10.524 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:13:10.412084+08:00, resultsCount=0 2022-12-08 12:13:10.524 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:13:10.412084+08:00 2022-12-08 12:13:10.865 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:10.870 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:11.152 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:11.152 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:11.152 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:11.153 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:12.606 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:13:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,470f10581403] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:13:13.720 INFO 42 --- [pool-prometheus-cache-monitor1,,470f10581403] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:13:13.871 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:13.889 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:14.602 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:13:14.608 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:13:15.923 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:16.890 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:16.895 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:17.566 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:17.566 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:17.945 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:13:18.031 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:13:18.362 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:18.848 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:13:18.878 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:13:19.896 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:19.901 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:20.037 INFO 42 --- [pool-ocp-schedules-10,,2504c4d07f86] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:13:20.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:13:20.404 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:13:20.404389+08:00, lastProcessTime=2022-12-08T12:13:10.412084+08:00 2022-12-08 12:13:20.541 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:13:20.404389+08:00, resultsCount=0 2022-12-08 12:13:20.542 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:13:20.404389+08:00, resultsCount=0 2022-12-08 12:13:20.542 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:13:20.404389+08:00 2022-12-08 12:13:20.643 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:21.0, nextRun=2022-12-08 12:13:20.0, currentDate=Thu Dec 08 12:13:20 CST 2022 2022-12-08 12:13:20.644 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:12:21.0, nextRunTime=2022-12-08 12:13:20.0} 2022-12-08 12:13:20.669 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:20.669 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:20.670 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:13:20.671 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:13:20.671 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:13:20.675 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:20.675 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:21.231 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 103, operation:EXECUTE, state: RUNNING 2022-12-08 12:13:21.479 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=103, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:13:21.219+08:00, endTime=null} 2022-12-08 12:13:22.902 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:22.907 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:22.957 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:103, status:SUCCESS 2022-12-08 12:13:22.964 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:103, status:SUCCESS 2022-12-08 12:13:24.129 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:13:24.134 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:13:25.500 INFO 42 --- [pool-ocp-schedules-16,,f5306ad3dbd9] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:13:25.501 INFO 42 --- [pool-ocp-schedules-16,,f5306ad3dbd9] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:13:25.510 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:27.0, nextRun=2022-12-08 12:13:25.0, currentDate=Thu Dec 08 12:13:25 CST 2022 2022-12-08 12:13:25.511 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:12:27.0, nextRunTime=2022-12-08 12:13:25.0} 2022-12-08 12:13:25.566 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:13:25.567 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:13:25.567 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:13:25.907 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:25.912 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:25.957 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:26.619 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 104, operation:EXECUTE, state: RUNNING 2022-12-08 12:13:26.677 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=104, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:13:26.604+08:00, endTime=null} 2022-12-08 12:13:27.015 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:27.025 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:27.509 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:13:27.738 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:13:28.011 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:104, status:SUCCESS 2022-12-08 12:13:28.017 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:104, status:SUCCESS 2022-12-08 12:13:28.362 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:13:28.878 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:28.913 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:28.918 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:28.999 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:13:29.006 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:13:30.038 INFO 42 --- [pool-ocp-schedules-19,,607911af4d20] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:13:30.128 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:30.0, nextRun=2022-12-08 12:13:30.0, currentDate=Thu Dec 08 12:13:30 CST 2022 2022-12-08 12:13:30.129 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:12:30.0, nextRunTime=2022-12-08 12:13:30.0} 2022-12-08 12:13:30.153 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:13:30.284 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:13:01.0, nextRun=2022-12-08 12:13:30.0, currentDate=Thu Dec 08 12:13:30 CST 2022 2022-12-08 12:13:30.285 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:13:01.0, nextRunTime=2022-12-08 12:13:30.0} 2022-12-08 12:13:30.302 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:13:30.302 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:13:30.302 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:13:30.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:13:30.412 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:13:30.413340+08:00, lastProcessTime=2022-12-08T12:13:20.404389+08:00 2022-12-08 12:13:30.497 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:30.498 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:30.506 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:13:30.413340+08:00, resultsCount=0 2022-12-08 12:13:30.506 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:13:30.413340+08:00, resultsCount=0 2022-12-08 12:13:30.507 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:13:30.413340+08:00 2022-12-08 12:13:30.512 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:30.512 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:30.791 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 105, operation:EXECUTE, state: RUNNING 2022-12-08 12:13:30.996 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=105, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:13:30.778+08:00, endTime=null} 2022-12-08 12:13:31.427 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:105, status:SUCCESS 2022-12-08 12:13:31.433 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:105, status:SUCCESS 2022-12-08 12:13:31.919 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:31.924 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:32.925 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:13:32.938 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:13:33.567 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:33.594 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:34.068 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:13:34.925 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:34.929 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:35.995 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:36.633 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:36.634 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:36.675 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:36.675 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:37.930 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:37.936 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:38.420 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:13:38.559 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:13:38.603 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:13:38.717 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:13:38.973 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:39.093 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:13:39.237 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:13:39.487 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:13:39.493 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:13:39.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:39.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:39.853 INFO 42 --- [pool-ocp-schedules-20,,f2f2f7eaa414] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:13:39.883 INFO 42 --- [pool-ocp-schedules-20,,f2f2f7eaa414] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:13:39.965 INFO 42 --- [pool-ocp-schedules-10,,26093745d5bb] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:13:40.039 INFO 42 --- [pool-ocp-schedules-15,,ff76fc2de1ea] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:13:40.092 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:13:40.169 INFO 42 --- [pool-ocp-schedules-11,,73e669b12cde] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:13:40.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:13:40.405 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:13:40.405039+08:00, lastProcessTime=2022-12-08T12:13:30.413340+08:00 2022-12-08 12:13:40.535 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:13:40.405039+08:00, resultsCount=0 2022-12-08 12:13:40.536 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:13:40.405039+08:00, resultsCount=0 2022-12-08 12:13:40.536 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:13:40.405039+08:00 2022-12-08 12:13:40.937 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:40.943 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:41.146 INFO 42 --- [pool-ocp-schedules-7,,4108b402524e] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:13:41.146 INFO 42 --- [pool-ocp-schedules-10,,0a3124e88301] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:13:41.147 INFO 42 --- [pool-ocp-schedules-14,,0919ffe57cc4] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:13:41.862 INFO 42 --- [pool-ocp-schedules-3,,d1485fb53162] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:13:41.863 INFO 42 --- [pool-ocp-schedules-3,,d1485fb53162] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:13:41.863 INFO 42 --- [pool-ocp-schedules-3,,d1485fb53162] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:13:42.793 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:13:42.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:42.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:42.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:42.880 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:43.944 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:43.949 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:45.536 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:13:45.540 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:13:45.543 INFO 42 --- [pool-ocp-schedules-16,,70273136ab07] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:13:45.543 INFO 42 --- [pool-ocp-schedules-16,,70273136ab07] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:13:45.965 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:45.965 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:46.153 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:13:46.233 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:46.950 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:46.954 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:48.639 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:13:49.053 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:49.053 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:49.054 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:49.054 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:49.237 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:49.244 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:13:49.487 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:13:49.954 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:49.959 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:50.041 INFO 42 --- [pool-ocp-schedules-10,,adfabb9d3005] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:13:50.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:13:50.419 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:13:50.418702+08:00, lastProcessTime=2022-12-08T12:13:40.405039+08:00 2022-12-08 12:13:50.551 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:13:50.418702+08:00, resultsCount=0 2022-12-08 12:13:50.552 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:13:50.418702+08:00, resultsCount=0 2022-12-08 12:13:50.552 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:13:50.418702+08:00 2022-12-08 12:13:51.291 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:13:51.297 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:13:52.455 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:52.459 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:52.889 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:13:52.960 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:52.966 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:55.567 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:55.567 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:13:55.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:55.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:13:55.967 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:55.971 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:56.276 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:57.825 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:13:58.266 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:13:58.272 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:13:58.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:58.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:13:58.669 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:13:58.972 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:13:58.976 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:13:59.022 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:13:59.487 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:13:59.494 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:13:59.581 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:14:00.042 INFO 42 --- [pool-ocp-schedules-14,,6feb83b1f5ff] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:14:00.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:14:00.410 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:14:00.411065+08:00, lastProcessTime=2022-12-08T12:13:50.418702+08:00 2022-12-08 12:14:00.529 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:14:00.411065+08:00, resultsCount=0 2022-12-08 12:14:00.530 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:14:00.411065+08:00, resultsCount=0 2022-12-08 12:14:00.530 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:14:00.411065+08:00 2022-12-08 12:14:01.071 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:12:01.0, nextRun=2022-12-08 12:14:00.0, currentDate=Thu Dec 08 12:14:01 CST 2022 2022-12-08 12:14:01.072 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 12:12:01.0, nextRunTime=2022-12-08 12:14:00.0} 2022-12-08 12:14:01.094 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 12:14:01.246 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:13:01.0, nextRun=2022-12-08 12:14:00.0, currentDate=Thu Dec 08 12:14:01 CST 2022 2022-12-08 12:14:01.247 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:13:01.0, nextRunTime=2022-12-08 12:14:00.0} 2022-12-08 12:14:01.272 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:14:01.273 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:14:01.273 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:14:01.407 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:13:01.0, nextRun=2022-12-08 12:14:00.0, currentDate=Thu Dec 08 12:14:01 CST 2022 2022-12-08 12:14:01.408 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:13:01.0, nextRunTime=2022-12-08 12:14:00.0} 2022-12-08 12:14:01.444 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:14:01.445 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:14:01.445 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:14:01.514 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:13:01.0, nextRun=2022-12-08 12:14:00.0, currentDate=Thu Dec 08 12:14:01 CST 2022 2022-12-08 12:14:01.515 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:13:01.0, nextRunTime=2022-12-08 12:14:00.0} 2022-12-08 12:14:01.544 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:14:01.545 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:14:01.545 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:14:01.610 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:13:30.0, nextRun=2022-12-08 12:14:00.0, currentDate=Thu Dec 08 12:14:01 CST 2022 2022-12-08 12:14:01.611 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:13:30.0, nextRunTime=2022-12-08 12:14:00.0} 2022-12-08 12:14:01.630 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:14:01.631 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:14:01.631 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:14:01.752 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:13:01.0, nextRun=2022-12-08 12:14:00.0, currentDate=Thu Dec 08 12:14:01 CST 2022 2022-12-08 12:14:01.753 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:13:01.0, nextRunTime=2022-12-08 12:14:00.0} 2022-12-08 12:14:01.770 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:14:01.770 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:14:01.771 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:14:01.977 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:01.981 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:02.008 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:02.008 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:02.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:02.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:02.409 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 106, operation:EXECUTE, state: RUNNING 2022-12-08 12:14:02.677 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=106, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:14:02.397+08:00, endTime=null} 2022-12-08 12:14:02.705 INFO 42 --- [pool-prometheus-minute-schedule-2,,29eaf8a78318] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472900, interval=60 2022-12-08 12:14:02.706 INFO 42 --- [pool-prometheus-minute-schedule-2,,29eaf8a78318] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472842, count=0, elapsed=1668802369864 2022-12-08 12:14:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,2abd653a5cf0] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670472900, interval=60 2022-12-08 12:14:02.714 INFO 42 --- [pool-prometheus-minute-schedule-1,,2abd653a5cf0] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670472842, count=0, elapsed=1668802369872 2022-12-08 12:14:02.771 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 107, operation:EXECUTE, state: RUNNING 2022-12-08 12:14:03.199 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=107, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T12:14:02.752+08:00, endTime=null} 2022-12-08 12:14:03.280 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 108, operation:EXECUTE, state: RUNNING 2022-12-08 12:14:03.335 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=108, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T12:14:03.261+08:00, endTime=null} 2022-12-08 12:14:03.403 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,9cfdff61e436] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=107, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=107, task_operation=execute, latest_execution_start_time=2022-12-08T12:14:02.750+08:00, sub_task_instance_id=107}, listMap={}}, executor=192.168.28.62 2022-12-08 12:14:03.410 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 109, operation:EXECUTE, state: RUNNING 2022-12-08 12:14:03.491 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=109, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:14:03.389+08:00, endTime=null} 2022-12-08 12:14:03.567 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 110, operation:EXECUTE, state: RUNNING 2022-12-08 12:14:03.570 INFO 42 --- [pool-subtask-executor32,e9a604ac23b54e62,9cfdff61e436] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 107, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:14:03.684 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=110, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T12:14:03.549+08:00, endTime=null} 2022-12-08 12:14:04.211 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:14:04.217 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:14:04.679 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:106, status:SUCCESS 2022-12-08 12:14:04.685 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:106, status:SUCCESS 2022-12-08 12:14:04.789 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:107, status:SUCCESS 2022-12-08 12:14:04.796 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:107, status:SUCCESS 2022-12-08 12:14:04.957 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:108, status:SUCCESS 2022-12-08 12:14:04.964 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:108, status:SUCCESS 2022-12-08 12:14:04.982 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:04.986 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:05.091 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:109, status:SUCCESS 2022-12-08 12:14:05.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:05.106 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:05.107 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:109, status:SUCCESS 2022-12-08 12:14:05.208 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:110, status:SUCCESS 2022-12-08 12:14:05.215 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:110, status:SUCCESS 2022-12-08 12:14:05.307 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:14:05.591 INFO 42 --- [pool-ocp-schedules-15,,6dc5899f0c01] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:14:05.592 INFO 42 --- [pool-ocp-schedules-15,,6dc5899f0c01] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:14:06.234 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:13:06.0, nextRun=2022-12-08 12:14:05.0, currentDate=Thu Dec 08 12:14:06 CST 2022 2022-12-08 12:14:06.235 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:13:06.0, nextRunTime=2022-12-08 12:14:05.0} 2022-12-08 12:14:06.254 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:14:06.254 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:14:06.254 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:14:06.332 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:14:06.820 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 111, operation:EXECUTE, state: RUNNING 2022-12-08 12:14:06.865 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=111, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T12:14:06.804+08:00, endTime=null} 2022-12-08 12:14:07.987 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:07.995 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:08.126 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:111, status:SUCCESS 2022-12-08 12:14:08.134 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:111, status:SUCCESS 2022-12-08 12:14:08.185 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:08.185 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:08.186 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:08.186 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:08.560 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:14:08.850 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:14:08.930 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:14:09.027 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:14:09.556 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:14:09.560 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:14:09.684 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:14:10.043 INFO 42 --- [pool-ocp-schedules-9,,cecd085990e3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:14:10.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:14:10.426 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:14:10.426256+08:00, lastProcessTime=2022-12-08T12:14:00.411065+08:00 2022-12-08 12:14:10.475 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:14:10.481 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:14:10.540 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:14:10.426256+08:00, resultsCount=0 2022-12-08 12:14:10.541 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:14:10.426256+08:00, resultsCount=0 2022-12-08 12:14:10.541 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:14:10.426256+08:00 2022-12-08 12:14:10.996 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:11.000 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:11.279 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:11.279 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:11.573 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:14:12.901 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:14:13.719 INFO 42 --- [pool-prometheus-cache-monitor1,,2b2912bf5ecd] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:14:13.720 INFO 42 --- [pool-prometheus-cache-monitor1,,2b2912bf5ecd] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:14:14.001 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:14.005 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:14.409 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:14.409 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:14.410 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:14.410 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:16.615 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:14:16.777 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:14:16.787 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:14:17.006 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:17.016 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:17.661 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:17.664 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:17.945 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:14:19.081 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:14:19.614 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:14:19.634 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:14:20.017 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:20.021 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:20.046 INFO 42 --- [pool-ocp-schedules-6,,736304e9e2fa] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:14:20.219 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:14:20.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:14:20.412 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:14:20.411904+08:00, lastProcessTime=2022-12-08T12:14:10.426256+08:00 2022-12-08 12:14:20.521 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:14:20.411904+08:00, resultsCount=0 2022-12-08 12:14:20.521 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:14:20.411904+08:00, resultsCount=0 2022-12-08 12:14:20.521 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:14:20.411904+08:00 2022-12-08 12:14:20.626 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:13:21.0, nextRun=2022-12-08 12:14:20.0, currentDate=Thu Dec 08 12:14:20 CST 2022 2022-12-08 12:14:20.627 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:13:21.0, nextRunTime=2022-12-08 12:14:20.0} 2022-12-08 12:14:20.648 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:14:20.649 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:14:20.649 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:14:20.766 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:20.767 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:20.769 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:20.769 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:21.095 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 112, operation:EXECUTE, state: RUNNING 2022-12-08 12:14:21.391 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=112, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T12:14:21.082+08:00, endTime=null} 2022-12-08 12:14:21.817 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:112, status:SUCCESS 2022-12-08 12:14:21.823 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:112, status:SUCCESS 2022-12-08 12:14:23.022 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:23.028 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:23.144 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:14:23.150 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:14:23.847 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:23.877 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:24.263 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:14:25.306 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:13:26.0, nextRun=2022-12-08 12:14:25.0, currentDate=Thu Dec 08 12:14:25 CST 2022 2022-12-08 12:14:25.306 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:13:26.0, nextRunTime=2022-12-08 12:14:25.0} 2022-12-08 12:14:25.345 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:14:25.346 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:14:25.346 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:14:25.519 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 113, operation:EXECUTE, state: RUNNING 2022-12-08 12:14:25.558 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=113, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T12:14:25.507+08:00, endTime=null} 2022-12-08 12:14:25.786 INFO 42 --- [pool-ocp-schedules-8,,94afe1da9a1a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:14:25.787 INFO 42 --- [pool-ocp-schedules-8,,94afe1da9a1a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:14:26.028 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:26.034 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:26.458 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:113, status:SUCCESS 2022-12-08 12:14:26.465 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:113, status:SUCCESS 2022-12-08 12:14:26.650 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:14:27.048 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:27.049 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:27.056 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:27.056 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:27.321 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 12:14:27.340 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=19ms, period=120000ms 2022-12-08 12:14:27.997 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:14:29.035 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:29.040 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:29.172 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:14:29.662 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:14:29.796 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:14:29.801 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:14:30.019 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:14:30.047 INFO 42 --- [pool-ocp-schedules-13,,c7b06b08d65a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:14:30.194 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:30.196 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:30.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:14:30.413 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:14:30.412344+08:00, lastProcessTime=2022-12-08T12:14:20.411904+08:00 2022-12-08 12:14:30.528 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:14:30.412344+08:00, resultsCount=0 2022-12-08 12:14:30.529 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:14:30.412344+08:00, resultsCount=0 2022-12-08 12:14:30.529 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:14:30.412344+08:00 2022-12-08 12:14:30.579 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:14:30.649 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:14:31.437 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:13:30.0, nextRun=2022-12-08 12:14:30.0, currentDate=Thu Dec 08 12:14:31 CST 2022 2022-12-08 12:14:31.438 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:13:30.0, nextRunTime=2022-12-08 12:14:30.0} 2022-12-08 12:14:31.456 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:14:31.618 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:02.0, nextRun=2022-12-08 12:14:30.0, currentDate=Thu Dec 08 12:14:31 CST 2022 2022-12-08 12:14:31.618 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:14:02.0, nextRunTime=2022-12-08 12:14:30.0} 2022-12-08 12:14:31.639 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:14:31.640 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:14:31.640 INFO 42 --- [pool-task-coordinator2,e9a604ac23b54e62,de9d054deac2] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:14:32.041 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:32.046 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:32.710 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 114, operation:EXECUTE, state: RUNNING 2022-12-08 12:14:33.052 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=114, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:14:32.697+08:00, endTime=null} 2022-12-08 12:14:33.269 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:33.270 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:33.279 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:33.279 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:34.071 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:114, status:SUCCESS 2022-12-08 12:14:34.076 INFO 42 --- [pool-task-coordinator1,71424bfefee043c0,998dd4bf0e66] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:114, status:SUCCESS 2022-12-08 12:14:35.046 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:35.051 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:35.822 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:14:35.826 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:14:36.373 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:36.378 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:36.678 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:14:36.894 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:14:38.051 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:38.055 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:38.850 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:14:38.930 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:14:39.028 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:14:39.072 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:11:38+08:00, updateTime=2022-12-08T12:14:08+08:00, expireTime=null, isLeader=false} 2022-12-08 12:14:39.082 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:14:39.245 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:14:39.647 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:39.648 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:39.649 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:39.649 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:39.748 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:14:39.838 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 12:14:39.853 INFO 42 --- [pool-ocp-schedules-19,,b0622a8b5d56] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:14:39.924 INFO 42 --- [pool-ocp-schedules-19,,b0622a8b5d56] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:14:39.948 INFO 42 --- [pool-ocp-schedules-13,,48aaddf7ce87] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:14:39.949 INFO 42 --- [pool-ocp-schedules-13,,48aaddf7ce87] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:14:39.966 INFO 42 --- [pool-ocp-schedules-14,,78e5938e98e2] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:14:40.048 INFO 42 --- [pool-ocp-schedules-20,,fadab3a9c946] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:14:40.143 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:14:40.174 INFO 42 --- [pool-ocp-schedules-2,,978c28f823e9] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:14:40.255 INFO 42 --- [pool-ocp-schedules-6,,5241741d607c] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 12:14:40.350 INFO 42 --- [pool-ocp-schedules-8,,281aed73220b] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 12:14:40.354 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:14:40.402 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:14:40.402837+08:00, lastProcessTime=2022-12-08T12:14:30.412344+08:00 2022-12-08 12:14:40.862 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:14:40.988 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:14:40.402837+08:00, resultsCount=0 2022-12-08 12:14:40.989 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:14:40.402837+08:00, resultsCount=0 2022-12-08 12:14:40.989 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:14:40.402837+08:00 2022-12-08 12:14:41.056 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:41.061 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:41.205 INFO 42 --- [pool-ocp-schedules-13,,bb44ea025e55] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:14:41.205 INFO 42 --- [pool-ocp-schedules-17,,0fbc003324e5] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:14:41.208 INFO 42 --- [pool-ocp-schedules-19,,4efa37496cd5] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:14:41.982 INFO 42 --- [pool-ocp-schedules-8,,7f93d33d9d2b] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:14:41.982 INFO 42 --- [pool-ocp-schedules-8,,7f93d33d9d2b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:14:41.982 INFO 42 --- [pool-ocp-schedules-8,,7f93d33d9d2b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:14:42.072 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:14:42.085 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:14:42.751 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:42.751 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:43.034 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:14:43.193 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:14:44.062 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:44.067 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:45.824 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:45.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:45.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:45.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:46.255 INFO 42 --- [pool-ocp-schedules-10,,ca52c364c926] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:14:46.255 INFO 42 --- [pool-ocp-schedules-10,,ca52c364c926] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:14:46.722 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:14:47.068 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:47.072 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:48.371 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:14:48.374 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:14:49.345 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:14:49.490 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:49.493 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:49.813 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:14:50.008 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:14:50.049 INFO 42 --- [pool-ocp-schedules-10,,dbfaebe3b5f4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:14:50.072 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:50.077 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:50.337 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:14:50.353 INFO 42 --- [alarm-task-1,,1b1e9b23a238] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:14:50.403 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:14:50.402606+08:00, lastProcessTime=2022-12-08T12:14:40.402837+08:00 2022-12-08 12:14:50.527 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:14:50.402606+08:00, resultsCount=0 2022-12-08 12:14:50.528 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:14:50.402606+08:00, resultsCount=0 2022-12-08 12:14:50.528 INFO 42 --- [alarm-task-2,,6dd3820ee23f] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:14:50.402606+08:00 2022-12-08 12:14:50.911 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:14:52.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:52.550 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:52.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:14:52.551 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:14:53.077 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:53.082 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:55.228 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:14:55.236 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:14:55.617 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:55.618 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:14:55.825 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:14:56.083 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:14:56.087 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:14:56.760 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 Run in container Total memory is 8388608KB Starting ocp-server: /usr/lib/jvm/java-1.8.0/bin/java -server -XX:+UseG1GC -Xms5734m -Xmx5734m -Xss512k -XX:+PrintCommandLineFlags -XX:MetaspaceSize=1024m -XX:MaxMetaspaceSize=1024m -XX:+PrintAdaptiveSizePolicy -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -Xloggc:/home/admin/ocp-server/bin/../log/gc.log -XX:+UseGCLogFileRotation -XX:GCLogFileSize=50M -XX:NumberOfGCLogFiles=2 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -Dfile.encoding=UTF-8 -jar /home/admin/ocp-server/bin/../lib/ocp-server-4.0.0-20220930.jar -XX:CompressedClassSpaceSize=1065353216 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:GCLogFileSize=52428800 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -XX:InitialHeapSize=6012534784 -XX:MaxHeapSize=6012534784 -XX:MaxMetaspaceSize=1073741824 -XX:MetaspaceSize=1073741824 -XX:NumberOfGCLogFiles=2 -XX:+PrintAdaptiveSizePolicy -XX:+PrintCommandLineFlags -XX:+PrintGC -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ThreadStackSize=512 -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseGCLogFileRotation ___ ___ / _ \ __ ___ __ _ _ _ | _ ) __ _ ___ ___ | (_) | / _| / -_) / _` | | ' \ | _ \ / _` | (_-< / -_) \___/ \__| \___| \__,_| |_||_| |___/ \__,_| /__/ \___| :: Spring Boot :: (v2.3.9.RELEASE) :: OCP Server :: (v4.0.0-20220930) 2022-12-08 12:15:32.657 INFO 42 --- [ main] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 12:15:34.059 INFO 42 --- [ main] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 12:15:34.453 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : The following profiles are active: composite,default 2022-12-08 12:16:04.241 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:16:05.512 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 1156ms. Found 3 JPA repository interfaces. 2022-12-08 12:16:05.610 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:16:07.873 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 2262ms. Found 16 JPA repository interfaces. 2022-12-08 12:16:07.879 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:16:24.384 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 16503ms. Found 99 JPA repository interfaces. 2022-12-08 12:16:33.702 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmEventHistoryRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmEventHistoryRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:33.704 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmGroupAlarmTypeRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmGroupAlarmTypeRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:33.705 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmDetectRuleRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmDetectRuleRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:33.706 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmMetricMetaRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmMetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:34.119 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricGroupRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricGroupRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:34.120 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricObCollectConfigRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricObCollectConfigRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:34.121 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricClassRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricClassRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:34.121 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricMetaRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:34.664 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'sqlAggregateDataRepository' and 'com.alipay.ocp.core.monitordb.alarm.SqlAggregateDataRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:34.666 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obClusterSystemEventRepository' and 'com.alipay.ocp.core.monitordb.ob.ObClusterSystemEventRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:34.667 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obTenantMiniCompactionRepository' and 'com.alipay.ocp.core.monitordb.ob.ObTenantMiniCompactionRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:16:36.081 INFO 42 --- [main,,] o.s.cloud.context.scope.GenericScope : BeanFactory id=22bf410e-9c42-33ee-903b-47d732131f72 2022-12-08 12:16:39.771 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler@383f1975' of type [org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:16:39.775 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'localSecurityConfiguration.MethodSecurityConfiguration' of type [com.alipay.ocp.server.config.security.LocalSecurityConfiguration$MethodSecurityConfiguration$$EnhancerBySpringCGLIB$$b2981658] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:16:39.920 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Method-level access control enabled. 2022-12-08 12:16:39.939 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'methodSecurityMetadataSource' of type [org.springframework.security.access.method.DelegatingMethodSecurityMetadataSource] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:16:45.691 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 12:16:47.730 INFO 42 --- [main,,] org.hibernate.Version : HHH000412: Hibernate ORM core version 5.4.28.Final 2022-12-08 12:16:50.822 INFO 42 --- [main,,] o.hibernate.annotations.common.Version : HCANN000001: Hibernate Commons Annotations {5.1.2.Final} 2022-12-08 12:16:59.826 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-1,metadb-connect-pool} inited 2022-12-08 12:17:00.247 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:17:04.865 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:17:04.868 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:17:04.870 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:17:08.752 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000038: Composite-id class does not override equals(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 12:17:08.755 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000039: Composite-id class does not override hashCode(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 12:17:22.250 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 12:17:22.375 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 12:17:32.033 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8080 (http) 2022-12-08 12:17:32.158 INFO 42 --- [main,,] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2022-12-08 12:17:32.160 INFO 42 --- [main,,] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.43] 2022-12-08 12:17:32.980 INFO 42 --- [main,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2022-12-08 12:17:32.982 INFO 42 --- [main,,] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 118274 ms 2022-12-08 12:17:41.554 INFO 42 --- [main,,] c.a.o.service.maz.OcpMultiAzoneService : OCP multi-azone not enabled 2022-12-08 12:17:41.567 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set username=monitor_user@monitor_tenant#obcluster 2022-12-08 12:17:41.570 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set url=jdbc:oceanbase://192.168.28.54:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true 2022-12-08 12:17:41.571 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set driver class=com.oceanbase.jdbc.Driver 2022-12-08 12:17:41.812 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 12:17:47.364 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-2,monitordb-connect-pool} inited 2022-12-08 12:17:47.366 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:17:49.645 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 12:17:49.651 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 12:17:50.263 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/meta 2022-12-08 12:17:51.036 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Finish migration, location=migration/meta 2022-12-08 12:17:51.037 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/monitor 2022-12-08 12:17:51.040 INFO 42 --- [main,,] com.alipay.ocp.core.util.ResourceUtils : Cannot find any file in location: migration/monitor 2022-12-08 12:17:51.041 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Migration schemas is empty. 2022-12-08 12:18:40.339 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 26117 ms to scan 31 urls, producing 672 keys and 5542 values 2022-12-08 12:19:03.742 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 22930 ms to scan 31 urls, producing 73 keys and 4708 values 2022-12-08 12:19:03.830 INFO 42 --- [main,,] c.a.o.server.analyzer.OcpStartUpChecker : audit event is disable 2022-12-08 12:19:06.559 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : ocp-monitor bean configuration done 2022-12-08 12:19:19.516 INFO 42 --- [main,,] c.a.ocp.server.config.BeanConfiguration : begin set auto discover false. 2022-12-08 12:19:19.568 INFO 42 --- [main,,] c.a.ocp.server.config.BeanConfiguration : set auto discover false success. 2022-12-08 12:19:26.854 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Validate and set keys, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCmKEJV3mbaJH2oW7yTVE1NiJWrXzMS8SnAlPUTiZVZm5Lb/00BUhwEhiOsVyihLHkAZRTfgmmyxpBoOZkFsAUmD5Gkc1b9tdgH/cImSbxnsdssxYE28miDmXthxJhqadHkdqOqMOAQictyWUHRiOFryzIFz0dUew/lSdZult/OoQIDAQAB, valid=true 2022-12-08 12:19:26.857 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Login key is legal. 2022-12-08 12:19:29.146 INFO 42 --- [main,,] c.a.o.s.s.operator.LocalFileOperator : FileStorageService init, fileDirPath=/home/admin/data/files Run in container Total memory is 8388608KB Starting ocp-server: /usr/lib/jvm/java-1.8.0/bin/java -server -XX:+UseG1GC -Xms5734m -Xmx5734m -Xss512k -XX:+PrintCommandLineFlags -XX:MetaspaceSize=1024m -XX:MaxMetaspaceSize=1024m -XX:+PrintAdaptiveSizePolicy -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -Xloggc:/home/admin/ocp-server/bin/../log/gc.log -XX:+UseGCLogFileRotation -XX:GCLogFileSize=50M -XX:NumberOfGCLogFiles=2 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -Dfile.encoding=UTF-8 -jar /home/admin/ocp-server/bin/../lib/ocp-server-4.0.0-20220930.jar -XX:CompressedClassSpaceSize=1065353216 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:GCLogFileSize=52428800 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -XX:InitialHeapSize=6012534784 -XX:MaxHeapSize=6012534784 -XX:MaxMetaspaceSize=1073741824 -XX:MetaspaceSize=1073741824 -XX:NumberOfGCLogFiles=2 -XX:+PrintAdaptiveSizePolicy -XX:+PrintCommandLineFlags -XX:+PrintGC -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ThreadStackSize=512 -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseGCLogFileRotation ___ ___ / _ \ __ ___ __ _ _ _ | _ ) __ _ ___ ___ | (_) | / _| / -_) / _` | | ' \ | _ \ / _` | (_-< / -_) \___/ \__| \___| \__,_| |_||_| |___/ \__,_| /__/ \___| :: Spring Boot :: (v2.3.9.RELEASE) :: OCP Server :: (v4.0.0-20220930) 2022-12-08 12:20:08.458 INFO 42 --- [ main] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 12:20:10.014 INFO 42 --- [ main] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 12:20:10.459 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : The following profiles are active: composite,default 2022-12-08 12:20:40.301 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:20:41.580 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 1181ms. Found 3 JPA repository interfaces. 2022-12-08 12:20:41.656 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:20:44.135 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 2477ms. Found 16 JPA repository interfaces. 2022-12-08 12:20:44.143 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:21:01.944 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 17798ms. Found 99 JPA repository interfaces. 2022-12-08 12:21:10.515 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmEventHistoryRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmEventHistoryRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:10.517 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmGroupAlarmTypeRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmGroupAlarmTypeRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:10.518 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmDetectRuleRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmDetectRuleRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:10.519 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmMetricMetaRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmMetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:10.978 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricGroupRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricGroupRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:10.981 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricObCollectConfigRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricObCollectConfigRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:10.982 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricClassRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricClassRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:10.983 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricMetaRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:11.615 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'sqlAggregateDataRepository' and 'com.alipay.ocp.core.monitordb.alarm.SqlAggregateDataRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:11.617 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obClusterSystemEventRepository' and 'com.alipay.ocp.core.monitordb.ob.ObClusterSystemEventRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:11.618 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obTenantMiniCompactionRepository' and 'com.alipay.ocp.core.monitordb.ob.ObTenantMiniCompactionRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:21:13.172 INFO 42 --- [main,,] o.s.cloud.context.scope.GenericScope : BeanFactory id=22bf410e-9c42-33ee-903b-47d732131f72 2022-12-08 12:21:16.634 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler@562c877a' of type [org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:21:16.654 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'localSecurityConfiguration.MethodSecurityConfiguration' of type [com.alipay.ocp.server.config.security.LocalSecurityConfiguration$MethodSecurityConfiguration$$EnhancerBySpringCGLIB$$7859743e] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:21:16.782 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Method-level access control enabled. 2022-12-08 12:21:16.801 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'methodSecurityMetadataSource' of type [org.springframework.security.access.method.DelegatingMethodSecurityMetadataSource] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:21:22.201 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 12:21:24.064 INFO 42 --- [main,,] org.hibernate.Version : HHH000412: Hibernate ORM core version 5.4.28.Final 2022-12-08 12:21:26.546 INFO 42 --- [main,,] o.hibernate.annotations.common.Version : HCANN000001: Hibernate Commons Annotations {5.1.2.Final} 2022-12-08 12:21:35.379 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-1,metadb-connect-pool} inited 2022-12-08 12:21:35.756 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:21:39.587 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:21:39.590 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:21:39.592 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:21:43.201 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000038: Composite-id class does not override equals(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 12:21:43.203 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000039: Composite-id class does not override hashCode(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 12:22:01.808 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 12:22:01.993 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 12:22:12.871 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8080 (http) 2022-12-08 12:22:13.083 INFO 42 --- [main,,] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2022-12-08 12:22:13.085 INFO 42 --- [main,,] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.43] 2022-12-08 12:22:14.452 INFO 42 --- [main,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2022-12-08 12:22:14.453 INFO 42 --- [main,,] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 123693 ms 2022-12-08 12:22:26.121 INFO 42 --- [main,,] c.a.o.service.maz.OcpMultiAzoneService : OCP multi-azone not enabled 2022-12-08 12:22:26.156 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set username=monitor_user@monitor_tenant#obcluster 2022-12-08 12:22:26.159 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set url=jdbc:oceanbase://192.168.28.54:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true 2022-12-08 12:22:26.160 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set driver class=com.oceanbase.jdbc.Driver 2022-12-08 12:22:26.507 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 12:22:32.253 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-2,monitordb-connect-pool} inited 2022-12-08 12:22:32.256 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:22:34.753 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 12:22:34.756 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 12:22:35.734 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/meta 2022-12-08 12:22:36.642 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Finish migration, location=migration/meta 2022-12-08 12:22:36.643 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/monitor 2022-12-08 12:22:36.647 INFO 42 --- [main,,] com.alipay.ocp.core.util.ResourceUtils : Cannot find any file in location: migration/monitor 2022-12-08 12:22:36.648 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Migration schemas is empty. Run in container Total memory is 8388608KB Starting ocp-server: /usr/lib/jvm/java-1.8.0/bin/java -server -XX:+UseG1GC -Xms5734m -Xmx5734m -Xss512k -XX:+PrintCommandLineFlags -XX:MetaspaceSize=1024m -XX:MaxMetaspaceSize=1024m -XX:+PrintAdaptiveSizePolicy -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -Xloggc:/home/admin/ocp-server/bin/../log/gc.log -XX:+UseGCLogFileRotation -XX:GCLogFileSize=50M -XX:NumberOfGCLogFiles=2 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -Dfile.encoding=UTF-8 -jar /home/admin/ocp-server/bin/../lib/ocp-server-4.0.0-20220930.jar -XX:CompressedClassSpaceSize=1065353216 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:GCLogFileSize=52428800 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -XX:InitialHeapSize=6012534784 -XX:MaxHeapSize=6012534784 -XX:MaxMetaspaceSize=1073741824 -XX:MetaspaceSize=1073741824 -XX:NumberOfGCLogFiles=2 -XX:+PrintAdaptiveSizePolicy -XX:+PrintCommandLineFlags -XX:+PrintGC -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ThreadStackSize=512 -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseGCLogFileRotation ___ ___ / _ \ __ ___ __ _ _ _ | _ ) __ _ ___ ___ | (_) | / _| / -_) / _` | | ' \ | _ \ / _` | (_-< / -_) \___/ \__| \___| \__,_| |_||_| |___/ \__,_| /__/ \___| :: Spring Boot :: (v2.3.9.RELEASE) :: OCP Server :: (v4.0.0-20220930) 2022-12-08 12:25:02.977 INFO 42 --- [ main] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 12:25:05.272 INFO 42 --- [ main] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 12:25:05.800 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : The following profiles are active: composite,default 2022-12-08 12:25:35.206 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:25:36.285 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 976ms. Found 3 JPA repository interfaces. 2022-12-08 12:25:36.347 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:25:38.834 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 2485ms. Found 16 JPA repository interfaces. 2022-12-08 12:25:38.844 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:25:54.879 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 16034ms. Found 99 JPA repository interfaces. Run in container Total memory is 8388608KB Starting ocp-server: /usr/lib/jvm/java-1.8.0/bin/java -server -XX:+UseG1GC -Xms5734m -Xmx5734m -Xss512k -XX:+PrintCommandLineFlags -XX:MetaspaceSize=1024m -XX:MaxMetaspaceSize=1024m -XX:+PrintAdaptiveSizePolicy -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -Xloggc:/home/admin/ocp-server/bin/../log/gc.log -XX:+UseGCLogFileRotation -XX:GCLogFileSize=50M -XX:NumberOfGCLogFiles=2 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -Dfile.encoding=UTF-8 -jar /home/admin/ocp-server/bin/../lib/ocp-server-4.0.0-20220930.jar -XX:CompressedClassSpaceSize=1065353216 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:GCLogFileSize=52428800 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -XX:InitialHeapSize=6012534784 -XX:MaxHeapSize=6012534784 -XX:MaxMetaspaceSize=1073741824 -XX:MetaspaceSize=1073741824 -XX:NumberOfGCLogFiles=2 -XX:+PrintAdaptiveSizePolicy -XX:+PrintCommandLineFlags -XX:+PrintGC -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ThreadStackSize=512 -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseGCLogFileRotation ___ ___ / _ \ __ ___ __ _ _ _ | _ ) __ _ ___ ___ | (_) | / _| / -_) / _` | | ' \ | _ \ / _` | (_-< / -_) \___/ \__| \___| \__,_| |_||_| |___/ \__,_| /__/ \___| :: Spring Boot :: (v2.3.9.RELEASE) :: OCP Server :: (v4.0.0-20220930) 2022-12-08 12:35:19.730 INFO 42 --- [ main] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 12:35:21.008 INFO 42 --- [ main] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 12:35:21.374 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : The following profiles are active: composite,default 2022-12-08 12:35:47.535 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:35:48.866 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 1216ms. Found 3 JPA repository interfaces. 2022-12-08 12:35:48.959 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:35:51.498 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 2537ms. Found 16 JPA repository interfaces. 2022-12-08 12:35:51.504 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:36:06.007 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 14501ms. Found 99 JPA repository interfaces. 2022-12-08 12:36:12.766 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmEventHistoryRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmEventHistoryRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:12.768 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmGroupAlarmTypeRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmGroupAlarmTypeRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:12.769 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmDetectRuleRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmDetectRuleRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:12.770 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmMetricMetaRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmMetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:13.198 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricGroupRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricGroupRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:13.199 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricObCollectConfigRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricObCollectConfigRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:13.200 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricClassRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricClassRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:13.201 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricMetaRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:13.751 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'sqlAggregateDataRepository' and 'com.alipay.ocp.core.monitordb.alarm.SqlAggregateDataRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:13.752 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obClusterSystemEventRepository' and 'com.alipay.ocp.core.monitordb.ob.ObClusterSystemEventRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:13.754 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obTenantMiniCompactionRepository' and 'com.alipay.ocp.core.monitordb.ob.ObTenantMiniCompactionRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:36:15.184 INFO 42 --- [main,,] o.s.cloud.context.scope.GenericScope : BeanFactory id=22bf410e-9c42-33ee-903b-47d732131f72 2022-12-08 12:36:18.374 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler@55b8dbda' of type [org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:36:18.379 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'localSecurityConfiguration.MethodSecurityConfiguration' of type [com.alipay.ocp.server.config.security.LocalSecurityConfiguration$MethodSecurityConfiguration$$EnhancerBySpringCGLIB$$e88bb417] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:36:18.503 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Method-level access control enabled. 2022-12-08 12:36:18.523 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'methodSecurityMetadataSource' of type [org.springframework.security.access.method.DelegatingMethodSecurityMetadataSource] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:36:23.708 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 12:36:26.609 INFO 42 --- [main,,] org.hibernate.Version : HHH000412: Hibernate ORM core version 5.4.28.Final 2022-12-08 12:36:32.313 INFO 42 --- [main,,] o.hibernate.annotations.common.Version : HCANN000001: Hibernate Commons Annotations {5.1.2.Final} 2022-12-08 12:36:40.805 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-1,metadb-connect-pool} inited 2022-12-08 12:36:41.181 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:36:45.544 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:36:45.546 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:36:45.548 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:36:48.783 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000038: Composite-id class does not override equals(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 12:36:48.785 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000039: Composite-id class does not override hashCode(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 12:36:58.119 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 12:36:58.236 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 12:37:05.668 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8080 (http) 2022-12-08 12:37:05.742 INFO 42 --- [main,,] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2022-12-08 12:37:05.744 INFO 42 --- [main,,] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.43] 2022-12-08 12:37:06.282 INFO 42 --- [main,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2022-12-08 12:37:06.283 INFO 42 --- [main,,] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 104688 ms 2022-12-08 12:37:14.410 INFO 42 --- [main,,] c.a.o.service.maz.OcpMultiAzoneService : OCP multi-azone not enabled 2022-12-08 12:37:14.428 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set username=monitor_user@monitor_tenant#obcluster 2022-12-08 12:37:14.430 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set url=jdbc:oceanbase://192.168.28.54:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true 2022-12-08 12:37:14.430 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set driver class=com.oceanbase.jdbc.Driver 2022-12-08 12:37:14.739 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 12:37:20.112 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-2,monitordb-connect-pool} inited 2022-12-08 12:37:20.114 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:37:22.412 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 12:37:22.413 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 12:37:22.919 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/meta 2022-12-08 12:37:23.635 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Finish migration, location=migration/meta 2022-12-08 12:37:23.636 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/monitor 2022-12-08 12:37:23.639 INFO 42 --- [main,,] com.alipay.ocp.core.util.ResourceUtils : Cannot find any file in location: migration/monitor 2022-12-08 12:37:23.640 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Migration schemas is empty. 2022-12-08 12:38:06.720 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 24032 ms to scan 31 urls, producing 672 keys and 5542 values 2022-12-08 12:38:28.461 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 21488 ms to scan 31 urls, producing 73 keys and 4708 values 2022-12-08 12:38:28.556 INFO 42 --- [main,,] c.a.o.server.analyzer.OcpStartUpChecker : audit event is disable 2022-12-08 12:38:31.096 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : ocp-monitor bean configuration done Run in container Total memory is 8388608KB Starting ocp-server: /usr/lib/jvm/java-1.8.0/bin/java -server -XX:+UseG1GC -Xms5734m -Xmx5734m -Xss512k -XX:+PrintCommandLineFlags -XX:MetaspaceSize=1024m -XX:MaxMetaspaceSize=1024m -XX:+PrintAdaptiveSizePolicy -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -Xloggc:/home/admin/ocp-server/bin/../log/gc.log -XX:+UseGCLogFileRotation -XX:GCLogFileSize=50M -XX:NumberOfGCLogFiles=2 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -Dfile.encoding=UTF-8 -jar /home/admin/ocp-server/bin/../lib/ocp-server-4.0.0-20220930.jar -XX:CompressedClassSpaceSize=1065353216 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:GCLogFileSize=52428800 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -XX:InitialHeapSize=6012534784 -XX:MaxHeapSize=6012534784 -XX:MaxMetaspaceSize=1073741824 -XX:MetaspaceSize=1073741824 -XX:NumberOfGCLogFiles=2 -XX:+PrintAdaptiveSizePolicy -XX:+PrintCommandLineFlags -XX:+PrintGC -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ThreadStackSize=512 -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseGCLogFileRotation ___ ___ / _ \ __ ___ __ _ _ _ | _ ) __ _ ___ ___ | (_) | / _| / -_) / _` | | ' \ | _ \ / _` | (_-< / -_) \___/ \__| \___| \__,_| |_||_| |___/ \__,_| /__/ \___| :: Spring Boot :: (v2.3.9.RELEASE) :: OCP Server :: (v4.0.0-20220930) 2022-12-08 12:39:24.752 INFO 42 --- [ main] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 12:39:26.267 INFO 42 --- [ main] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 12:39:26.716 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : The following profiles are active: composite,default 2022-12-08 12:39:54.123 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:39:55.818 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 1580ms. Found 3 JPA repository interfaces. 2022-12-08 12:39:56.058 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:39:58.145 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 2085ms. Found 16 JPA repository interfaces. 2022-12-08 12:39:58.151 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 12:40:15.275 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 17122ms. Found 99 JPA repository interfaces. 2022-12-08 12:40:23.042 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmEventHistoryRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmEventHistoryRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:23.044 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmGroupAlarmTypeRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmGroupAlarmTypeRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:23.045 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmDetectRuleRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmDetectRuleRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:23.046 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmMetricMetaRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmMetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:23.477 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricGroupRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricGroupRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:23.479 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricObCollectConfigRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricObCollectConfigRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:23.480 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricClassRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricClassRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:23.481 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricMetaRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:24.193 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'sqlAggregateDataRepository' and 'com.alipay.ocp.core.monitordb.alarm.SqlAggregateDataRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:24.194 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obClusterSystemEventRepository' and 'com.alipay.ocp.core.monitordb.ob.ObClusterSystemEventRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:24.196 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obTenantMiniCompactionRepository' and 'com.alipay.ocp.core.monitordb.ob.ObTenantMiniCompactionRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 12:40:25.796 INFO 42 --- [main,,] o.s.cloud.context.scope.GenericScope : BeanFactory id=22bf410e-9c42-33ee-903b-47d732131f72 2022-12-08 12:40:28.716 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler@74fe5966' of type [org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:40:28.719 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'localSecurityConfiguration.MethodSecurityConfiguration' of type [com.alipay.ocp.server.config.security.LocalSecurityConfiguration$MethodSecurityConfiguration$$EnhancerBySpringCGLIB$$499c1cc6] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:40:28.792 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Method-level access control enabled. 2022-12-08 12:40:28.804 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'methodSecurityMetadataSource' of type [org.springframework.security.access.method.DelegatingMethodSecurityMetadataSource] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 12:40:32.240 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 12:40:33.241 INFO 42 --- [main,,] org.hibernate.Version : HHH000412: Hibernate ORM core version 5.4.28.Final 2022-12-08 12:40:35.842 INFO 42 --- [main,,] o.hibernate.annotations.common.Version : HCANN000001: Hibernate Commons Annotations {5.1.2.Final} 2022-12-08 12:40:45.844 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-1,metadb-connect-pool} inited 2022-12-08 12:40:46.212 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:40:50.085 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:40:50.088 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:40:50.089 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 12:40:53.114 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000038: Composite-id class does not override equals(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 12:40:53.116 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000039: Composite-id class does not override hashCode(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 12:41:09.402 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 12:41:09.721 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 12:41:18.365 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8080 (http) 2022-12-08 12:41:18.469 INFO 42 --- [main,,] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2022-12-08 12:41:18.471 INFO 42 --- [main,,] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.43] 2022-12-08 12:41:19.067 INFO 42 --- [main,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2022-12-08 12:41:19.068 INFO 42 --- [main,,] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 112068 ms 2022-12-08 12:41:28.089 INFO 42 --- [main,,] c.a.o.service.maz.OcpMultiAzoneService : OCP multi-azone not enabled 2022-12-08 12:41:28.109 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set username=monitor_user@monitor_tenant#obcluster 2022-12-08 12:41:28.111 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set url=jdbc:oceanbase://192.168.28.54:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true 2022-12-08 12:41:28.113 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set driver class=com.oceanbase.jdbc.Driver 2022-12-08 12:41:28.478 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 12:41:33.616 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-2,monitordb-connect-pool} inited 2022-12-08 12:41:33.618 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:41:35.543 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 12:41:35.545 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 12:41:37.128 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/meta 2022-12-08 12:41:38.108 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Finish migration, location=migration/meta 2022-12-08 12:41:38.109 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/monitor 2022-12-08 12:41:38.111 INFO 42 --- [main,,] com.alipay.ocp.core.util.ResourceUtils : Cannot find any file in location: migration/monitor 2022-12-08 12:41:38.112 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Migration schemas is empty. 2022-12-08 12:42:20.960 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 22922 ms to scan 31 urls, producing 672 keys and 5542 values 2022-12-08 12:42:40.802 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 19397 ms to scan 31 urls, producing 73 keys and 4708 values 2022-12-08 12:42:40.857 INFO 42 --- [main,,] c.a.o.server.analyzer.OcpStartUpChecker : audit event is disable 2022-12-08 12:42:43.001 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : ocp-monitor bean configuration done 2022-12-08 12:42:49.090 INFO 42 --- [main,,] c.a.ocp.server.config.BeanConfiguration : begin set auto discover false. 2022-12-08 12:42:49.110 INFO 42 --- [main,,] c.a.ocp.server.config.BeanConfiguration : set auto discover false success. 2022-12-08 12:42:51.487 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Validate and set keys, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCmKEJV3mbaJH2oW7yTVE1NiJWrXzMS8SnAlPUTiZVZm5Lb/00BUhwEhiOsVyihLHkAZRTfgmmyxpBoOZkFsAUmD5Gkc1b9tdgH/cImSbxnsdssxYE28miDmXthxJhqadHkdqOqMOAQictyWUHRiOFryzIFz0dUew/lSdZult/OoQIDAQAB, valid=true 2022-12-08 12:42:51.487 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Login key is legal. 2022-12-08 12:42:52.528 INFO 42 --- [main,,] c.a.o.s.s.operator.LocalFileOperator : FileStorageService init, fileDirPath=/home/admin/data/files 2022-12-08 12:43:01.146 INFO 42 --- [main,,] com.alipay.ocp.core.util.BeanUtils : BeanUtils initialized 2022-12-08 12:43:03.293 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:43:03.303 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:43:03.303 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:43:03.304 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:43:05.098 INFO 42 --- [main,,] c.a.o.s.a.c.AlarmConfigurationManager : defaultTimeZone not set, use system default, zoneId=Asia/Shanghai 2022-12-08 12:43:05.760 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_daily, createTime=1670472339 2022-12-08 12:43:05.823 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_hour, createTime=1670472331 2022-12-08 12:43:05.900 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_second, createTime=1670472289 2022-12-08 12:43:10.065 INFO 42 --- [main,,] c.a.o.s.a.core.silence.GlobalSilencer : enabled alarm types changed, previous=, current=ob_server_sstable_percent_over_threshold,ob_host_task_timeout,ob_tenant_long_trans_exist,ob_host_net_send_percent_over_threshold,host_agent_goroutine_count_over_threshold,backup_storage_capacity_over_threshold,os_tsar_traffic_drop,tenant_active_memstore_percent_over_threshold,ob_host_data_disk_percent_over_threshold,os_tsar_cpu_util_full,tenant_cpu_percent_over_threshold,ob_tenant_exists_expired_xa_trans,monitor_exporter_unavaliable,ob_tenant_compaction_error,os_tsar_cpu_util_hwm,ob_cluster_exists_inactive_server,os_tsar_traffic_error,ob_host_load1_per_cpu_over_threshold,ob_cluster_operation_info,ob_cluster_frozen_version_delta_over_threshold,ob_cluster_merge_error,no_enough_exporter,backup_storage_capacity_timeout_or_interrupted,ob_tenant_large_trans_exist,inc_backup_delay,host_unavailable,ob_host_mem_percent_over_threshold,os_observer_not_exist,system_obproxy_unavailable,ocp_remote_server_time_diff_too_large,host_ntp_service_not_exist,ob_tenant_expired_trans_exist,host_disk_readonly,node_file_root_usage,os_kernel_io_hang,ob_tenant_task_timeout,same_alarm_rule_detect_too_many_targets,os_tsar_sda_ioawait,ob_log_alarm,os_tsar_traffic_overload,ob_cluster_sync_delay_time_too_long,os_tsar_nvme_ioawait,tenant_memstore_percent_over_threshold,ob_cluster_merge_timeout,ob_zone_sstable_percent_over_threshold,obproxy_cannot_connected,partition_create_failed,node_file_inode_usage,obproxy_process_dead,ob_cluster_rs_not_same,os_tsar_cpu_sys_abnormal,ob_cluster_exists_index_fail_table,ob_tenant_operation_info,host_ntp_offset_too_large,os_nic_1000m_hwm,ob_cluster_no_frozen,ob_host_cpu_percent_over_threshold,ob_cpu_percent_over_threshold,base_backup_too_long_time_no_one_success_task,oms_migrate_delay_over_threshold,vpc_connect_failed,ob_host_disk_readonly,ob_host_net_recv_percent_over_threshold,os_cpu_irq_error,ob_host_connection_percent_over_threshold,ob_cluster_status_check_failed,ocp_local_obproxy_proxyro_user_password_not_same,ob_tenant_no_compaction,host_agent_res_memory_over_threshold,host_agent_open_fd_count_over_threshold,ob_cluster_no_merge,backup_storage_capacity_retry_times_exceeded,obproxyd_process_dead,ob_tenant_log_disk_usage_high,ob_cluster_sync_failed,ob_tenant_no_frozen,ob_tenant500_mem_hold_over_threshold,os_observer_fd_usage,backup_process_dead,ob_cannot_connected,ob_host_tcp_retrans_percent_over_threshold,ob_host_log_disk_percent_over_threshold,ob_host_install_disk_percent_over_threshold,ic_server_connect_failed,os_nic_1000m_full,ob_tenant500_mem_hold_percent_over_threshold,base_backup_fail,os_observer_core_dump,ob_cluster_inspection_not_passed,obagent_dead,ob_host_partition_count_over_threshold 2022-12-08 12:43:11.921 INFO 42 --- [main,,] c.a.o.c.t.e.coordinator.TaskCoordinator : Start task coordinator 2022-12-08 12:43:16.156 INFO 42 --- [main,,] c.a.o.s.a.service.OcpAlarmSearchService : total load alarm history size: 0 2022-12-08 12:43:16.158 INFO 42 --- [main,,] c.a.o.s.a.service.OcpAlarmSearchService : init alarm search done 2022-12-08 12:43:21.405 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2022-12-08 12:43:21.661 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2022-12-08 12:43:21.735 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 12:43:21.770 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 12:43:22.465 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2022-12-08 12:43:22.600 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2022-12-08 12:43:22.626 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 12:43:22.634 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 12:43:22.639 INFO 42 --- [main,,] c.o.o.b.i.c.BackupConfiguration : init backup agent meta cfg 2022-12-08 12:43:22.998 INFO 42 --- [main,,] c.a.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key global_lock_com.oceanbase.ocp.backup.internal.task.backupocptaskmanager 2022-12-08 12:43:23.026 INFO 42 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : upgradeFromOldAgentToNewService start. 2022-12-08 12:43:23.042 INFO 42 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : serviceInfos=[], allMachineList=[] 2022-12-08 12:43:23.153 INFO 42 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : register backup schedules success 2022-12-08 12:43:27.489 INFO 42 --- [main,,] .a.o.s.m.c.MonitorDataRolloverProperties : Monitor retention conf is {ob_cluster_system_event=31, ocp_metric_data_1=8, ocp_metric_data_60=31, metric_hour_data=1098, metric_daily_data=1098} 2022-12-08 12:43:27.789 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Metadb, table=profile_credential_sharing 2022-12-08 12:43:27.790 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_cluster_system_event 2022-12-08 12:43:27.791 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_1 2022-12-08 12:43:27.791 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_60 2022-12-08 12:43:27.791 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_hour_data 2022-12-08 12:43:27.792 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_daily_data 2022-12-08 12:43:27.792 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_second 2022-12-08 12:43:27.793 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_minute 2022-12-08 12:43:27.793 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_hour 2022-12-08 12:43:27.793 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_daily 2022-12-08 12:43:27.794 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=sql_aggregate_data 2022-12-08 12:43:27.794 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_partition_stats_compressed 2022-12-08 12:43:27.794 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_tenant_mini_compaction_info 2022-12-08 12:43:27.795 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_0 2022-12-08 12:43:27.795 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_1 2022-12-08 12:43:27.796 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_2 2022-12-08 12:43:27.796 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat 2022-12-08 12:43:27.797 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sqltext 2022-12-08 12:43:27.797 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0 2022-12-08 12:43:27.797 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan 2022-12-08 12:43:27.798 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_explain 2022-12-08 12:43:27.798 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_sample 2022-12-08 12:43:27.799 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis_task 2022-12-08 12:43:27.800 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis 2022-12-08 12:43:27.800 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_active_session_stat_0 2022-12-08 12:43:27.801 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_snapshot 2022-12-08 12:43:27.801 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cluster 2022-12-08 12:43:27.801 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_tenant 2022-12-08 12:43:27.802 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_server 2022-12-08 12:43:27.802 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_replica 2022-12-08 12:43:27.802 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sysstat 2022-12-08 12:43:27.803 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_row_lock 2022-12-08 12:43:27.803 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_latch 2022-12-08 12:43:27.804 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cache 2022-12-08 12:43:27.804 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_parameter 2022-12-08 12:43:27.804 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_rpc 2022-12-08 12:43:27.805 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_packet 2022-12-08 12:43:27.805 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_clog 2022-12-08 12:43:27.806 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_location_cache 2022-12-08 12:43:27.806 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_gts 2022-12-08 12:43:27.806 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_system_event 2022-12-08 12:43:27.807 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_plan_monitor 2022-12-08 12:43:27.808 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_trans_stat_0 2022-12-08 12:43:27.821 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167004] Submitting initial worker 2022-12-08 12:43:27.951 INFO 42 --- [main,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService updater scheduler started on 192.168.28.62:8080 2022-12-08 12:43:27.991 INFO 42 --- [main,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : Init, apiConnectTimeoutMillis:1000, apiReadTimeoutMillis:1000, taskSchedulePeriodSec:3 2022-12-08 12:43:28.579 WARN 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : Error state, the follower found itself leader. 2022-12-08 12:43:28.580 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2022-12-08 12:43:29.127 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_minute, createTime=1670472326 2022-12-08 12:43:29.378 INFO 42 --- [main,,] c.o.o.b.i.m.s.StorageExporterServiceImpl : collectEnabled=true,periodMinutes=180, register backup exporter. 2022-12-08 12:43:29.729 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : scheduleEnabled=true 2022-12-08 12:43:29.784 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : initialize global tasks done 2022-12-08 12:43:29.785 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : initialize done 2022-12-08 12:43:31.540 WARN 42 --- [main,,] JpaBaseConfiguration$JpaWebConfiguration : spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning 2022-12-08 12:43:31.585 WARN 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : Error state, the follower found itself leader. 2022-12-08 12:43:31.586 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2022-12-08 12:43:32.955 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:43:33.205 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=CMDB_SYNCER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:03+08:00, updateTime=2022-12-08T12:14:49+08:00, expireTime=null, isLeader=false} 2022-12-08 12:43:33.478 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=MC_MANAGER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:03+08:00, updateTime=2022-12-08T12:14:56+08:00, expireTime=null, isLeader=false} 2022-12-08 12:43:33.576 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PERF_SQL_ROLLUP, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:03+08:00, updateTime=2022-12-08T12:14:43+08:00, expireTime=null, isLeader=false} 2022-12-08 12:43:33.809 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:11:38+08:00, updateTime=2022-12-08T12:14:38+08:00, expireTime=null, isLeader=false} 2022-12-08 12:43:34.084 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=RATE_LIMIT, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:03+08:00, updateTime=2022-12-08T12:14:50+08:00, expireTime=null, isLeader=false} 2022-12-08 12:43:34.258 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:12:08+08:00, updateTime=2022-12-08T12:14:38+08:00, expireTime=null, isLeader=false} 2022-12-08 12:43:34.296 INFO 42 --- [main,,] c.a.o.s.o.ob.ObMetricCollectService : ObMetricCollectService init, aggConfigList:[{"aggFunc":"max","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_cpu_percent","targetMetric":"ob_tenant_server_max_cpu_used_percentage"},{"aggFunc":"max","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_memory_percent","targetMetric":"ob_tenant_server_max_memory_used_percentage"},{"aggFunc":"avg","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_cpu_percent","targetMetric":"ob_tenant_server_avg_cpu_used_percentage"},{"aggFunc":"avg","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_memory_percent","targetMetric":"ob_tenant_server_avg_memory_used_percentage"}] 2022-12-08 12:43:34.380 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:14:39+08:00, updateTime=2022-12-08T12:14:39+08:00, expireTime=null, isLeader=false} 2022-12-08 12:43:34.496 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=TASK_MANAGER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:03+08:00, updateTime=2022-12-08T12:14:49+08:00, expireTime=null, isLeader=false} 2022-12-08 12:43:34.504 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:43:34.592 WARN 42 --- [pool-3-thread-1,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2022-12-08 12:43:34.593 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2022-12-08 12:43:34.642 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:43:34.650 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service MC_MANAGER, Incorrect result size: expected 1, actual 0 2022-12-08 12:43:34.754 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:43:34.773 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PERF_SQL_ROLLUP, Incorrect result size: expected 1, actual 0 2022-12-08 12:43:34.830 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:43:34.839 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service CMDB_SYNCER, Incorrect result size: expected 1, actual 0 2022-12-08 12:43:34.892 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:43:34.901 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service TASK_MANAGER, Incorrect result size: expected 1, actual 0 2022-12-08 12:43:34.957 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:43:34.967 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2022-12-08 12:43:35.018 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:43:35.028 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 12:43:35.190 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:43:35.207 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:43:36.328 INFO 42 --- [main,,] .o.s.m.o.c.ClusterSystemEventServiceImpl : Init eventTemplateCache: 172 cache entries, 172 elements. 2022-12-08 12:43:36.510 INFO 42 --- [main,,] c.a.o.s.a.c.AlarmConfiguration : alarm configuration set from system properties 2022-12-08 12:43:36.715 INFO 42 --- [main,,] c.a.o.s.a.c.n.NotificationSender : NotificationSender init, scriptDirectoryPath=/home/admin/ocp-server/alarm-channel-script 2022-12-08 12:43:36.957 INFO 42 --- [main,,] c.a.o.s.a.c.d.metrics.AlarmMetricsQuery : createMetricMetaMapping done, metasCount=88 2022-12-08 12:43:37.419 INFO 42 --- [main,,] c.a.o.s.a.c.d.metrics.SqlMetricsQuery : createMetricMetaMapping done, metasCount=88 2022-12-08 12:43:37.754 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 gets the leadership... 2022-12-08 12:43:40.756 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:43:40.796 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:43:42.097 INFO 42 --- [main,,] c.a.o.s.alarm.schedule.AlarmSchedules : AlarmSchedules construct done 2022-12-08 12:43:42.192 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 12:43:42.194 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize alarmDetectMetricExecutor 2022-12-08 12:43:42.198 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 'alarmDetectMetricExecutor' 2022-12-08 12:43:42.277 INFO 42 --- [main,,] o.s.s.concurrent.ThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 12:43:42.278 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize alarmTaskExecutor 2022-12-08 12:43:42.279 INFO 42 --- [main,,] o.s.s.concurrent.ThreadPoolTaskExecutor : Initializing ExecutorService 'alarmTaskExecutor' 2022-12-08 12:43:42.297 INFO 42 --- [main,,] c.a.o.s.a.utils.task.AlarmTaskManager : alarm task manager construct done, executorName=192.168.28.62:42 2022-12-08 12:43:42.365 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : OcpMonitorManager init start... 2022-12-08 12:43:42.373 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670474640, interval=60 2022-12-08 12:43:42.376 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670475600, interval=3600 2022-12-08 12:43:42.378 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670474640, interval=60 2022-12-08 12:43:42.380 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670475600, interval=3600 2022-12-08 12:43:42.392 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : OcpMonitorManager init success. 2022-12-08 12:43:42.656 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 12:43:42.658 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize notificationSendExecutor 2022-12-08 12:43:42.659 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 'notificationSendExecutor' 2022-12-08 12:43:42.797 INFO 42 --- [main,,] c.a.o.s.dataclean.TableCleaningService : Successfully init all table cleaning configurations: {"cleanTaskInstance":{"batchIntervalMillis":0,"batchSize":0,"condition":"create_time <= date_sub(now(), interval 30 day) and type = \"SYS_SCHEDULED\"","priority":1,"tableName":"task_instance"},"cleanSubTaskInstance":{"batchIntervalMillis":0,"batchSize":0,"condition":"task_id in (select id from task_instance where create_time <= date_sub(now(), interval 30 day) and type = \"SYS_SCHEDULED\")","priority":0,"tableName":"subtask_instance"}} 2022-12-08 12:43:43.038 INFO 42 --- [part-initial-worker,,] c.a.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2022-12-08 12:43:43.040 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2022-12-08 12:43:43.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=proxy, clusterName=obcluster, obClusterId=null, tenantName=monitor_tenant, username=monitor_user, address=192.168.28.54, port=2883, database=monitor_database) 2022-12-08 12:43:43.067 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=monitor_user, tenantName=monitor_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=monitor_database) 2022-12-08 12:43:43.151 INFO 42 --- [obsdk-init-thread-1,,ac5fc6d96a6e] com.alibaba.druid.pool.DruidDataSource : {dataSource-3,ob-connector-datasource_proxy_obcluster_null_monitor_tenant_monitor_user_192.168.28.54_2883} inited 2022-12-08 12:43:43.160 INFO 42 --- [obsdk-init-thread-1,,ac5fc6d96a6e] c.a.o.c.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=monitor_user, tenantName=monitor_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=monitor_database) 2022-12-08 12:43:43.163 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2022-12-08 12:43:43.175 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.196 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.207 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.213 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2022-12-08 12:43:43.237 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.238 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.242 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.252 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.252 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.256 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2022-12-08 12:43:43.346 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.347 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.351 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.358 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.359 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.365 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2022-12-08 12:43:43.390 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.391 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.395 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.402 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.403 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.407 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2022-12-08 12:43:43.434 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.435 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.439 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.445 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.446 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.450 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2022-12-08 12:43:43.477 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.478 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.482 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.489 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.490 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2022-12-08 12:43:43.518 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.519 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.524 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.540 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.540 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.544 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2022-12-08 12:43:43.594 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.595 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.598 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.604 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.605 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.608 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2022-12-08 12:43:43.691 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.691 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.695 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.704 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.708 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.713 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2022-12-08 12:43:43.741 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.742 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.752 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.759 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.760 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.769 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2022-12-08 12:43:43.799 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:43:43.804 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.805 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.806 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:43:43.810 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.820 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.821 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.826 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2022-12-08 12:43:43.837 INFO 42 --- [main,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updater scheduler started on 192.168.28.62:8080 2022-12-08 12:43:43.850 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.851 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.857 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.866 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.867 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.871 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2022-12-08 12:43:43.893 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.894 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.899 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.905 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.906 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.909 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2022-12-08 12:43:43.936 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.936 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.939 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:43.945 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:43.945 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:43.948 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2022-12-08 12:43:44.002 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.003 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.006 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.012 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.012 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.016 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2022-12-08 12:43:44.068 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.069 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.072 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.078 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.079 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.083 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2022-12-08 12:43:44.124 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.125 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.136 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.137 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.141 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2022-12-08 12:43:44.193 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.194 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.197 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.202 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.print.sql = true 2022-12-08 12:43:44.204 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.205 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set sqlLogEnabled=true 2022-12-08 12:43:44.205 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.208 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2022-12-08 12:43:44.212 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.max-idle.seconds = 3600 2022-12-08 12:43:44.233 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.233 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set maxIdleSeconds=3600 2022-12-08 12:43:44.233 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.237 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.241 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.cleanup.period.seconds = 300 2022-12-08 12:43:44.241 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set cleanPeriod=300 2022-12-08 12:43:44.244 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.244 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.248 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2022-12-08 12:43:44.249 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.operation.global.timeout.millis = 300000 2022-12-08 12:43:44.250 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set ddlGlobalTimeoutMillis=300000 2022-12-08 12:43:44.257 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.timeout.millis = 3000 2022-12-08 12:43:44.258 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set initTimeoutMillis=3000 2022-12-08 12:43:44.265 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.slow.query.threshold.millis = 1000 2022-12-08 12:43:44.266 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set slowQueryThresholdMillis=1000 2022-12-08 12:43:44.272 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.holder.capacity = 100 2022-12-08 12:43:44.276 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.277 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.280 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.281 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set cacheSize=100 2022-12-08 12:43:44.287 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.287 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.288 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.read.timeout.millis = 1800000 2022-12-08 12:43:44.289 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketReadTimeoutMillis=1800000 2022-12-08 12:43:44.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2022-12-08 12:43:44.296 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.executor.thread-count = 16 2022-12-08 12:43:44.297 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketInitThreadCount=16 2022-12-08 12:43:44.305 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.connect.timeout.millis = 2000 2022-12-08 12:43:44.305 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketConnectTimeoutMillis=2000 2022-12-08 12:43:44.320 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.321 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.325 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.331 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.332 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2022-12-08 12:43:44.363 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.363 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.367 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.374 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.374 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.378 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2022-12-08 12:43:44.387 INFO 42 --- [main,,] c.a.o.service.maz.OcpAzoneDaemonService : Multi azone daemon not enabled 2022-12-08 12:43:44.421 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.422 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.426 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.438 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.438 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.441 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2022-12-08 12:43:44.478 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.479 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.483 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.490 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.490 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2022-12-08 12:43:44.531 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.532 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.535 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.539 INFO 42 --- [main,,] c.a.o.s.s.BuiltInFilesInitializeLoader : Load lib files, localBuiltInDir=/home/admin/ocp-server/lib 2022-12-08 12:43:44.540 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Remove built-in file:pos.py 2022-12-08 12:43:44.542 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.543 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.546 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2022-12-08 12:43:44.679 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.679 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.683 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.690 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.691 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.695 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2022-12-08 12:43:44.721 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.722 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.726 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.733 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.734 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.739 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2022-12-08 12:43:44.755 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:43:44.764 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.765 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.768 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Delete object, bucket=built-in, name=pos.py, objectId=1 2022-12-08 12:43:44.769 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.776 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.777 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2022-12-08 12:43:44.816 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.817 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.824 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.831 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.831 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2022-12-08 12:43:44.865 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.866 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.874 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.884 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.886 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.893 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:43:44.900 INFO 42 --- [main,,] c.a.o.s.s.operator.ObjectBlockOperator : deleteByFileId, deletedBlockCount=1 2022-12-08 12:43:44.904 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2022-12-08 12:43:44.931 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.931 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.938 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:44.956 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.957 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.957 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:43:44.960 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2022-12-08 12:43:44.984 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:44.985 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:44.989 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.001 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.001 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.005 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2022-12-08 12:43:45.018 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:43:45.034 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.034 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.038 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.050 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.051 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.055 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2022-12-08 12:43:45.086 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.086 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.093 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.104 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.105 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.108 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2022-12-08 12:43:45.129 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.132 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.137 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.138 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.140 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2022-12-08 12:43:45.163 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.164 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.167 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.172 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.173 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.176 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2022-12-08 12:43:45.197 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.198 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.201 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.207 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.208 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.211 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2022-12-08 12:43:45.230 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.231 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.234 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.239 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.239 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.242 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2022-12-08 12:43:45.264 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.264 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.268 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.274 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.274 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.277 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2022-12-08 12:43:45.297 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.301 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.306 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.307 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.310 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2022-12-08 12:43:45.328 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.329 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.332 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.338 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.338 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.341 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2022-12-08 12:43:45.360 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.361 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.364 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.369 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.370 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.373 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2022-12-08 12:43:45.406 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.406 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.412 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.421 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.422 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.425 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_0 2022-12-08 12:43:45.472 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2022-12-08 12:43:45.472 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2022-12-08 12:43:45.473 INFO 42 --- [part-initial-worker,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=proxy, clusterName=obcluster, obClusterId=null, tenantName=meta_tenant, username=meta_user, address=192.168.28.54, port=2883, database=meta_database) 2022-12-08 12:43:45.473 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=meta_user, tenantName=meta_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=meta_database) 2022-12-08 12:43:45.515 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Load built-in file:pos.py 2022-12-08 12:43:45.515 INFO 42 --- [obsdk-init-thread-2,,fddef888bb0a] com.alibaba.druid.pool.DruidDataSource : {dataSource-4,ob-connector-datasource_proxy_obcluster_null_meta_tenant_meta_user_192.168.28.54_2883} inited 2022-12-08 12:43:45.516 INFO 42 --- [obsdk-init-thread-2,,fddef888bb0a] c.a.o.c.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=meta_user, tenantName=meta_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=meta_database) 2022-12-08 12:43:45.517 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2022-12-08 12:43:45.517 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.522 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.522 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.526 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2022-12-08 12:43:45.535 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.535 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.538 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 12:43:45.545 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 12:43:45.545 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 12:43:45.549 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2022-12-08 12:43:45.572 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2022-12-08 12:43:46.149 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=built-in, name=pos.py, objectId=6 2022-12-08 12:43:46.807 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:43:46.812 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:43:46.890 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=6, name=pos.py 2022-12-08 12:43:46.890 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Remove built-in file:obproxyd.sh 2022-12-08 12:43:46.921 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Delete object, bucket=built-in, name=obproxyd.sh, objectId=2 2022-12-08 12:43:46.941 INFO 42 --- [main,,] c.a.o.s.s.operator.ObjectBlockOperator : deleteByFileId, deletedBlockCount=1 2022-12-08 12:43:46.996 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Load built-in file:obproxyd.sh 2022-12-08 12:43:47.156 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=built-in, name=obproxyd.sh, objectId=7 2022-12-08 12:43:47.459 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=7, name=obproxyd.sh 2022-12-08 12:43:47.492 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:libaio-0.3.112-1.el8.x86_64.rpm 2022-12-08 12:43:47.597 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Software package already exist, name=libaio-0.3.112-1.el8.x86_64.rpm 2022-12-08 12:43:47.597 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:t-oceanbase-ocp-agent-4.0.0-20221104145832.alios7.aarch64.rpm 2022-12-08 12:43:47.635 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Software package already exist, name=t-oceanbase-ocp-agent-4.0.0-20221104145832.alios7.aarch64.rpm 2022-12-08 12:43:47.635 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:t-oceanbase-ocp-agent-4.0.0-20221104150026.alios7.x86_64.rpm 2022-12-08 12:43:47.675 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Software package already exist, name=t-oceanbase-ocp-agent-4.0.0-20221104150026.alios7.x86_64.rpm 2022-12-08 12:43:48.840 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:43:48.984 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.server.DefaultServerUpdater : Deleted expired server: DistributedServer{id=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:03:20+08:00, updateTime=2022-12-08T12:14:50+08:00, expireTime=2022-12-08T12:15:20+08:00, isActive=false} 2022-12-08 12:43:49.813 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:43:49.819 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:43:49.831 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:43:50.235 INFO 42 --- [main,,] f.a.AutowiredAnnotationBeanPostProcessor : Autowired annotation is not supported on static methods: public static void com.alipay.ocp.core.util.jpa.JsonNodeConverter.init(com.fasterxml.jackson.databind.ObjectMapper) 2022-12-08 12:43:50.579 INFO 42 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup daemon submitted 2022-12-08 12:43:50.581 INFO 42 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup workers submitted 2022-12-08 12:43:52.820 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:43:52.826 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:43:54.816 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:43:55.058 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:43:55.139 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:43:55.471 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:43:55.827 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:43:55.836 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:43:57.923 INFO 42 --- [main,,] c.a.o.core.sharding.ShardingCoordinator : Sharding registry started, module=metric-collect 2022-12-08 12:43:58.837 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:43:58.848 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:43:59.227 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:44:01.850 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:01.856 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:01.961 INFO 42 --- [main,,] c.a.o.c.t.engine.util.ThreadPrintStream : replaceSystemOut done 2022-12-08 12:44:01.972 INFO 42 --- [main,,] c.a.o.c.t.e.c.SubtaskCoordinator : Start subtask coordinator 2022-12-08 12:44:03.480 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:44:03.494 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:44:03.954 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:03.955 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:04.500 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:44:04.643 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:44:04.857 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:04.863 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:05.078 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:44:05.219 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:05.359 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:44:05.488 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:44:05.552 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:44:05.708 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:06.189 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:44:07.466 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:44:07.467 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:44:07.482 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:44:07.483 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:44:07.864 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:07.872 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:09.278 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:44:10.268 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:44:10.275 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:44:10.428 INFO 42 --- [main,,] o.s.b.a.w.s.WelcomePageHandlerMapping : Adding welcome page: class path resource [static/index.html] 2022-12-08 12:44:10.873 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:10.878 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:11.420 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:11.438 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:11.754 WARN 42 --- [main,,] ion$DefaultTemplateResolverConfiguration : Cannot find template location: classpath:/templates/ (please add some templates or check your Thymeleaf configuration) 2022-12-08 12:44:11.978 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:44:12.143 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:06.0, nextRun=2022-12-08 12:15:05.0, currentDate=Thu Dec 08 12:44:12 CST 2022 2022-12-08 12:44:12.145 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 12:14:06.0, nextRunTime=2022-12-08 12:15:05.0} 2022-12-08 12:44:12.275 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 12:44:12.287 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:12.288 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:12.456 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:21.0, nextRun=2022-12-08 12:15:20.0, currentDate=Thu Dec 08 12:44:12 CST 2022 2022-12-08 12:44:12.457 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:14:21.0, nextRunTime=2022-12-08 12:15:20.0} 2022-12-08 12:44:12.479 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:44:12.480 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:12.480 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:12.816 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:25.0, nextRun=2022-12-08 12:15:25.0, currentDate=Thu Dec 08 12:44:12 CST 2022 2022-12-08 12:44:12.817 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:14:25.0, nextRunTime=2022-12-08 12:15:25.0} 2022-12-08 12:44:13.123 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:44:13.123 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:13.123 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:13.280 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:01.0, nextRun=2022-12-08 12:20:00.0, currentDate=Thu Dec 08 12:44:13 CST 2022 2022-12-08 12:44:13.281 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=12, name=Refresh agent config, templateName=RefreshAgentConfigSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 12:10:01.0, nextRunTime=2022-12-08 12:20:00.0} 2022-12-08 12:44:13.300 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Refresh agent config, nodeCount=1, taskCount=1 2022-12-08 12:44:13.301 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:13.301 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Refresh agent config, taskDefinitionId=12, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:13.440 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:01.0, nextRun=2022-12-08 12:16:00.0, currentDate=Thu Dec 08 12:44:13 CST 2022 2022-12-08 12:44:13.441 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 12:14:01.0, nextRunTime=2022-12-08 12:16:00.0} 2022-12-08 12:44:13.544 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 12:44:13.868 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:01.0, nextRun=2022-12-08 12:20:00.0, currentDate=Thu Dec 08 12:44:13 CST 2022 2022-12-08 12:44:13.869 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=15, name=Sync system event, templateName=SyncSystemEventSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 12:10:01.0, nextRunTime=2022-12-08 12:20:00.0} 2022-12-08 12:44:13.881 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:13.885 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:13.903 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync system event 2022-12-08 12:44:14.147 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:31.0, nextRun=2022-12-08 12:15:30.0, currentDate=Thu Dec 08 12:44:14 CST 2022 2022-12-08 12:44:14.148 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:14:31.0, nextRunTime=2022-12-08 12:15:30.0} 2022-12-08 12:44:14.181 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:44:14.347 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:01.0, nextRun=2022-12-08 12:15:00.0, currentDate=Thu Dec 08 12:44:14 CST 2022 2022-12-08 12:44:14.348 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 12:10:01.0, nextRunTime=2022-12-08 12:15:00.0} 2022-12-08 12:44:14.378 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 12:44:14.378 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:14.379 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:14.481 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:01.0, nextRun=2022-12-08 12:15:00.0, currentDate=Thu Dec 08 12:44:14 CST 2022 2022-12-08 12:44:14.482 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 12:10:01.0, nextRunTime=2022-12-08 12:15:00.0} 2022-12-08 12:44:14.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:44:14.569 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:44:14.604 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:44:14.604 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:44:15.359 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:15.715 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:44:16.176 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 12:44:16.176 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 12:44:16.189 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:16.689 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:01.0, nextRun=2022-12-08 12:15:00.0, currentDate=Thu Dec 08 12:44:16 CST 2022 2022-12-08 12:44:16.690 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:14:01.0, nextRunTime=2022-12-08 12:15:00.0} 2022-12-08 12:44:16.722 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:44:16.723 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:16.723 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:16.840 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:01.0, nextRun=2022-12-08 12:15:00.0, currentDate=Thu Dec 08 12:44:16 CST 2022 2022-12-08 12:44:16.841 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:14:01.0, nextRunTime=2022-12-08 12:15:00.0} 2022-12-08 12:44:16.885 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:44:16.886 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:16.886 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:16.887 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:16.896 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:17.046 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:44:17.125 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:02.0, nextRun=2022-12-08 12:15:00.0, currentDate=Thu Dec 08 12:44:17 CST 2022 2022-12-08 12:44:17.126 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:14:02.0, nextRunTime=2022-12-08 12:15:00.0} 2022-12-08 12:44:17.161 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 12:44:17.161 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:17.162 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:17.295 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:44:17.303 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:44:17.327 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:32.0, nextRun=2022-12-08 12:15:00.0, currentDate=Thu Dec 08 12:44:17 CST 2022 2022-12-08 12:44:17.328 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:14:32.0, nextRunTime=2022-12-08 12:15:00.0} 2022-12-08 12:44:17.350 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:44:17.350 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:17.350 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:17.492 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:10:02.0, nextRun=2022-12-08 12:15:00.0, currentDate=Thu Dec 08 12:44:17 CST 2022 2022-12-08 12:44:17.492 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 12:10:02.0, nextRunTime=2022-12-08 12:15:00.0} 2022-12-08 12:44:17.513 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 12:44:17.513 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:17.513 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:17.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:17.678 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:14:02.0, nextRun=2022-12-08 12:15:00.0, currentDate=Thu Dec 08 12:44:17 CST 2022 2022-12-08 12:44:17.679 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:14:02.0, nextRunTime=2022-12-08 12:15:00.0} 2022-12-08 12:44:17.761 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:18.035 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:44:19.625 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:44:19.897 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:19.903 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:20.220 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:44:20.580 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 12:44:20.607 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=26ms, period=120000ms 2022-12-08 12:44:20.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:44:20.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:44:21.000 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:44:21.001 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:44:22.840 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:44:22.842 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:22.842 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:22.904 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:22.910 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:23.279 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:44:23.288 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:44:23.979 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:24.088 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:24.261 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:12.0, nextRun=2022-12-08 12:44:20.0, currentDate=Thu Dec 08 12:44:24 CST 2022 2022-12-08 12:44:24.262 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 12:44:12.0, nextRunTime=2022-12-08 12:44:20.0} 2022-12-08 12:44:24.286 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 12:44:24.287 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:24.287 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:24.375 INFO 42 --- [pool-prometheus-minute-schedule-1,,48ac5471645e] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670474700, interval=60 2022-12-08 12:44:24.380 INFO 42 --- [pool-prometheus-minute-schedule-1,,48ac5471645e] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670474664, count=0, elapsed=1668804189716 2022-12-08 12:44:24.382 INFO 42 --- [pool-prometheus-minute-schedule-1,,a9cc6faeb7c0] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670474700, interval=60 2022-12-08 12:44:24.382 INFO 42 --- [pool-prometheus-minute-schedule-1,,a9cc6faeb7c0] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670474664, count=0, elapsed=1668804189718 2022-12-08 12:44:24.722 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:44:24.942 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Local JDBC authentication enabled: whiteList [/api/status.*, /api/v2/time, /api/v2/mc/info, /api/v2/loginKey, .*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|GetObRootServiceInfoUrlTemplate).*, performance/ash/reports/.*/data], basicAuth true, CSRF true 2022-12-08 12:44:24.948 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/assets/**'], [] 2022-12-08 12:44:24.948 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/index.html'], [] 2022-12-08 12:44:24.949 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.js'], [] 2022-12-08 12:44:24.949 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.css'], [] 2022-12-08 12:44:24.949 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/webjars/**'], [] 2022-12-08 12:44:24.949 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.svg'], [] 2022-12-08 12:44:25.715 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:25.811 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:13.0, nextRun=2022-12-08 12:44:25.0, currentDate=Thu Dec 08 12:44:25 CST 2022 2022-12-08 12:44:25.812 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 12:44:13.0, nextRunTime=2022-12-08 12:44:25.0} 2022-12-08 12:44:25.881 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 12:44:25.881 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:25.882 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:25.911 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:25.916 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:26.053 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:44:26.520 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: com.alipay.ocp.server.config.security.BasicAuthenticationSecurityConfiguration$$Lambda$2024/65461975@5ec5f4ab, [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@10ab6440, org.springframework.security.web.context.SecurityContextPersistenceFilter@6f29ac2, org.springframework.security.web.header.HeaderWriterFilter@3f8b8746, org.springframework.security.web.authentication.logout.LogoutFilter@70cf87c, com.alipay.ocp.server.authentication.PreAuthenticationFilter@66c9aca2, org.springframework.security.oauth2.server.resource.web.BearerTokenAuthenticationFilter@4fa22da7, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@472bb137, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@16381fd, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@7210af32, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@339ae5bb, org.springframework.security.web.session.SessionManagementFilter@42c9b9f5, org.springframework.security.web.access.ExceptionTranslationFilter@22173fe8, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@3609ab79] 2022-12-08 12:44:26.683 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:26.738 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: any request, [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@68154374, org.springframework.security.web.context.SecurityContextPersistenceFilter@27bb53a1, org.springframework.security.web.header.HeaderWriterFilter@4d142140, org.springframework.security.web.csrf.CsrfFilter@3ce11cf5, org.springframework.security.web.authentication.logout.LogoutFilter@15fb9174, com.alipay.ocp.server.authentication.PreAuthenticationFilter@66c9aca2, org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter@1aab59a4, org.springframework.security.oauth2.server.resource.web.BearerTokenAuthenticationFilter@28b359bf, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@496ca244, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@251e8408, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@3bd27dd9, org.springframework.security.web.session.SessionManagementFilter@79a68aa3, org.springframework.security.web.access.ExceptionTranslationFilter@37db2c4e, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@2ce9de5] 2022-12-08 12:44:27.216 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:44:27.216 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:44:27.239 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:44:27.294 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:44:27.295 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:44:29.203 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:29.210 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:29.611 INFO 42 --- [main,,] o.s.b.a.e.web.EndpointLinksResolver : Exposing 3 endpoint(s) beneath base path '/actuator' 2022-12-08 12:44:29.711 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:44:30.362 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:44:30.372 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:44:31.578 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8080 (http) with context path '' 2022-12-08 12:44:31.609 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ************************* ACTIVE OCP PROPERTIES ****************************** 2022-12-08 12:44:31.610 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : Active profiles: [composite, default] 2022-12-08 12:44:31.623 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : apsara.audit.enabled=false 2022-12-08 12:44:31.624 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : backup.dbname.prefix=backup 2022-12-08 12:44:31.625 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : display-parse-failed-sql=true 2022-12-08 12:44:31.625 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : enable-sql.parse-service=true 2022-12-08 12:44:31.627 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file=/home/admin/ocp-server/log/ocp.log 2022-12-08 12:44:31.627 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.max-history=100 2022-12-08 12:44:31.627 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.max-size=100MB 2022-12-08 12:44:31.628 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.name=/home/admin/ocp-server/log/ocp.log 2022-12-08 12:44:31.629 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.total-size-cap=10GB 2022-12-08 12:44:31.629 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.com.alipay.ocp=INFO 2022-12-08 12:44:31.630 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.com.oceanbase.ocp=INFO 2022-12-08 12:44:31.630 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.org.hibernate.SQL=INFO 2022-12-08 12:44:31.631 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.web=INFO 2022-12-08 12:44:31.631 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.pattern.console=%clr(%d{yyyy-MM-dd HH:mm:ss.SSS}){faint} %clr(%5p) %clr(42){magenta} %clr(---){faint} %clr([%t,%X{traceId},%X{spanId}]){faint} %clr(%-40.40logger{39}){cyan} %clr(:){faint} %m%n%wEx 2022-12-08 12:44:31.632 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.pattern.file=%d{yyyy-MM-dd HH:mm:ss.SSS} %5p 42 --- [%t,%X{traceId},%X{spanId}] %-40.40logger{39} : %m%n%wEx 2022-12-08 12:44:31.632 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : mc.ocp.cluster.role.sync.check-timeout-seconds=120 2022-12-08 12:44:31.633 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : mgragent.log.level=info 2022-12-08 12:44:31.633 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : monagent.log.level=info 2022-12-08 12:44:31.634 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ob.logtailer.keyword.alarm.rules=[{"keyword":"partition table update task cost too much time to execute", "logLevel":"error", "svrType":"observer", "errorCode":4015, "alarmLevel":2}, {"keyword":"is_out_of_memstore_mem=true", "logLevel":"error", "svrType":"observer", "errorCode":100000, "alarmLevel":1}, {"keyword":"clog disk is almost full", "logLevel":"error", "svrType":"observer", "errorCode":100001, "alarmLevel":2}, {"keyword":"set_disk_error:attention!!!", "logLevel":"error", "svrType":"observer", "errorCode":100002, "alarmLevel":2}, {"keyword":"error occurs on data disk or slog disk", "logLevel":"warn", "svrType":"observer", "errorCode":100003, "alarmLevel":2}, {"keyword":"right_to_die_or_duty_to_live", "logLevel":"error", "svrType":"observer", "errorCode":100004, "alarmLevel":1}, {"keyword":"on_fatal_error", "logLevel":"error", "svrType":"observer", "errorCode":4070, "alarmLevel":1}] 2022-12-08 12:44:31.635 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.cleanup.period.seconds=300 2022-12-08 12:44:31.636 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.holder.capacity=100 2022-12-08 12:44:31.636 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.init.executor.thread-count=16 2022-12-08 12:44:31.637 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.init.timeout.millis=3000 2022-12-08 12:44:31.637 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.max-idle.seconds=3600 2022-12-08 12:44:31.638 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.operation.global.timeout.millis=300000 2022-12-08 12:44:31.638 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.print.sql=true 2022-12-08 12:44:31.639 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.slow.query.threshold.millis=1000 2022-12-08 12:44:31.639 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.socket.connect.timeout.millis=2000 2022-12-08 12:44:31.639 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.socket.read.timeout.millis=1800000 2022-12-08 12:44:31.640 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.auth.metric-auth-enabled=true 2022-12-08 12:44:31.640 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.auth.username=ocp_agent 2022-12-08 12:44:31.641 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.manager.http.port=62888 2022-12-08 12:44:31.641 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.monitor.http.port=62889 2022-12-08 12:44:31.641 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.ob-cleaner.config={"ob_log":{"path":"{INSTALL_PATH}/log","disk_threshold":80,"rules":[{"file_reg":"\\([a-z]\\+\\.\\)\\?[a-z]\\+\\.log\\.[0-9]\\+","retention_days":8,"keep_percentage":0.6},{"file_reg":"\\([a-z]\\+\\.\\)\\?[a-z]\\+\\.log\\.wf\\.[0-9]\\+","retention_days":30,"keep_percentage":0.8}]},"core_log":{"path":"{INSTALL_PATH}","disk_threshold":80,"rules":[{"file_reg":"core\\.[0-9]\\+","retention_days":8,"keep_percentage":0.6}]}} 2022-12-08 12:44:31.642 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-end-time-offset-seconds=130 2022-12-08 12:44:31.642 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-timeout-seconds=3 2022-12-08 12:44:31.642 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.slow-sql-exclude-obclusters=sys#* 2022-12-08 12:44:31.643 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-min-duration-seconds=60 2022-12-08 12:44:31.643 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-min-log-size-mb=0.5 2022-12-08 12:44:31.644 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-stat-exclude-obclusters= 2022-12-08 12:44:31.644 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans.query-end-time-offset-seconds=15 2022-12-08 12:44:31.644 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.detect.too-many-targets-alarm-threshold=20 2022-12-08 12:44:31.645 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.enabled=true 2022-12-08 12:44:31.645 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.host.property=svr_ip 2022-12-08 12:44:31.645 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.notification.expired-days=90 2022-12-08 12:44:31.646 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.recover-message-template= 2022-12-08 12:44:31.646 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.batch-max=20 2022-12-08 12:44:31.646 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.enabled=true 2022-12-08 12:44:31.647 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.once-retry-times=1 2022-12-08 12:44:31.647 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.once-timeout-ms=10000 2022-12-08 12:44:31.647 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.period.ms=2000 2022-12-08 12:44:31.648 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.retry-timeout-minutes=60 2022-12-08 12:44:31.648 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.total-failed-retry-times=3 2022-12-08 12:44:31.648 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.total-timeout-seconds=60 2022-12-08 12:44:31.649 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.will-be-sent-in-period-seconds=1800 2022-12-08 12:44:31.649 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.enabled=false 2022-12-08 12:44:31.651 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.addresses=null 2022-12-08 12:44:31.652 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.password=null 2022-12-08 12:44:31.652 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.username=null 2022-12-08 12:44:31.653 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.keep.days=7 2022-12-08 12:44:31.653 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.replicas=1 2022-12-08 12:44:31.653 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.shards=12 2022-12-08 12:44:31.653 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.ob.log.enabled=false 2022-12-08 12:44:31.653 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.ob.trace.enabled=false 2022-12-08 12:44:31.654 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.audit.enabled=true 2022-12-08 12:44:31.654 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.agent.relation.file.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/backup_agent_ob_relations_config.yaml')} 2022-12-08 12:44:31.654 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.backup-data-retention-days=7 2022-12-08 12:44:31.655 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.backup-liboblog-expire-days=7 2022-12-08 12:44:31.655 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.base-backup-last-finished-threshold=12960 2022-12-08 12:44:31.655 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.base-backup-timeout=10 2022-12-08 12:44:31.655 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.inc-backup-delay-threshold=3600 2022-12-08 12:44:31.656 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.last-data-backup-max-interval-minutes=1440 2022-12-08 12:44:31.656 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.backup-command.timeout=300 2022-12-08 12:44:31.656 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.logical.log.meta.time.continuity.threshold.seconds=10 2022-12-08 12:44:31.656 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.oss.support.cname=true 2022-12-08 12:44:31.657 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.restore-time-pre-check.enabled=true 2022-12-08 12:44:31.657 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.command.timeout=3600000 2022-12-08 12:44:31.657 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.host.task.concurrency=8 2022-12-08 12:44:31.657 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.max.retry.times=2 2022-12-08 12:44:31.658 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-interval-seconds=60 2022-12-08 12:44:31.658 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-times=60 2022-12-08 12:44:31.658 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.period.minutes=180 2022-12-08 12:44:31.658 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.schedule.enabled=true 2022-12-08 12:44:31.659 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.task.timeout=10800000 2022-12-08 12:44:31.659 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cloud.data.platform.site.url=null 2022-12-08 12:44:31.660 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cloud.meta.platform.site.url=null 2022-12-08 12:44:31.660 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.id=1 2022-12-08 12:44:31.660 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.name=ocp-cluster 2022-12-08 12:44:31.660 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.role=FOLLOWER 2022-12-08 12:44:31.661 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.config-url.site.url= 2022-12-08 12:44:31.665 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.config-url.use-request-address=true 2022-12-08 12:44:31.665 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.debug.web.cdn.enabled=false 2022-12-08 12:44:31.665 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.debug.web.cdn.location=https://gw-office.alipayobjects.com/a-sit/g/oceanbase/ocp-v2/2.5.0 2022-12-08 12:44:31.666 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.server.expire.seconds=30 2022-12-08 12:44:31.666 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.server.update.seconds=10 2022-12-08 12:44:31.667 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.service.expire.seconds={CMDB_SYNCER:30, TASK_MANAGER:30, RATE_LIMIT:30, PERF_SQL_ROLLUP:30, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:30} 2022-12-08 12:44:31.667 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.service.update.seconds={CMDB_SYNCER:10, TASK_MANAGER:10, RATE_LIMIT:10, PERF_SQL_ROLLUP:15, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:10} 2022-12-08 12:44:31.667 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.env=private 2022-12-08 12:44:31.668 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.access-key=****** 2022-12-08 12:44:31.668 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.access-secret=****** 2022-12-08 12:44:31.668 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.endpoint=TO_BE_REPLACED 2022-12-08 12:44:31.669 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.built-in.bucket=built-in 2022-12-08 12:44:31.669 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.default-block-split-size=1048576 2022-12-08 12:44:31.669 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.file-server.bucket.type=LOCAL 2022-12-08 12:44:31.670 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.local.built-in.dir=#{systemProperties['user.home'].concat('/ocp-server/lib')} 2022-12-08 12:44:31.670 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.local.dir=#{systemProperties['user.home'].concat('/data/files')} 2022-12-08 12:44:31.671 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.max-concurrent-count=16 2022-12-08 12:44:31.671 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.oss-block-split-size=1048576 2022-12-08 12:44:31.671 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.supported-architecture=x86_64,AArch64 2022-12-08 12:44:31.673 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.sys-package.bucket=sys-package 2022-12-08 12:44:31.673 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.try-lock-timeout-milliseconds=60000 2022-12-08 12:44:31.674 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.config.threshold={"-1":{"host_load":{"load1_per_cpu":2},"host_disk_status":{"host_disk_used_percent":85},"host_time":{"clock_diff":500,"ssh_interval":1000},"ob_server_disk_status":{"observer_disk_threshold_percentage":80},"ob_server_partition_count":{"ob_server_partition_count":100000},"obproxy_connection_count":{"obproxy_session_count_percentage":80}}} 2022-12-08 12:44:31.674 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.status.available-keyword=okay 2022-12-08 12:44:31.674 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.status.unavailable-keyword=bad 2022-12-08 12:44:31.675 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host-manager.staragent.enable=false 2022-12-08 12:44:31.675 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.check.clock-diff.enable=false 2022-12-08 12:44:31.675 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.check.clock-diff.max-diff=50 2022-12-08 12:44:31.676 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.remote-command.default-timeout-millis=30000 2022-12-08 12:44:31.676 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.remote-command.min-timeout-millis=30000 2022-12-08 12:44:31.676 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.ssh-ping.max-delay-millis=3000 2022-12-08 12:44:31.677 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.account.system.active=false 2022-12-08 12:44:31.677 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth=local 2022-12-08 12:44:31.677 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-key=****** 2022-12-08 12:44:31.678 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-secret=****** 2022-12-08 12:44:31.678 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-url=TO_BE_REPLACED 2022-12-08 12:44:31.678 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-domain=TO_BE_REPLACED 2022-12-08 12:44:31.678 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-login-url=TO_BE_REPLACED 2022-12-08 12:44:31.679 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-logout-url=TO_BE_REPLACED 2022-12-08 12:44:31.679 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-domain=TO_BE_REPLACED 2022-12-08 12:44:31.679 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-login-url=TO_BE_REPLACED 2022-12-08 12:44:31.680 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-logout-url=TO_BE_REPLACED 2022-12-08 12:44:31.680 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.access-key=****** 2022-12-08 12:44:31.680 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.access-secret=****** 2022-12-08 12:44:31.681 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.domain=TO_BE_REPLACED 2022-12-08 12:44:31.681 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.endpoint=TO_BE_REPLACED 2022-12-08 12:44:31.681 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.region-name=TO_BE_REPLACED 2022-12-08 12:44:31.681 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.ram.endpoint=TO_BE_REPLACED 2022-12-08 12:44:31.682 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.ram.region-name=TO_BE_REPLACED 2022-12-08 12:44:31.682 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.basic.enabled=true 2022-12-08 12:44:31.682 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.admin-employee-ids=146380,073156,032575 2022-12-08 12:44:31.683 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.app-name=TO_BE_REPLACED 2022-12-08 12:44:31.684 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.login-env=daily 2022-12-08 12:44:31.685 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.login-url=TO_BE_REPLACED 2022-12-08 12:44:31.685 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.logout-url=TO_BE_REPLACED 2022-12-08 12:44:31.685 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:14.0, nextRun=2022-12-08 12:44:30.0, currentDate=Thu Dec 08 12:44:31 CST 2022 2022-12-08 12:44:31.685 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.whitelist=/api/v2/time,/api/v2/mc/info,/api/v2/loginKey,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|GetObRootServiceInfoUrlTemplate).*,performance/ash/reports/.*/data 2022-12-08 12:44:31.685 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 12:44:14.0, nextRunTime=2022-12-08 12:44:30.0} 2022-12-08 12:44:31.686 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.csrf.enabled=true 2022-12-08 12:44:31.686 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.csrf.url.excluded=/api/v2/iam/login.*,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName).* 2022-12-08 12:44:31.686 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.lockout-minutes=10 2022-12-08 12:44:31.686 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.max-attempts=10 2022-12-08 12:44:31.687 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.white-list=null 2022-12-08 12:44:31.688 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.lockout-minutes=30 2022-12-08 12:44:31.688 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.max-attempts=5 2022-12-08 12:44:31.688 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.preserved.username.list=admin,sys,system,sysdba,dba,oceanbase,obproxy,proxyro,ocp,ocp_monitor,ocp_agent,odc,oms,backup,drc,lbacsys,odp,temp 2022-12-08 12:44:31.689 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.enabled=true 2022-12-08 12:44:31.689 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.connect.timeout=1000 2022-12-08 12:44:31.689 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.read.timeout=1000 2022-12-08 12:44:31.689 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.on-ip.enabled=false 2022-12-08 12:44:31.690 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.on-user.enabled=true 2022-12-08 12:44:31.690 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.task.schedule.period=3 2022-12-08 12:44:31.690 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.role.forbidden.update.username.list=admin,system,obpass,obproxy,ocp_admin,monitor 2022-12-08 12:44:31.691 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.idempotent.client-token.expire.time=14d 2022-12-08 12:44:31.691 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.scrips.sequence-availability.threshold-percentage=0.8 2022-12-08 12:44:31.691 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-cluster-not-exists-name=__UNKNOWN__ 2022-12-08 12:44:31.692 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-database-not-exists-name=__UNKNOWN__ 2022-12-08 12:44:31.692 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-host-not-exists-ip=__UNKNOWN__ 2022-12-08 12:44:31.693 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-tenant-not-exists-name=__UNKNOWN__ 2022-12-08 12:44:31.695 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.core-pool-size=5 2022-12-08 12:44:31.695 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.max-pool-size=100 2022-12-08 12:44:31.695 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.queue-size=100 2022-12-08 12:44:31.696 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.thread-keep-alive-time=100 2022-12-08 12:44:31.696 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.internal.rpc.user.password=****** 2022-12-08 12:44:31.696 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.internal.rpc.user.username=system 2022-12-08 12:44:31.697 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.http.connect.timeout=180000 2022-12-08 12:44:31.697 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.http.read.timeout=180000 2022-12-08 12:44:31.697 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.tmp.dir=#{systemProperties['user.home'].concat('/logs/ocp')} 2022-12-08 12:44:31.698 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.max-download-speed=1024 2022-12-08 12:44:31.698 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.host=/var/log/message* 2022-12-08 12:44:31.698 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.obproxy=/home/admin/logs/obproxy/log/* 2022-12-08 12:44:31.699 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.observer=%s/log/* 2022-12-08 12:44:31.699 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.ocp_agent=/home/admin/ocp_agent/log/* 2022-12-08 12:44:31.699 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.enabled=true 2022-12-08 12:44:31.699 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.private-key=****** 2022-12-08 12:44:31.700 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.public-key=****** 2022-12-08 12:44:31.700 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.meta.cluster.name= 2022-12-08 12:44:31.701 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.metric.collect.interval.second=1 2022-12-08 12:44:31.701 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.migration.meta.baseline=4.0.0-20220930 2022-12-08 12:44:31.701 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.host.enabled=true 2022-12-08 12:44:31.702 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.max-pool-size=3000 2022-12-08 12:44:31.702 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obcluster.enabled=true 2022-12-08 12:44:31.702 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obproxy.enabled=true 2022-12-08 12:44:31.702 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obsdk.sql-query-row-limit=10000 2022-12-08 12:44:31.703 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.data.retention-days={"ob_cluster_system_event":31,"ocp_metric_data_1":8,"ocp_metric_data_60":31,"metric_hour_data":1098,"metric_daily_data":1098} 2022-12-08 12:44:31.703 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.datasource.query.timeout.sec=120 2022-12-08 12:44:31.704 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.datasource.socket.timeout.ms=120000 2022-12-08 12:44:31.705 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.check-active-period-seconds=60 2022-12-08 12:44:31.705 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.check-inactive-period-seconds=50 2022-12-08 12:44:31.705 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.inactive.threshold.seconds=300 2022-12-08 12:44:31.706 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.host.exporters=/metrics/node/host,:62888/metrics/stat,:62889/metrics/stat 2022-12-08 12:44:31.706 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.host.metrics-list=load1,load5,load15,cpu_percent,io_read,io_write,io_read_time,io_write_time,io_read_byte,io_write_byte,net_recv,net_send,memory_used,memory_buffers,memory_free,host_disk_used,disk_percent,net_recv_percent,load1_per_cpu,memory_percent,net_send_percent,disk_readonly_flag,ssd_wear_indicator,tcp_retrans_percent,host_partition_usage_percent,memory_cached,ob_log_disk_usage_percent,ob_data_disk_usage_percent,ob_install_disk_usage_percent 2022-12-08 12:44:31.706 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.minute.exporters=:62888/metrics/stat,:62889/metrics/stat,/metrics/ob/extra,/metrics/obcloud/extra 2022-12-08 12:44:31.707 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.ob.exporters=/metrics/node/ob,/metrics/ob/basic,/metrics/ob/extra 2022-12-08 12:44:31.707 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.obproxy.exporters=/metrics/node/obproxy,/metrics/obproxy 2022-12-08 12:44:31.707 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.second.exporters=/metrics/node/host,/metrics/node/ob,/metrics/ob/basic,/metrics/node/obproxy,/metrics/obproxy 2022-12-08 12:44:31.708 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.database=monitor_database 2022-12-08 12:44:31.708 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.driverClassName=com.oceanbase.jdbc.Driver 2022-12-08 12:44:31.708 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.initialSize=10 2022-12-08 12:44:31.709 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.keepAlive=true 2022-12-08 12:44:31.709 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.maxActive=200 2022-12-08 12:44:31.709 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.maxWait=2000 2022-12-08 12:44:31.710 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.minIdle=2 2022-12-08 12:44:31.710 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.name=monitordb-connect-pool 2022-12-08 12:44:31.710 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.testWhileIdle=true 2022-12-08 12:44:31.711 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.validationQuery=SELECT 1 FROM DUAL 2022-12-08 12:44:31.711 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.host=192.168.28.54 2022-12-08 12:44:31.711 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.password=****** 2022-12-08 12:44:31.711 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.port=2883 2022-12-08 12:44:31.712 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.username=monitor_user@monitor_tenant#obcluster 2022-12-08 12:44:31.712 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.enabled=false 2022-12-08 12:44:31.712 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.heartbeat.expire.seconds=60 2022-12-08 12:44:31.713 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.heartbeat.interval.seconds=10 2022-12-08 12:44:31.713 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.replication.interval.seconds=30 2022-12-08 12:44:31.713 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.replication.properties.metadb.global-tables=[{"tableName":"mc_ocp_cluster", "mode":"FULL", "querySql":"select `id`, `name`, `role`, `address`, `metadb_config`, `version`, `status`, `last_heartbeat_time`, `create_time`, `update_time` from mc_ocp_cluster","writeSql":"replace into mc_ocp_cluster (`id`, `name`, `role`, `address`, `metadb_config`, `version`, `status`, `last_heartbeat_time`, `create_time`, `update_time`) values (:id, :name, :role, :address, :metadb_config, :version, :status, :last_heartbeat_time, :create_time, :update_time)"},{"tableName":"mc_common_sequence", "mode":"FULL", "querySql":"select `id`, `name`, `next_val`, `create_time`, `update_time` from mc_common_sequence","writeSql":"replace into mc_common_sequence (`id`, `name`, `next_val`, `create_time`, `update_time`) values (:id, :name, :next_val, :create_time, :update_time)"},{"tableName":"mc_ob_cluster", "mode": "FULL", "querySql":"select `ocp_cluster_id`, `ocp_ob_cluster_id`, `ob_cluster_name`, `ob_cluster_id`, `type`, `architecture`, `rootserver_json`, `ob_version`, `locker_id`, `lock_count`, `create_time`, `update_time` from mc_ob_cluster", "writeSql":"replace into mc_ob_cluster (`ocp_cluster_id`, `ocp_ob_cluster_id`, `ob_cluster_name`, `ob_cluster_id`, `type`, `architecture`, `rootserver_json`, `ob_version`, `locker_id`, `lock_count`, `create_time`, `update_time`) values (:ocp_cluster_id, :ocp_ob_cluster_id, :ob_cluster_name, :ob_cluster_id, :type, :architecture, :rootserver_json, :ob_version, :locker_id, :lock_count, :create_time, :update_time)"}, {"tableName":"mc_ocp_cluster_remote_call", "mode":"INCREMENTAL", "querySql":"select `uuid`, `caller_id`, `executor_id`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `max_retry_times`, `retry_interval`, `current_retry_time`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time` from mc_ocp_cluster_remote_call where update_time >= :INCREMENTAL_COLUMN_VALUE", "writeSql":"replace into mc_ocp_cluster_remote_call (`uuid`, `caller_id`, `executor_id`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `max_retry_times`, `retry_interval`, `current_retry_time`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time`) values (:uuid, :caller_id, :executor_id, :task_type, :request_type, :context, :arguments_json, :output_json, :max_retry_times, :retry_interval, :current_retry_time, :timeout, :status, :start_time, :finish_time, :create_time, :update_time)", "queryMaxRecordSql":"select max(update_time) from mc_ocp_cluster_remote_call"}, {"tableName":"mc_ocp_cluster_remote_call_instance", "mode":"INCREMENTAL", "querySql":"select `uuid`, `remote_call_uuid`, `caller_id`, `executor_id`, `server_ip_port`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time` from mc_ocp_cluster_remote_call_instance where update_time >= :INCREMENTAL_COLUMN_VALUE", "writeSql":"replace into mc_ocp_cluster_remote_call_instance (`uuid`, `remote_call_uuid`, `caller_id`, `executor_id`, `server_ip_port`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time`) values (:uuid, :remote_call_uuid, :caller_id, :executor_id, :server_ip_port, :task_type, :request_type, :context, :arguments_json, :output_json, :timeout, :status, :start_time, :finish_time, :create_time, :update_time)","queryMaxRecordSql":"select max(update_time) from mc_ocp_cluster_remote_call_instance"}] 2022-12-08 12:44:31.714 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.agent.socks-port=1080 2022-12-08 12:44:31.714 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.host-address=localhost 2022-12-08 12:44:31.715 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.socks-port=1080 2022-12-08 12:44:31.715 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.web-port=8088 2022-12-08 12:44:31.715 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.vpc.mode.enabled=false 2022-12-08 12:44:31.716 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.cluster.ops.blacklist= 2022-12-08 12:44:31.716 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.slowsql.threshold=100000 2022-12-08 12:44:31.716 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.upgrade.allow-downgrade=false 2022-12-08 12:44:31.716 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.upgrade.dependencies.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/oceanbase_upgrade_dep.yml')} 2022-12-08 12:44:31.717 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.obcloud.api.address= 2022-12-08 12:44:31.717 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.connector.cache.max-idle-seconds=3600 2022-12-08 12:44:31.717 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.connector.cache.max-size=1000 2022-12-08 12:44:31.718 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connect-timeout=5000 2022-12-08 12:44:31.718 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connection.max-per-route=100 2022-12-08 12:44:31.718 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connection.max-pool-size=100 2022-12-08 12:44:31.719 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.read-timeout=30000 2022-12-08 12:44:31.719 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.socket-timeout=3000 2022-12-08 12:44:31.720 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.core-pool-size=500 2022-12-08 12:44:31.720 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.keep-alive-time=120000 2022-12-08 12:44:31.720 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.max-pool-size=1500 2022-12-08 12:44:31.721 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.ssh.connect-timeout=10000 2022-12-08 12:44:31.721 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.ssh.default-command-timeout=10000 2022-12-08 12:44:31.721 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.delete-server.reserve-data-enabled=false 2022-12-08 12:44:31.721 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.resource.trend.collect.period=daily 2022-12-08 12:44:31.722 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.resource.trend.max-point=20 2022-12-08 12:44:31.722 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.single-idc-for-zone-enabled=true 2022-12-08 12:44:31.722 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.sql-execute.enabled=false 2022-12-08 12:44:31.723 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.sql-execute.sql-type.whitelist=SELECT,SHOW 2022-12-08 12:44:31.723 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.tenant.allow-small-unit=false 2022-12-08 12:44:31.723 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.tenant.whitelist.attach-default-whitelist=true 2022-12-08 12:44:31.724 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.unit.unused.max-reserve-hour=1 2022-12-08 12:44:31.724 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.password=****** 2022-12-08 12:44:31.725 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.username=proxyro 2022-12-08 12:44:31.725 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.start.command.template=./bin/obproxy -p 2883 -n %s -o obproxy_config_server_url='%s/services?User_ID=alibaba&UID=test&Action=GetObProxyConfig',enable_metadb_used=false,enable_strict_kernel_release=false,enable_proxy_scramble=true,proxy_mem_limited=2G,log_dir_size_threshold=10G,prometheus_sync_interval=1s 2022-12-08 12:44:31.725 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.odp.root.default.password=****** 2022-12-08 12:44:31.726 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.ash.earliest-analyse-time=8 2022-12-08 12:44:31.726 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.ash.max-analyse-range=60m 2022-12-08 12:44:31.726 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.parallel.sql.limit=2000 2022-12-08 12:44:31.727 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.parallel.sql.partition.retention.days=15 2022-12-08 12:44:31.727 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.awful-performance-index-used-config={"enabled":true, "cpuTimeLimitUs":100000, "execPsLimit":5.0, "fullLogicalReadsLimit":10000} 2022-12-08 12:44:31.727 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.cpu-time-proportion-high-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":10.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":30, "sqlCountLimit":20, "cpuTimePercentLimit":20} 2022-12-08 12:44:31.728 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.database-white-list=oceanbase,information_schema,mysql,__recyclebin,sys,__public 2022-12-08 12:44:31.728 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.diagnose.standby-cluster.enabled=0 2022-12-08 12:44:31.728 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.execution-spike-config={"enabled":true, "cpuTimeLimitUs":3000, "execPsLimit":5.0, "pointsLimit":5, "compareMin":20, "avgExecutionMultiply":{"0":6, "1":5, "5":4, "10":3, "50": 2.5, "100": 2, "500": 1.6}, "stdExecutionMultiply":{"0":80, "1":60 , "3": 30,"5":20, "10":15, "20":8, "30":6, "50":5, "80":4}} 2022-12-08 12:44:31.729 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.index-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2022-12-08 12:44:31.729 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.ineffective-hint-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 12:44:31.729 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.outline-history-query-days=30 2022-12-08 12:44:31.729 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.perf-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2022-12-08 12:44:31.730 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-after-plan-changed-config={"enabled":true, "compareMin":5, "cpuTimeMultiply":{"0":50, "1":30, "10":10, "100":8, "1000":6}} 2022-12-08 12:44:31.730 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":5.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":5, "compareMin":20, "cpuTimeMultiply":{"0":50, "1":30, "10":10, "100":8, "1000":6}} 2022-12-08 12:44:31.731 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.query-timeout=30000000 2022-12-08 12:44:31.731 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.row-lock-contention-high-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":100000, "elapsedTimeLimitUs":0} 2022-12-08 12:44:31.731 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.sql-diagnosis-retention-days=30 2022-12-08 12:44:31.731 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-exists-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 12:44:31.732 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 12:44:31.732 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-used-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 12:44:31.733 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.tenant-white-list=null 2022-12-08 12:44:31.733 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.advisor-plan-max-query-range=7d 2022-12-08 12:44:31.733 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag-plan-change-config={"enabled":true,"schedulePeriodMin":2, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":500,"diagPeriodSec":120,"diagOffsetSec":120,"maxDiagPeriodSec":600} 2022-12-08 12:44:31.734 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-queue-max-size=1000000 2022-12-08 12:44:31.734 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-core-size=30 2022-12-08 12:44:31.734 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-max-size=300 2022-12-08 12:44:31.735 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.earliest-query-time=8d 2022-12-08 12:44:31.735 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.index-advisor-cpu-time-threshold=10 2022-12-08 12:44:31.735 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.index-advisor-elapsed-time-threshold=20 2022-12-08 12:44:31.736 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.info.parameterize.sql=false 2022-12-08 12:44:31.738 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.info.parse.sql.type=true 2022-12-08 12:44:31.739 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.max-query-range=24h 2022-12-08 12:44:31.740 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.batch.insert.size=100 2022-12-08 12:44:31.740 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.core.thread=8 2022-12-08 12:44:31.740 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.insert.query.rate.limit=10 2022-12-08 12:44:31.741 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.max.thread=16 2022-12-08 12:44:31.741 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.query.limit=2000 2022-12-08 12:44:31.741 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.queue.size=20000 2022-12-08 12:44:31.742 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-granularity=30s 2022-12-08 12:44:31.742 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-query-interval=2h 2022-12-08 12:44:31.742 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-retention=8d 2022-12-08 12:44:31.742 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.prepare-partition-ahead=8 2022-12-08 12:44:31.743 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-digest-limit=0 2022-12-08 12:44:31.743 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-digest-trend.points=15 2022-12-08 12:44:31.743 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-timeout=30000000 2022-12-08 12:44:31.744 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.slow-sql-limit=2000 2022-12-08 12:44:31.744 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-audit-sample-retention=8d 2022-12-08 12:44:31.744 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-granularity=30s 2022-12-08 12:44:31.745 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-query-interval=2h 2022-12-08 12:44:31.745 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-retention=2d 2022-12-08 12:44:31.745 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-granularity=2m 2022-12-08 12:44:31.746 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-query-interval=12h 2022-12-08 12:44:31.746 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-retention=8d 2022-12-08 12:44:31.746 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-granularity=10m 2022-12-08 12:44:31.746 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-query-interval=48h 2022-12-08 12:44:31.747 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-retention=15d 2022-12-08 12:44:31.747 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-info-secondary-cache-expiration=30m 2022-12-08 12:44:31.748 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level0-query-interval=30m 2022-12-08 12:44:31.748 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level1-query-interval=2h 2022-12-08 12:44:31.748 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.top-sql-limit=2000 2022-12-08 12:44:31.749 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.tuning-advisor-cpu-time-ratio-of-plan-comparison=0.8 2022-12-08 12:44:31.749 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.transaction.partition.retention.days=7 2022-12-08 12:44:31.749 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.site.url=http://192.168.28.62:8080 2022-12-08 12:44:31.749 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.startup-check.metadb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2022-12-08 12:44:31.750 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.startup-check.monitordb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2022-12-08 12:44:31.752 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.default.language=zh-CN 2022-12-08 12:44:31.752 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.default.timezone= 2022-12-08 12:44:31.753 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.event.excluded={balancer: {'start_sql_bkgd_task','finish_sql_bkgd_task'}} 2022-12-08 12:44:31.753 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.address=localhost 2022-12-08 12:44:31.754 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.cluster-name=obdv1 2022-12-08 12:44:31.754 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.database=obproxy 2022-12-08 12:44:31.754 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.enabled=false 2022-12-08 12:44:31.755 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.user=root@obproxy 2022-12-08 12:44:31.755 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.port=2888 2022-12-08 12:44:31.755 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.batch-interval-millis=10 2022-12-08 12:44:31.756 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.batch-size=1000 2022-12-08 12:44:31.756 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.preserve-days=30 2022-12-08 12:44:31.756 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.thread.core-pool-size=4 2022-12-08 12:44:31.757 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.thread.maximum-pool-size=16 2022-12-08 12:44:31.757 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.version=4.0.0 2022-12-08 12:44:31.757 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.web.tracking.enabled=False 2022-12-08 12:44:31.757 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.client-id=TO_BE_REPLACED 2022-12-08 12:44:31.758 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.client-secret=****** 2022-12-08 12:44:31.758 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.issuer=https://example.com/oauth2/default 2022-12-08 12:44:31.758 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.redirect-uri=TO_BE_REPLACED 2022-12-08 12:44:31.759 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : server.port=8080 2022-12-08 12:44:31.760 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : server.servlet.session.timeout=30m 2022-12-08 12:44:31.760 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : slow-sql.query-sql-info-from.cache.directly=false 2022-12-08 12:44:31.761 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.data.web.pageable.one-indexed-parameters=true 2022-12-08 12:44:31.761 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.initialSize=10 2022-12-08 12:44:31.762 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.keepAlive=true 2022-12-08 12:44:31.762 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.maxActive=100 2022-12-08 12:44:31.763 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.maxWait=2000 2022-12-08 12:44:31.763 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.minIdle=2 2022-12-08 12:44:31.763 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.name=metadb-connect-pool 2022-12-08 12:44:31.764 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.testWhileIdle=true 2022-12-08 12:44:31.764 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.validationQuery=SELECT 1 FROM DUAL 2022-12-08 12:44:31.765 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.hibernate.naming-strategy=org.hibernate.cfg.ImprovedNamingStrategy 2022-12-08 12:44:31.765 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.properties.hibernate.dialect=org.hibernate.dialect.MySQL5Dialect 2022-12-08 12:44:31.766 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.properties.hibernate.globally_quoted_identifiers=true 2022-12-08 12:44:31.766 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.enabled=true 2022-12-08 12:44:31.767 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.max-file-size=2048MB 2022-12-08 12:44:31.767 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.max-request-size=2048MB 2022-12-08 12:44:31.768 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.api-docs.enabled=false 2022-12-08 12:44:31.768 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.api-docs.path=/doc/api-docs 2022-12-08 12:44:31.770 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.paths-to-exclude=null 2022-12-08 12:44:31.771 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.paths-to-match=/api/v2/** 2022-12-08 12:44:31.771 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.swagger-ui.path=/doc/swagger-ui.html 2022-12-08 12:44:31.772 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : sql-stat.flush-sql-info-to-cache=true 2022-12-08 12:44:31.772 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.core-pool-size=8 2022-12-08 12:44:31.773 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.max-pool-size=64 2022-12-08 12:44:31.773 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.task-queue-size=1800 2022-12-08 12:44:31.773 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : top-sql.query-sql-info-from.cache.directly=false 2022-12-08 12:44:31.774 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ****************************************************************************** 2022-12-08 12:44:31.935 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:17.0, nextRun=2022-12-08 12:44:30.0, currentDate=Thu Dec 08 12:44:31 CST 2022 2022-12-08 12:44:31.936 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:44:17.0, nextRunTime=2022-12-08 12:44:30.0} 2022-12-08 12:44:31.970 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:44:31.971 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:44:31.971 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:44:32.211 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:32.216 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:32.594 INFO 42 --- [pool-ocp-schedules-1,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 12:44:32.619 INFO 42 --- [pool-ocp-schedules-8,,e71e50b86a16] .s.a.AnnotationAsyncExecutionInterceptor : More than one TaskExecutor bean found within the context, and none is named 'taskExecutor'. Mark one of them as primary or name it 'taskExecutor' (possibly as an alias) in order to use it for async processing: [alarmTaskExecutor, notificationSendExecutor, alarmDetectMetricExecutor] 2022-12-08 12:44:32.658 INFO 42 --- [pool-ocp-schedules-8,,d1dd09aa3b40] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:44:32.671 INFO 42 --- [pool-ocp-schedules-2,,57cd588492f7] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 12:44:32.696 INFO 42 --- [pool-ocp-schedules-18,,e1456be94d7e] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 12:44:32.697 INFO 42 --- [pool-ocp-schedules-7,,d6b6285488b0] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 12:44:32.704 INFO 42 --- [pool-ocp-schedules-6,,29f64916c0eb] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:44:32.705 INFO 42 --- [pool-ocp-schedules-6,,29f64916c0eb] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:44:32.878 INFO 42 --- [pool-ocp-schedules-1,,72e09ffed832] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 12:44:33.194 INFO 42 --- [pool-ocp-schedules-2,,57cd588492f7] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 12:44:33.195 INFO 42 --- [pool-ocp-schedules-4,,b96be52653bd] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 12:44:33.406 INFO 42 --- [pool-ocp-schedules-6,,59932d2f14e3] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 12:44:33.462 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:33.472 INFO 42 --- [pool-ocp-schedules-14,,8ef6953294b7] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100000, channelName=钉钉群消息样例 2022-12-08 12:44:33.473 INFO 42 --- [pool-ocp-schedules-14,,8ef6953294b7] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=钉钉群消息样例 2022-12-08 12:44:33.562 INFO 42 --- [pool-ocp-schedules-14,,8ef6953294b7] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100001, channelName=自定义脚本通道(待配置样例) 2022-12-08 12:44:33.562 INFO 42 --- [pool-ocp-schedules-14,,8ef6953294b7] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=自定义脚本通道(待配置样例) 2022-12-08 12:44:33.563 INFO 42 --- [pool-ocp-schedules-14,,8ef6953294b7] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=2, updatedCount=2, failedToUpdateCount=0 2022-12-08 12:44:33.677 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=2 2022-12-08 12:44:33.679 INFO 42 --- [pool-ocp-schedules-20,,214e128d758e] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 12:44:33.680 INFO 42 --- [pool-ocp-schedules-10,,140a56fe6827] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 12:44:33.730 INFO 42 --- [pool-ocp-schedules-17,,f74d21539f93] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 12:44:33.732 INFO 42 --- [pool-ocp-schedules-17,,f74d21539f93] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:44:33.734 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.service.TaskRepositoryService : fetchNeedExecute, tryAcquireTasksCount=2, fetchedCount=2 2022-12-08 12:44:33.734 INFO 42 --- [pool-ocp-schedules-17,,f74d21539f93] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 12:44:34.245 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.alarm.core.task.AlarmDetectTask : AlarmDetectTask created 2022-12-08 12:44:34.248 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=1, uuid=1b5fa8db-4c8f-4f48-89fa-b7878569b70f, taskType=AlarmDetect, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T04:03:00.869769Z, startAt=2022-12-08T04:44:33.681Z, endAt=null, heartbeatAt=2022-12-08T04:44:33.681Z, result=executing) 2022-12-08 12:44:34.253 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:44:34.282 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : Started OcpServerApplication in 327.074 seconds (JVM running for 332.853) 2022-12-08 12:44:34.386 INFO 42 --- [SimpleAsyncTaskExecutor-20,,] c.o.o.p.a.i.SessionEventSyncService : start to sync session wait event info, cluster ids is [] 2022-12-08 12:44:34.386 INFO 42 --- [SimpleAsyncTaskExecutor-20,,] c.o.o.p.a.i.SessionEventSyncService : Sync session wait event info finished, cluster ids is [] 2022-12-08 12:44:34.408 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100000, channelName=钉钉群消息样例 2022-12-08 12:44:34.409 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=钉钉群消息样例 2022-12-08 12:44:34.542 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100001, channelName=自定义脚本通道(待配置样例) 2022-12-08 12:44:34.542 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=自定义脚本通道(待配置样例) 2022-12-08 12:44:34.543 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=2, updatedCount=2, failedToUpdateCount=0 2022-12-08 12:44:34.550 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.core.process.AlarmProcessor : AlarmProcessor init done, lastProcessTime=2022-12-08T12:44:34.546734+08:00 2022-12-08 12:44:34.551 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.core.task.AlarmProcessTask : AlarmProcessTask created 2022-12-08 12:44:34.555 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=2, uuid=5f13908a-dd7e-4807-b3e0-26648e685c4d, taskType=AlarmProcess, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T04:03:00.947157Z, startAt=2022-12-08T04:44:33.681Z, endAt=null, heartbeatAt=2022-12-08T04:44:33.681Z, result=executing) 2022-12-08 12:44:34.555 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.utils.task.AlarmTaskManager : startNeedExecute, activeCount=0, tryStartCount=2, startedCount=2 2022-12-08 12:44:34.587 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:44:34.587 INFO 42 --- [pool-ocp-schedules-5,,c9d2f9704082] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:44:34.616 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:44:34.612463+08:00, lastProcessTime=2022-12-08T12:44:34.546734+08:00 2022-12-08 12:44:34.718 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obagent_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.720 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obagent_dead 2022-12-08 12:44:34.720 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obagent_dead 2022-12-08 12:44:34.721 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cannot_connected, duration=PT1M, resolveTimeout=PT10S 2022-12-08 12:44:34.721 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cannot_connected 2022-12-08 12:44:34.721 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cannot_connected 2022-12-08 12:44:34.723 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_connection_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.723 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_connection_percent_over_threshold 2022-12-08 12:44:34.723 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_connection_percent_over_threshold 2022-12-08 12:44:34.724 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 12:44:34.724 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_cpu_percent_over_threshold 2022-12-08 12:44:34.724 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_cpu_percent_over_threshold 2022-12-08 12:44:34.725 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 12:44:34.725 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cpu_percent_over_threshold 2022-12-08 12:44:34.725 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cpu_percent_over_threshold 2022-12-08 12:44:34.726 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.726 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold 2022-12-08 12:44:34.729 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_frozen_version_delta_over_threshold 2022-12-08 12:44:34.731 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_net_recv_percent_over_threshold, duration=PT2M, resolveTimeout=PT1M 2022-12-08 12:44:34.731 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_recv_percent_over_threshold 2022-12-08 12:44:34.731 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_net_recv_percent_over_threshold 2022-12-08 12:44:34.733 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_exists_inactive_server, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:44:34.733 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_inactive_server 2022-12-08 12:44:34.733 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_exists_inactive_server 2022-12-08 12:44:34.734 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_exists_index_fail_table, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.735 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_index_fail_table 2022-12-08 12:44:34.735 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_exists_index_fail_table 2022-12-08 12:44:34.736 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_load1_per_cpu_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 12:44:34.736 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_load1_per_cpu_over_threshold 2022-12-08 12:44:34.737 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_load1_per_cpu_over_threshold 2022-12-08 12:44:34.739 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_mem_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.739 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_mem_percent_over_threshold 2022-12-08 12:44:34.739 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_mem_percent_over_threshold 2022-12-08 12:44:34.740 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_merge_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.741 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_timeout 2022-12-08 12:44:34.741 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_merge_timeout 2022-12-08 12:44:34.742 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_merge_error, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.742 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_error 2022-12-08 12:44:34.743 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_merge_error 2022-12-08 12:44:34.743 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_no_frozen, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.744 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_frozen 2022-12-08 12:44:34.744 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_no_frozen 2022-12-08 12:44:34.747 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_no_merge, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.747 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_merge 2022-12-08 12:44:34.748 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_no_merge 2022-12-08 12:44:34.749 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_net_send_percent_over_threshold, duration=PT2M, resolveTimeout=PT1M 2022-12-08 12:44:34.749 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_send_percent_over_threshold 2022-12-08 12:44:34.749 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_net_send_percent_over_threshold 2022-12-08 12:44:34.750 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_partition_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.751 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_partition_count_over_threshold 2022-12-08 12:44:34.751 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_partition_count_over_threshold 2022-12-08 12:44:34.752 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_disk_readonly, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.752 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_disk_readonly 2022-12-08 12:44:34.752 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_disk_readonly 2022-12-08 12:44:34.755 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant500_mem_hold_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.756 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_over_threshold 2022-12-08 12:44:34.756 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant500_mem_hold_over_threshold 2022-12-08 12:44:34.757 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_server_sstable_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.757 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_sstable_percent_over_threshold 2022-12-08 12:44:34.758 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_server_sstable_percent_over_threshold 2022-12-08 12:44:34.759 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_zone_sstable_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.759 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_zone_sstable_percent_over_threshold 2022-12-08 12:44:34.759 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_zone_sstable_percent_over_threshold 2022-12-08 12:44:34.760 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold, duration=PT1M, resolveTimeout=PT10S 2022-12-08 12:44:34.761 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold 2022-12-08 12:44:34.761 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_tcp_retrans_percent_over_threshold 2022-12-08 12:44:34.762 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.762 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold 2022-12-08 12:44:34.762 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant500_mem_hold_percent_over_threshold 2022-12-08 12:44:34.763 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_active_memstore_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.763 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_active_memstore_percent_over_threshold 2022-12-08 12:44:34.764 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_active_memstore_percent_over_threshold 2022-12-08 12:44:34.764 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 12:44:34.765 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_cpu_percent_over_threshold 2022-12-08 12:44:34.765 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_cpu_percent_over_threshold 2022-12-08 12:44:34.766 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_memstore_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.766 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_memstore_percent_over_threshold 2022-12-08 12:44:34.766 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_memstore_percent_over_threshold 2022-12-08 12:44:34.767 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_sync_failed, duration=PT2M, resolveTimeout=PT1M 2022-12-08 12:44:34.768 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_failed 2022-12-08 12:44:34.768 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_sync_failed 2022-12-08 12:44:34.769 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_status_check_failed, duration=PT2M, resolveTimeout=PT1M 2022-12-08 12:44:34.769 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_status_check_failed 2022-12-08 12:44:34.769 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_status_check_failed 2022-12-08 12:44:34.770 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_sync_delay_time_too_long, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.770 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_delay_time_too_long 2022-12-08 12:44:34.770 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_sync_delay_time_too_long 2022-12-08 12:44:34.771 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_exists_expired_xa_trans, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.771 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_exists_expired_xa_trans 2022-12-08 12:44:34.772 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_exists_expired_xa_trans 2022-12-08 12:44:34.773 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=backup_storage_capacity_retry_times_exceeded, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.773 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_retry_times_exceeded 2022-12-08 12:44:34.773 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=backup_storage_capacity_retry_times_exceeded 2022-12-08 12:44:34.774 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=backup_storage_capacity_timeout_or_interrupted, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.774 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_timeout_or_interrupted 2022-12-08 12:44:34.774 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=backup_storage_capacity_timeout_or_interrupted 2022-12-08 12:44:34.775 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_unavailable, duration=PT2M, resolveTimeout=PT1M 2022-12-08 12:44:34.775 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_unavailable 2022-12-08 12:44:34.776 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_unavailable 2022-12-08 12:44:34.776 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ocp_remote_server_time_diff_too_large, duration=PT1M, resolveTimeout=PT1M 2022-12-08 12:44:34.777 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_remote_server_time_diff_too_large 2022-12-08 12:44:34.777 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ocp_remote_server_time_diff_too_large 2022-12-08 12:44:34.777 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxy_process_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.778 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_dead 2022-12-08 12:44:34.778 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxy_process_dead 2022-12-08 12:44:34.779 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxyd_process_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.779 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_dead 2022-12-08 12:44:34.779 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxyd_process_dead 2022-12-08 12:44:34.780 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxy_cannot_connected, duration=PT1M, resolveTimeout=PT10S 2022-12-08 12:44:34.780 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_cannot_connected 2022-12-08 12:44:34.780 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxy_cannot_connected 2022-12-08 12:44:34.781 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_install_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.782 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_install_disk_percent_over_threshold 2022-12-08 12:44:34.782 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_install_disk_percent_over_threshold 2022-12-08 12:44:34.782 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_data_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.783 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_data_disk_percent_over_threshold 2022-12-08 12:44:34.784 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_data_disk_percent_over_threshold 2022-12-08 12:44:34.785 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_log_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.785 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_log_disk_percent_over_threshold 2022-12-08 12:44:34.786 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_log_disk_percent_over_threshold 2022-12-08 12:44:34.786 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=monitor_exporter_unavaliable, duration=PT3M, resolveTimeout=PT1M 2022-12-08 12:44:34.787 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monitor_exporter_unavaliable 2022-12-08 12:44:34.787 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=monitor_exporter_unavaliable 2022-12-08 12:44:34.788 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_ntp_service_not_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.788 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_service_not_exist 2022-12-08 12:44:34.788 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_ntp_service_not_exist 2022-12-08 12:44:34.789 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_ntp_offset_too_large, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.790 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_offset_too_large 2022-12-08 12:44:34.790 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_ntp_offset_too_large 2022-12-08 12:44:34.791 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ic_server_connect_failed, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.791 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ic_server_connect_failed 2022-12-08 12:44:34.791 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ic_server_connect_failed 2022-12-08 12:44:34.792 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=vpc_connect_failed, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.792 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=vpc_connect_failed 2022-12-08 12:44:34.792 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=vpc_connect_failed 2022-12-08 12:44:34.793 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_disk_readonly, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.793 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_disk_readonly 2022-12-08 12:44:34.793 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_disk_readonly 2022-12-08 12:44:34.794 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_goroutine_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.794 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_goroutine_count_over_threshold 2022-12-08 12:44:34.794 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_goroutine_count_over_threshold 2022-12-08 12:44:34.795 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_open_fd_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.796 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_open_fd_count_over_threshold 2022-12-08 12:44:34.796 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_open_fd_count_over_threshold 2022-12-08 12:44:34.797 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_res_memory_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.797 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_res_memory_over_threshold 2022-12-08 12:44:34.797 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_res_memory_over_threshold 2022-12-08 12:44:34.798 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_compaction_error, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.798 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_compaction_error 2022-12-08 12:44:34.798 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_compaction_error 2022-12-08 12:44:34.800 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_no_frozen, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.800 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_frozen 2022-12-08 12:44:34.800 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_no_frozen 2022-12-08 12:44:34.801 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_no_compaction, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.801 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_compaction 2022-12-08 12:44:34.801 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_no_compaction 2022-12-08 12:44:34.802 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_log_disk_usage_high, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.802 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_disk_usage_high 2022-12-08 12:44:34.802 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_log_disk_usage_high 2022-12-08 12:44:34.803 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_task_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.803 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_task_timeout 2022-12-08 12:44:34.804 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_task_timeout 2022-12-08 12:44:34.804 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_task_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.805 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_task_timeout 2022-12-08 12:44:34.805 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_task_timeout 2022-12-08 12:44:34.806 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_expired_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.807 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_expired_trans_exist 2022-12-08 12:44:34.807 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_expired_trans_exist 2022-12-08 12:44:34.808 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_long_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.808 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_long_trans_exist 2022-12-08 12:44:34.808 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_long_trans_exist 2022-12-08 12:44:34.810 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_large_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 12:44:34.810 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_large_trans_exist 2022-12-08 12:44:34.810 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_large_trans_exist 2022-12-08 12:44:34.811 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=node_file_root_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:44:34.811 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_root_usage 2022-12-08 12:44:34.812 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=node_file_root_usage 2022-12-08 12:44:34.813 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_fd_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:44:34.814 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_fd_usage 2022-12-08 12:44:34.814 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_fd_usage 2022-12-08 12:44:34.815 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_sys_abnormal, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.818 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_sys_abnormal 2022-12-08 12:44:34.819 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_sys_abnormal 2022-12-08 12:44:34.821 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_util_full, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.821 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_full 2022-12-08 12:44:34.821 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_util_full 2022-12-08 12:44:34.823 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_util_hwm, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.823 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_hwm 2022-12-08 12:44:34.823 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_util_hwm 2022-12-08 12:44:34.825 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_kernel_io_hang, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.825 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_kernel_io_hang 2022-12-08 12:44:34.825 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_kernel_io_hang 2022-12-08 12:44:34.826 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_sda_ioawait, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.827 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_sda_ioawait 2022-12-08 12:44:34.827 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_sda_ioawait 2022-12-08 12:44:34.828 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_nvme_ioawait, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.828 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_nvme_ioawait 2022-12-08 12:44:34.828 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_nvme_ioawait 2022-12-08 12:44:34.830 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_drop, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.831 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_drop 2022-12-08 12:44:34.831 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_drop 2022-12-08 12:44:34.832 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_error, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.832 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_error 2022-12-08 12:44:34.833 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_error 2022-12-08 12:44:34.833 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_not_exist, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:44:34.834 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_not_exist 2022-12-08 12:44:34.834 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_not_exist 2022-12-08 12:44:34.835 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_core_dump, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:44:34.835 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_core_dump 2022-12-08 12:44:34.835 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_core_dump 2022-12-08 12:44:34.836 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_nic_1000m_full, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.837 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_full 2022-12-08 12:44:34.837 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_nic_1000m_full 2022-12-08 12:44:34.838 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_nic_1000m_hwm, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.838 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_hwm 2022-12-08 12:44:34.839 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_nic_1000m_hwm 2022-12-08 12:44:34.840 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_overload, duration=PT30S, resolveTimeout=PT10S 2022-12-08 12:44:34.841 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_overload 2022-12-08 12:44:34.841 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_overload 2022-12-08 12:44:34.842 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=node_file_inode_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 12:44:34.842 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_inode_usage 2022-12-08 12:44:34.842 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=node_file_inode_usage 2022-12-08 12:44:34.843 INFO 42 --- [alarm-task-1,,0f526c6f342a] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_cpu_irq_error, duration=PT1M, resolveTimeout=PT10S 2022-12-08 12:44:34.844 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_cpu_irq_error 2022-12-08 12:44:34.844 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_cpu_irq_error 2022-12-08 12:44:34.844 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=75, updatedCount=75, failedToUpdateCount=0 2022-12-08 12:44:35.053 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:44:34.612463+08:00, resultsCount=0 2022-12-08 12:44:35.053 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:44:34.612463+08:00, resultsCount=0 2022-12-08 12:44:35.054 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:44:34.612463+08:00 2022-12-08 12:44:35.089 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:44:35.227 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:35.231 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:35.466 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:43:34+08:00, updateTime=2022-12-08T12:44:04+08:00, expireTime=null, isLeader=false} 2022-12-08 12:44:35.474 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:44:35.806 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:44:36.316 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 12:44:36.779 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:43:35+08:00, updateTime=2022-12-08T12:44:05+08:00, expireTime=null, isLeader=false} 2022-12-08 12:44:36.874 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T12:43:35+08:00, updateTime=2022-12-08T12:44:05+08:00, expireTime=null, isLeader=false} 2022-12-08 12:44:36.893 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 12:44:36.940 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 12:44:36.951 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 12:44:36.996 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:37.034 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:44:37.068 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:37.328 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:44:38.232 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:38.242 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:40.041 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:44:41.244 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:41.250 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:41.581 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 12:44:42.387 INFO 42 --- [pool-prometheus-cache-monitor1,,5170fc7e7b41] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 12:44:42.398 INFO 42 --- [pool-prometheus-cache-monitor1,,5170fc7e7b41] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 12:44:42.660 INFO 42 --- [pool-ocp-schedules-3,,e11a79b8ec36] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:44:44.246 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:44:44.251 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:44.256 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:44.313 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:44:44.311654+08:00, lastProcessTime=2022-12-08T12:44:34.612463+08:00 2022-12-08 12:44:44.527 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:44:44.311654+08:00, resultsCount=0 2022-12-08 12:44:44.528 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:44:44.311654+08:00, resultsCount=0 2022-12-08 12:44:44.529 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:44:44.311654+08:00 2022-12-08 12:44:46.712 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:44:46.717 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:44:46.766 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:47.034 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:47.222 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:44:47.257 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:47.261 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:47.273 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:47.376 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:44:49.677 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:50.067 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:44:50.147 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:44:50.263 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:50.273 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:51.316 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 12:44:52.661 INFO 42 --- [pool-ocp-schedules-16,,beed86617e17] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:44:52.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:44:52.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:44:53.274 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:53.279 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:53.805 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:44:53.806 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:44:54.244 INFO 42 --- [alarm-task-1,,0f526c6f342a] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 12:44:54.288 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T12:44:54.285264+08:00, lastProcessTime=2022-12-08T12:44:44.311654+08:00 2022-12-08 12:44:54.556 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T12:44:54.285264+08:00, resultsCount=0 2022-12-08 12:44:54.556 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T12:44:54.285264+08:00, resultsCount=0 2022-12-08 12:44:54.557 INFO 42 --- [alarm-task-2,,d90eb7b7ad97] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T12:44:54.285264+08:00 2022-12-08 12:44:54.908 INFO 42 --- [pool-ocp-schedules-6,,5c222f8dc0f4] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:44:54.908 INFO 42 --- [pool-ocp-schedules-6,,5c222f8dc0f4] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[1b5fa8db-4c8f-4f48-89fa-b7878569b70f, 5f13908a-dd7e-4807-b3e0-26648e685c4d] 2022-12-08 12:44:56.280 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:56.288 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:56.423 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 12:44:56.432 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 12:44:56.907 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:56.994 WARN 42 --- [pool-6-thread-1,,] o.p.s.d.i.OcpPerfSqlDiagnosisTaskService : OcpPerfSqlDiagnosisTaskEntity(taskName=SQL_PERF_DIAGNOSER, beginIntervalTime=1670472246007000, endIntervalTime=1670472546007000, executor=192.168.28.62, status=SUCCESS, createTime=2022-12-08T12:10:06.018463+08:00, updateTime=2022-12-08T12:10:06.268536+08:00) is too old, skip to diag OcpPerfSqlDiagnosisTaskEntity(taskName=SQL_PERF_DIAGNOSER, beginIntervalTime=1670472836994000, endIntervalTime=1670474636994000, executor=192.168.28.62, status=RUNNING, createTime=null, updateTime=null) 2022-12-08 12:44:57.107 WARN 42 --- [pool-7-thread-1,,] o.p.s.d.i.OcpPerfSqlDiagnosisTaskService : OcpPerfSqlDiagnosisTaskEntity(taskName=SQL_INDEX_DIAGNOSER, beginIntervalTime=1670472246015000, endIntervalTime=1670472546015000, executor=192.168.28.62, status=SUCCESS, createTime=2022-12-08T12:10:06.143398+08:00, updateTime=2022-12-08T12:10:06.275834+08:00) is too old, skip to diag OcpPerfSqlDiagnosisTaskEntity(taskName=SQL_INDEX_DIAGNOSER, beginIntervalTime=1670472837107000, endIntervalTime=1670474637107000, executor=192.168.28.62, status=RUNNING, createTime=null, updateTime=null) 2022-12-08 12:44:57.222 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:57.460 WARN 42 --- [pool-9-thread-1,,] o.p.s.d.i.OcpPerfSqlDiagnosisTaskService : OcpPerfSqlDiagnosisTaskEntity(taskName=PLAN_CHANGE_DETECTOR, beginIntervalTime=1670472545846000, endIntervalTime=1670472666161000, executor=192.168.28.62, status=SUCCESS, createTime=2022-12-08T12:13:06.166085+08:00, updateTime=2022-12-08T12:13:06.448053+08:00) is too old, skip to diag OcpPerfSqlDiagnosisTaskEntity(taskName=PLAN_CHANGE_DETECTOR, beginIntervalTime=1670473977460000, endIntervalTime=1670474577460000, executor=192.168.28.62, status=RUNNING, createTime=null, updateTime=null) 2022-12-08 12:44:57.462 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T12:13:56.994, end=2022-12-08T12:43:56.994} 2022-12-08 12:44:57.476 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 12:44:57.495 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 12:44:57.574 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T12:13:57.107, end=2022-12-08T12:43:57.107} 2022-12-08 12:44:57.574 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T12:32:57.46, end=2022-12-08T12:42:57.46} 2022-12-08 12:44:57.587 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 12:44:57.592 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 12:44:57.599 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 12:44:57.704 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 12:44:59.289 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:44:59.297 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:44:59.327 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 12:44:59.612 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 12:45:00.001 INFO 42 --- [pool-ocp-schedules-4,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 12:45:00.018 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:45:00.018 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:45:00.375 INFO 42 --- [pool-prometheus-minute-schedule-2,,7dcb88d87e92] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670474760, interval=60 2022-12-08 12:45:00.376 INFO 42 --- [pool-prometheus-minute-schedule-2,,7dcb88d87e92] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670474700, count=0, elapsed=1668804225676 2022-12-08 12:45:00.383 INFO 42 --- [pool-prometheus-minute-schedule-2,,e71bd1a6c60b] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670474760, interval=60 2022-12-08 12:45:00.384 INFO 42 --- [pool-prometheus-minute-schedule-2,,e71bd1a6c60b] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670474700, count=0, elapsed=1668804225684 2022-12-08 12:45:00.791 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 12:45:01.241 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:14.0, nextRun=2022-12-08 12:45:00.0, currentDate=Thu Dec 08 12:45:01 CST 2022 2022-12-08 12:45:01.242 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 12:44:14.0, nextRunTime=2022-12-08 12:45:00.0} 2022-12-08 12:45:01.261 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 12:45:01.261 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:45:01.262 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 12:45:01.659 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:14.0, nextRun=2022-12-08 12:45:00.0, currentDate=Thu Dec 08 12:45:01 CST 2022 2022-12-08 12:45:01.660 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 12:44:14.0, nextRunTime=2022-12-08 12:45:00.0} 2022-12-08 12:45:01.699 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 12:45:01.700 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 12:45:01.775 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:17.0, nextRun=2022-12-08 12:45:00.0, currentDate=Thu Dec 08 12:45:01 CST 2022 2022-12-08 12:45:01.776 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:44:17.0, nextRunTime=2022-12-08 12:45:00.0} 2022-12-08 12:45:01.793 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 12:45:01.793 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:45:01.793 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 12:45:01.945 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:17.0, nextRun=2022-12-08 12:45:00.0, currentDate=Thu Dec 08 12:45:01 CST 2022 2022-12-08 12:45:01.946 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:44:17.0, nextRunTime=2022-12-08 12:45:00.0} 2022-12-08 12:45:02.005 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.o.o.p.t.i.a.CollectTransSatatSchedule : The last trans sql collect task is still running, skip current task 2022-12-08 12:45:02.005 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Collect trans stat to SqlAggregateData for alarm 2022-12-08 12:45:02.065 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:17.0, nextRun=2022-12-08 12:45:00.0, currentDate=Thu Dec 08 12:45:02 CST 2022 2022-12-08 12:45:02.065 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:44:17.0, nextRunTime=2022-12-08 12:45:00.0} 2022-12-08 12:45:02.100 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.o.o.p.s.i.a.CollectSlowSqlSchedule : The last slow sql collect task is still running, skip current task 2022-12-08 12:45:02.100 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Collect SlowSql to SqlAggregateData for alarm 2022-12-08 12:45:02.141 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 128, operation:EXECUTE, state: RUNNING 2022-12-08 12:45:02.214 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:32.0, nextRun=2022-12-08 12:45:00.0, currentDate=Thu Dec 08 12:45:02 CST 2022 2022-12-08 12:45:02.214 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 12:44:32.0, nextRunTime=2022-12-08 12:45:00.0} 2022-12-08 12:45:02.233 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 12:45:02.233 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:45:02.234 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 12:45:02.261 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=128, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T12:45:02.107+08:00, endTime=null} 2022-12-08 12:45:02.298 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 12:45:02.302 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 12:45:02.351 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 129, operation:EXECUTE, state: RUNNING 2022-12-08 12:45:02.373 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:17.0, nextRun=2022-12-08 12:45:00.0, currentDate=Thu Dec 08 12:45:02 CST 2022 2022-12-08 12:45:02.374 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 12:44:17.0, nextRunTime=2022-12-08 12:45:00.0} 2022-12-08 12:45:02.405 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 12:45:02.406 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:45:02.406 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 12:45:02.422 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 12:45:02.423 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 12:45:02.435 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=129, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T12:45:02.338+08:00, endTime=null} 2022-12-08 12:45:02.492 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 12:44:18.0, nextRun=2022-12-08 12:45:00.0, currentDate=Thu Dec 08 12:45:02 CST 2022 2022-12-08 12:45:02.493 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 12:44:18.0, nextRunTime=2022-12-08 12:45:00.0} 2022-12-08 12:45:02.527 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 12:45:02.527 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 12:45:02.527 INFO 42 --- [pool-task-coordinator1,d360192a8670416f,4ba50dcd2f0a] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 12:45:02.557 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 130, operation:EXECUTE, state: RUNNING 2022-12-08 12:45:02.618 INFO 42 --- [pool-subtask-executor1,d360192a8670416f,a2cc4bf595e1] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=128, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=128, task_operation=execute, latest_execution_start_time=2022-12-08T12:45:02.104+08:00, sub_task_instance_id=128}, listMap={}}, executor=192.168.28.62 2022-12-08 12:45:02.619 INFO 42 --- [pool-subtask-executor1,d360192a8670416f,a2cc4bf595e1] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 12:45:02.630 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=130, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T12:45:02.519+08:00, endTime=null} 2022-12-08 12:45:02.651 INFO 42 --- [pool-subtask-executor1,d360192a8670416f,a2cc4bf595e1] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 12:45:02.661 INFO 42 --- [pool-subtask-executor2,d360192a8670416f,1635180e6075] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=129, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=129, task_operation=execute, latest_execution_start_time=2022-12-08T12:45:02.336+08:00, sub_task_instance_id=129}, listMap={}}, executor=192.168.28.62 2022-12-08 12:45:02.662 INFO 42 --- [pool-ocp-schedules-13,,b503f41dd77d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 12:45:02.705 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 115, operation:EXECUTE, state: RUNNING 2022-12-08 12:45:03.076 INFO 42 --- [pool-subtask-executor2,d360192a8670416f,1635180e6075] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 129, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 12:45:03.079 INFO 42 --- [pool-subtask-executor1,d360192a8670416f,a2cc4bf595e1] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 128, operation:EXECUTE, state: SUCCESSFUL Run in container Total memory is 8388608KB Starting ocp-server: /usr/lib/jvm/java-1.8.0/bin/java -server -XX:+UseG1GC -Xms5734m -Xmx5734m -Xss512k -XX:+PrintCommandLineFlags -XX:MetaspaceSize=1024m -XX:MaxMetaspaceSize=1024m -XX:+PrintAdaptiveSizePolicy -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -Xloggc:/home/admin/ocp-server/bin/../log/gc.log -XX:+UseGCLogFileRotation -XX:GCLogFileSize=50M -XX:NumberOfGCLogFiles=2 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -Dfile.encoding=UTF-8 -jar /home/admin/ocp-server/bin/../lib/ocp-server-4.0.0-20220930.jar -XX:CompressedClassSpaceSize=1065353216 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:GCLogFileSize=52428800 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -XX:InitialHeapSize=6012534784 -XX:MaxHeapSize=6012534784 -XX:MaxMetaspaceSize=1073741824 -XX:MetaspaceSize=1073741824 -XX:NumberOfGCLogFiles=2 -XX:+PrintAdaptiveSizePolicy -XX:+PrintCommandLineFlags -XX:+PrintGC -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ThreadStackSize=512 -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseGCLogFileRotation ___ ___ / _ \ __ ___ __ _ _ _ | _ ) __ _ ___ ___ | (_) | / _| / -_) / _` | | ' \ | _ \ / _` | (_-< / -_) \___/ \__| \___| \__,_| |_||_| |___/ \__,_| /__/ \___| :: Spring Boot :: (v2.3.9.RELEASE) :: OCP Server :: (v4.0.0-20220930) 2022-12-08 14:57:41.245 INFO 42 --- [ main] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 14:57:43.502 INFO 42 --- [ main] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 14:57:44.180 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : The following profiles are active: composite,default 2022-12-08 14:58:18.118 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 14:58:19.561 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 1339ms. Found 3 JPA repository interfaces. 2022-12-08 14:58:19.645 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 14:58:21.687 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 2040ms. Found 16 JPA repository interfaces. 2022-12-08 14:58:21.692 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 14:58:36.972 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 15279ms. Found 99 JPA repository interfaces. 2022-12-08 14:58:45.791 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmEventHistoryRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmEventHistoryRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:45.792 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmGroupAlarmTypeRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmGroupAlarmTypeRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:45.793 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmDetectRuleRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmDetectRuleRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:45.794 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmMetricMetaRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmMetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:46.268 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricGroupRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricGroupRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:46.270 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricObCollectConfigRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricObCollectConfigRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:46.270 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricClassRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricClassRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:46.271 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricMetaRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:46.840 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'sqlAggregateDataRepository' and 'com.alipay.ocp.core.monitordb.alarm.SqlAggregateDataRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:46.841 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obClusterSystemEventRepository' and 'com.alipay.ocp.core.monitordb.ob.ObClusterSystemEventRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:46.843 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obTenantMiniCompactionRepository' and 'com.alipay.ocp.core.monitordb.ob.ObTenantMiniCompactionRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 14:58:48.278 INFO 42 --- [main,,] o.s.cloud.context.scope.GenericScope : BeanFactory id=22bf410e-9c42-33ee-903b-47d732131f72 2022-12-08 14:58:51.602 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler@444548a0' of type [org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 14:58:51.625 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'localSecurityConfiguration.MethodSecurityConfiguration' of type [com.alipay.ocp.server.config.security.LocalSecurityConfiguration$MethodSecurityConfiguration$$EnhancerBySpringCGLIB$$49b04551] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 14:58:51.734 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Method-level access control enabled. 2022-12-08 14:58:51.752 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'methodSecurityMetadataSource' of type [org.springframework.security.access.method.DelegatingMethodSecurityMetadataSource] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 14:58:57.465 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 14:58:59.067 INFO 42 --- [main,,] org.hibernate.Version : HHH000412: Hibernate ORM core version 5.4.28.Final 2022-12-08 14:59:02.037 INFO 42 --- [main,,] o.hibernate.annotations.common.Version : HCANN000001: Hibernate Commons Annotations {5.1.2.Final} 2022-12-08 14:59:11.155 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-1,metadb-connect-pool} inited 2022-12-08 14:59:11.626 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 14:59:15.798 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 14:59:15.801 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 14:59:15.803 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 14:59:19.539 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000038: Composite-id class does not override equals(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 14:59:19.540 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000039: Composite-id class does not override hashCode(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 14:59:31.264 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 14:59:31.459 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 14:59:42.868 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8080 (http) 2022-12-08 14:59:42.997 INFO 42 --- [main,,] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2022-12-08 14:59:42.999 INFO 42 --- [main,,] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.43] 2022-12-08 14:59:44.163 INFO 42 --- [main,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2022-12-08 14:59:44.165 INFO 42 --- [main,,] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 119628 ms 2022-12-08 14:59:53.911 INFO 42 --- [main,,] c.a.o.service.maz.OcpMultiAzoneService : OCP multi-azone not enabled 2022-12-08 14:59:53.930 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set username=monitor_user@monitor_tenant#obcluster 2022-12-08 14:59:53.933 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set url=jdbc:oceanbase://192.168.28.54:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true 2022-12-08 14:59:53.934 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set driver class=com.oceanbase.jdbc.Driver 2022-12-08 14:59:54.359 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 14:59:58.211 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-2,monitordb-connect-pool} inited 2022-12-08 14:59:58.213 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 15:00:00.449 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 15:00:00.451 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 15:00:01.324 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/meta 2022-12-08 15:00:02.261 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Finish migration, location=migration/meta 2022-12-08 15:00:02.262 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/monitor 2022-12-08 15:00:02.266 INFO 42 --- [main,,] com.alipay.ocp.core.util.ResourceUtils : Cannot find any file in location: migration/monitor 2022-12-08 15:00:02.267 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Migration schemas is empty. 2022-12-08 15:00:42.191 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 23216 ms to scan 31 urls, producing 672 keys and 5542 values 2022-12-08 15:01:02.111 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 19565 ms to scan 31 urls, producing 73 keys and 4708 values 2022-12-08 15:01:02.235 INFO 42 --- [main,,] c.a.o.server.analyzer.OcpStartUpChecker : audit event is disable 2022-12-08 15:01:04.701 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : ocp-monitor bean configuration done 2022-12-08 15:01:12.908 INFO 42 --- [main,,] c.a.ocp.server.config.BeanConfiguration : begin set auto discover false. 2022-12-08 15:01:12.949 INFO 42 --- [main,,] c.a.ocp.server.config.BeanConfiguration : set auto discover false success. 2022-12-08 15:01:18.749 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Validate and set keys, publicKey=, valid=false 2022-12-08 15:01:19.317 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Generate new rsa key, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC9ZsS5KksUJGjKg1TOSL/wcbPhEUAQRPd8JJBqMjjMBOs8ebvjZOC8+VUlGQjefiv7yZPjlEwkVwIzBJ7sc2fO26AY+n19SqGgsrpd29SJFTkVLefKBhJ6A0GcF4gbcE6Zc8XmpiTY13qeY+4vKst8bkFQMh2Cz43JP1iiq9+dpwIDAQAB 2022-12-08 15:01:19.952 INFO 42 --- [main,,] c.a.o.service.property.PropertyService : Updated property, key=ocp.login.encryption.public-key, previousValue=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC9ZsS5KksUJGjKg1TOSL/wcbPhEUAQRPd8JJBqMjjMBOs8ebvjZOC8+VUlGQjefiv7yZPjlEwkVwIzBJ7sc2fO26AY+n19SqGgsrpd29SJFTkVLefKBhJ6A0GcF4gbcE6Zc8XmpiTY13qeY+4vKst8bkFQMh2Cz43JP1iiq9+dpwIDAQAB, updatedValue=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC9ZsS5KksUJGjKg1TOSL/wcbPhEUAQRPd8JJBqMjjMBOs8ebvjZOC8+VUlGQjefiv7yZPjlEwkVwIzBJ7sc2fO26AY+n19SqGgsrpd29SJFTkVLefKBhJ6A0GcF4gbcE6Zc8XmpiTY13qeY+4vKst8bkFQMh2Cz43JP1iiq9+dpwIDAQAB 2022-12-08 15:01:20.288 INFO 42 --- [main,,] c.a.o.service.property.PropertyService : Updated property, key=ocp.login.encryption.private-key, previousValue=MIICdgIBADANBgkqhkiG9w0BAQEFAASCAmAwggJcAgEAAoGBAL1mxLkqSxQkaMqDVM5Iv/Bxs+ERQBBE93wkkGoyOMwE6zx5u+Nk4Lz5VSUZCN5+K/vJk+OUTCRXAjMEnuxzZ87boBj6fX1KoaCyul3b1IkVORUt58oGEnoDQZwXiBtwTplzxeamJNjXep5j7i8qy3xuQVAyHYLPjck/WKKr352nAgMBAAECgYBnSdAmmqXvChwLtKtfA9WIrrlGGD4zoSjGDrqi71iCCnyuskSAsdbNt7tzS7/GdlBOM5PvHESZ3MlaQT7Z++WzvTmNkUfmgaBendfllJf3AyhefXQ6H3/kV9HjQvwro8aXSeTdBBsyXQSnryZa0xeKZWofCyIt38etw5I1d0qgoQJBAOWPODBHRCMhgLa91nmN40grJuG7iv762oHXYpmF1JD5jCJmou91ve5cehyoM28pMwjBuBTF5lxxDFkj6NNXucMCQQDTN3OUR4e77DI4KjteSEiat+haiU8TDdqk3o5D78clHGo7FIyuhE+ZVKkFiFNlUa4DZHVD+/K7yidQ2LgPBmpNAkEA3IzmShQeVbZZiLkJN43nwK2c1KGv4Fw41SiPVbqryIHJbj+36WLxEPKOa7v6dqFZo98iseqU8Vm3qGkExxBwqwJADIb6bO39J/EvXVNr6ACjhcGon04LiZbFxAeLKo5bImFYD579ZRBl5DM4PyLBx32bs4nOxrR3xhmMUWg5KnL39QJAacsZHeaMr0a5sXYKApQ6AIB2yMfbi5pk82n3kzw5qT6ayVcI8HTj7LJWpCsu3eMWxBYZYm/qiRiFS9Ku9d6n6A==, updatedValue=MIICdgIBADANBgkqhkiG9w0BAQEFAASCAmAwggJcAgEAAoGBAL1mxLkqSxQkaMqDVM5Iv/Bxs+ERQBBE93wkkGoyOMwE6zx5u+Nk4Lz5VSUZCN5+K/vJk+OUTCRXAjMEnuxzZ87boBj6fX1KoaCyul3b1IkVORUt58oGEnoDQZwXiBtwTplzxeamJNjXep5j7i8qy3xuQVAyHYLPjck/WKKr352nAgMBAAECgYBnSdAmmqXvChwLtKtfA9WIrrlGGD4zoSjGDrqi71iCCnyuskSAsdbNt7tzS7/GdlBOM5PvHESZ3MlaQT7Z++WzvTmNkUfmgaBendfllJf3AyhefXQ6H3/kV9HjQvwro8aXSeTdBBsyXQSnryZa0xeKZWofCyIt38etw5I1d0qgoQJBAOWPODBHRCMhgLa91nmN40grJuG7iv762oHXYpmF1JD5jCJmou91ve5cehyoM28pMwjBuBTF5lxxDFkj6NNXucMCQQDTN3OUR4e77DI4KjteSEiat+haiU8TDdqk3o5D78clHGo7FIyuhE+ZVKkFiFNlUa4DZHVD+/K7yidQ2LgPBmpNAkEA3IzmShQeVbZZiLkJN43nwK2c1KGv4Fw41SiPVbqryIHJbj+36WLxEPKOa7v6dqFZo98iseqU8Vm3qGkExxBwqwJADIb6bO39J/EvXVNr6ACjhcGon04LiZbFxAeLKo5bImFYD579ZRBl5DM4PyLBx32bs4nOxrR3xhmMUWg5KnL39QJAacsZHeaMr0a5sXYKApQ6AIB2yMfbi5pk82n3kzw5qT6ayVcI8HTj7LJWpCsu3eMWxBYZYm/qiRiFS9Ku9d6n6A== 2022-12-08 15:01:20.289 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Refresh and set keys, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC9ZsS5KksUJGjKg1TOSL/wcbPhEUAQRPd8JJBqMjjMBOs8ebvjZOC8+VUlGQjefiv7yZPjlEwkVwIzBJ7sc2fO26AY+n19SqGgsrpd29SJFTkVLefKBhJ6A0GcF4gbcE6Zc8XmpiTY13qeY+4vKst8bkFQMh2Cz43JP1iiq9+dpwIDAQAB 2022-12-08 15:01:22.040 INFO 42 --- [main,,] c.a.o.s.s.operator.LocalFileOperator : FileStorageService init, fileDirPath=/home/admin/data/files 2022-12-08 15:01:30.540 INFO 42 --- [main,,] com.alipay.ocp.core.util.BeanUtils : BeanUtils initialized 2022-12-08 15:01:33.875 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Init consumer, consumerInfo=ShardingConsumerEntity(id=2, module=metric-collect, name=192.168.28.62:8080-1, state=NEW, enabled=true, heartbeatTime=2022-12-08T15:01:33.271+08:00, createTime=null) 2022-12-08 15:01:33.876 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Init consumer, consumerInfo=ShardingConsumerEntity(id=1, module=metric-collect, name=192.168.28.62:8080-0, state=NEW, enabled=true, heartbeatTime=2022-12-08T15:01:33.271+08:00, createTime=null) 2022-12-08 15:01:34.008 INFO 42 --- [main,,] c.a.o.s.a.c.AlarmConfigurationManager : defaultTimeZone not set, use system default, zoneId=Asia/Shanghai 2022-12-08 15:01:35.141 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_daily, createTime=1670482605 2022-12-08 15:01:35.219 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_hour, createTime=1670482605 2022-12-08 15:01:35.299 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_second, createTime=1670482603 2022-12-08 15:01:38.953 INFO 42 --- [main,,] c.a.o.s.a.core.silence.GlobalSilencer : enabled alarm types changed, previous=, current=ob_server_sstable_percent_over_threshold,ob_host_task_timeout,ob_tenant_long_trans_exist,ob_host_net_send_percent_over_threshold,host_agent_goroutine_count_over_threshold,backup_storage_capacity_over_threshold,os_tsar_traffic_drop,tenant_active_memstore_percent_over_threshold,ob_host_data_disk_percent_over_threshold,os_tsar_cpu_util_full,tenant_cpu_percent_over_threshold,ob_tenant_exists_expired_xa_trans,monitor_exporter_unavaliable,ob_tenant_compaction_error,os_tsar_cpu_util_hwm,ob_cluster_exists_inactive_server,os_tsar_traffic_error,ob_host_load1_per_cpu_over_threshold,ob_cluster_operation_info,ob_cluster_frozen_version_delta_over_threshold,ob_cluster_merge_error,no_enough_exporter,backup_storage_capacity_timeout_or_interrupted,ob_tenant_large_trans_exist,inc_backup_delay,host_unavailable,ob_host_mem_percent_over_threshold,os_observer_not_exist,system_obproxy_unavailable,ocp_remote_server_time_diff_too_large,host_ntp_service_not_exist,ob_tenant_expired_trans_exist,host_disk_readonly,node_file_root_usage,os_kernel_io_hang,ob_tenant_task_timeout,same_alarm_rule_detect_too_many_targets,os_tsar_sda_ioawait,ob_log_alarm,os_tsar_traffic_overload,ob_cluster_sync_delay_time_too_long,os_tsar_nvme_ioawait,tenant_memstore_percent_over_threshold,ob_cluster_merge_timeout,ob_zone_sstable_percent_over_threshold,obproxy_cannot_connected,partition_create_failed,node_file_inode_usage,obproxy_process_dead,ob_cluster_rs_not_same,os_tsar_cpu_sys_abnormal,ob_cluster_exists_index_fail_table,ob_tenant_operation_info,host_ntp_offset_too_large,os_nic_1000m_hwm,ob_cluster_no_frozen,ob_host_cpu_percent_over_threshold,ob_cpu_percent_over_threshold,base_backup_too_long_time_no_one_success_task,oms_migrate_delay_over_threshold,vpc_connect_failed,ob_host_disk_readonly,ob_host_net_recv_percent_over_threshold,os_cpu_irq_error,ob_host_connection_percent_over_threshold,ob_cluster_status_check_failed,ocp_local_obproxy_proxyro_user_password_not_same,ob_tenant_no_compaction,host_agent_res_memory_over_threshold,host_agent_open_fd_count_over_threshold,ob_cluster_no_merge,backup_storage_capacity_retry_times_exceeded,obproxyd_process_dead,ob_tenant_log_disk_usage_high,ob_cluster_sync_failed,ob_tenant_no_frozen,ob_tenant500_mem_hold_over_threshold,os_observer_fd_usage,backup_process_dead,ob_cannot_connected,ob_host_tcp_retrans_percent_over_threshold,ob_host_log_disk_percent_over_threshold,ob_host_install_disk_percent_over_threshold,ic_server_connect_failed,os_nic_1000m_full,ob_tenant500_mem_hold_percent_over_threshold,base_backup_fail,os_observer_core_dump,ob_cluster_inspection_not_passed,obagent_dead,ob_host_partition_count_over_threshold 2022-12-08 15:01:40.601 INFO 42 --- [main,,] c.a.o.c.t.e.coordinator.TaskCoordinator : Start task coordinator 2022-12-08 15:01:44.606 INFO 42 --- [main,,] c.a.o.s.a.service.OcpAlarmSearchService : total load alarm history size: 0 2022-12-08 15:01:44.607 INFO 42 --- [main,,] c.a.o.s.a.service.OcpAlarmSearchService : init alarm search done 2022-12-08 15:01:50.869 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2022-12-08 15:01:51.178 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2022-12-08 15:01:51.265 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 15:01:51.298 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 15:01:52.213 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2022-12-08 15:01:52.389 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2022-12-08 15:01:52.416 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 15:01:52.422 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 15:01:52.426 INFO 42 --- [main,,] c.o.o.b.i.c.BackupConfiguration : init backup agent meta cfg 2022-12-08 15:01:52.545 INFO 42 --- [main,,] c.a.o.c.t.e.m.TaskDefinitionManagerImpl : Create task, req=CreateTaskRequest(name=Detect alarms on schedule, creatorId=200, groupId=2, scheduleType=SCHEDULE, scheduleRule=0 */1 * * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, templateName=BackupScheduleAlarmTemplateFactory, comments=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}, enable=true) 2022-12-08 15:01:53.229 INFO 42 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : Backup init, create system schedule task, task=TaskDefinition{id=1000002, name=Detect alarms on schedule, creatorId=200, templateName=BackupScheduleAlarmTemplateFactory, scheduleType=SCHEDULE, scheduleRule=0 */1 * * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, nextRunTime=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}}. 2022-12-08 15:01:53.240 INFO 42 --- [main,,] c.a.o.c.t.e.m.TaskDefinitionManagerImpl : Create task, req=CreateTaskRequest(name=Clean expired log files on schedule, creatorId=200, groupId=2, scheduleType=SCHEDULE, scheduleRule=0 0 0 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, templateName=BackupScheduleCleanLogTemplateFactory, comments=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}, enable=true) 2022-12-08 15:01:53.383 INFO 42 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : Backup init, create system schedule task, task=TaskDefinition{id=1000003, name=Clean expired log files on schedule, creatorId=200, templateName=BackupScheduleCleanLogTemplateFactory, scheduleType=SCHEDULE, scheduleRule=0 0 0 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, nextRunTime=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}}. 2022-12-08 15:01:53.453 INFO 42 --- [main,,] c.a.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key global_lock_com.oceanbase.ocp.backup.internal.task.backupocptaskmanager 2022-12-08 15:01:53.485 INFO 42 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : upgradeFromOldAgentToNewService start. 2022-12-08 15:01:53.529 INFO 42 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : serviceInfos=[], allMachineList=[] 2022-12-08 15:01:53.585 INFO 42 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : register backup schedules success 2022-12-08 15:01:58.168 INFO 42 --- [main,,] .a.o.s.m.c.MonitorDataRolloverProperties : Monitor retention conf is {ob_cluster_system_event=31, ocp_metric_data_1=8, ocp_metric_data_60=31, metric_hour_data=1098, metric_daily_data=1098} 2022-12-08 15:01:58.652 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Metadb, table=profile_credential_sharing 2022-12-08 15:01:58.654 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_cluster_system_event 2022-12-08 15:01:58.655 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_1 2022-12-08 15:01:58.656 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_60 2022-12-08 15:01:58.656 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_hour_data 2022-12-08 15:01:58.657 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_daily_data 2022-12-08 15:01:58.658 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_second 2022-12-08 15:01:58.658 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_minute 2022-12-08 15:01:58.659 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_hour 2022-12-08 15:01:58.660 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_daily 2022-12-08 15:01:58.660 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=sql_aggregate_data 2022-12-08 15:01:58.661 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_partition_stats_compressed 2022-12-08 15:01:58.661 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_tenant_mini_compaction_info 2022-12-08 15:01:58.662 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_0 2022-12-08 15:01:58.663 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_1 2022-12-08 15:01:58.663 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_2 2022-12-08 15:01:58.665 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat 2022-12-08 15:01:58.666 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sqltext 2022-12-08 15:01:58.666 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0 2022-12-08 15:01:58.667 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan 2022-12-08 15:01:58.667 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_explain 2022-12-08 15:01:58.668 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_sample 2022-12-08 15:01:58.669 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis_task 2022-12-08 15:01:58.670 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis 2022-12-08 15:01:58.670 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_active_session_stat_0 2022-12-08 15:01:58.671 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_snapshot 2022-12-08 15:01:58.671 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cluster 2022-12-08 15:01:58.672 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_tenant 2022-12-08 15:01:58.672 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_server 2022-12-08 15:01:58.673 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_replica 2022-12-08 15:01:58.674 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sysstat 2022-12-08 15:01:58.674 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_row_lock 2022-12-08 15:01:58.675 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_latch 2022-12-08 15:01:58.677 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cache 2022-12-08 15:01:58.677 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_parameter 2022-12-08 15:01:58.678 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_rpc 2022-12-08 15:01:58.679 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_packet 2022-12-08 15:01:58.680 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_clog 2022-12-08 15:01:58.681 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_location_cache 2022-12-08 15:01:58.682 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_gts 2022-12-08 15:01:58.683 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_system_event 2022-12-08 15:01:58.684 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_plan_monitor 2022-12-08 15:01:58.684 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_trans_stat_0 2022-12-08 15:01:58.704 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167004] Submitting initial worker 2022-12-08 15:01:58.882 INFO 42 --- [main,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService updater scheduler started on 192.168.28.62:8080 2022-12-08 15:01:58.928 INFO 42 --- [main,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : Init, apiConnectTimeoutMillis:1000, apiReadTimeoutMillis:1000, taskSchedulePeriodSec:3 2022-12-08 15:01:59.802 WARN 42 --- [pool-3-thread-1,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2022-12-08 15:01:59.803 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2022-12-08 15:02:00.549 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_minute, createTime=1670482604 2022-12-08 15:02:01.029 INFO 42 --- [main,,] c.o.o.b.i.m.s.StorageExporterServiceImpl : collectEnabled=true,periodMinutes=180, register backup exporter. 2022-12-08 15:02:01.040 INFO 42 --- [main,,] c.a.o.c.t.e.m.TaskDefinitionManagerImpl : Create task, req=CreateTaskRequest(name=Collect backup files size on schedule, creatorId=200, groupId=2, scheduleType=SCHEDULE, scheduleRule=0 0 */3 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, templateName=BackupScheduleCollectTemplateFactory, comments=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}, enable=true) 2022-12-08 15:02:01.131 INFO 42 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : Backup init, create system schedule task, task=TaskDefinition{id=1000004, name=Collect backup files size on schedule, creatorId=200, templateName=BackupScheduleCollectTemplateFactory, scheduleType=SCHEDULE, scheduleRule=0 0 */3 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, nextRunTime=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}}. 2022-12-08 15:02:01.427 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : scheduleEnabled=true 2022-12-08 15:02:01.638 INFO 42 --- [main,,] c.a.o.s.a.service.TaskRepositoryService : create task success, task=TaskInfo(id=1, uuid=5d1c7c8a-1780-40fe-8c4f-b46ce797f238, taskType=AlarmDetect, target=null, parameters=null, intervalSeconds=10, status=WAITING, executorName=192.168.28.62:42, createAt=null, startAt=null, endAt=null, heartbeatAt=null, result=null) 2022-12-08 15:02:01.640 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : create task done, taskType=AlarmDetect, expectCount=1, createCount=1 2022-12-08 15:02:01.654 INFO 42 --- [main,,] c.a.o.s.a.service.TaskRepositoryService : create task success, task=TaskInfo(id=2, uuid=142cf501-1f3a-4dfd-adba-cf2d83e0b467, taskType=AlarmProcess, target=null, parameters=null, intervalSeconds=10, status=WAITING, executorName=192.168.28.62:42, createAt=null, startAt=null, endAt=null, heartbeatAt=null, result=null) 2022-12-08 15:02:01.655 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : create task done, taskType=AlarmProcess, expectCount=1, createCount=1 2022-12-08 15:02:01.655 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : initialize global tasks done 2022-12-08 15:02:01.656 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : initialize done 2022-12-08 15:02:02.808 WARN 42 --- [pool-3-thread-1,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2022-12-08 15:02:02.809 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2022-12-08 15:02:03.362 WARN 42 --- [main,,] JpaBaseConfiguration$JpaWebConfiguration : spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning 2022-12-08 15:02:03.890 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:02:03.916 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:02:04.159 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:04.168 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service MC_MANAGER, Incorrect result size: expected 1, actual 0 2022-12-08 15:02:04.253 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:02:04.262 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PERF_SQL_ROLLUP, Incorrect result size: expected 1, actual 0 2022-12-08 15:02:04.342 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:02:04.352 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service CMDB_SYNCER, Incorrect result size: expected 1, actual 0 2022-12-08 15:02:04.395 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:04.404 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service TASK_MANAGER, Incorrect result size: expected 1, actual 0 2022-12-08 15:02:04.442 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:02:04.453 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2022-12-08 15:02:04.545 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:02:04.554 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:02:04.595 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:02:04.604 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:02:05.315 INFO 42 --- [main,,] c.a.o.s.o.ob.ObMetricCollectService : ObMetricCollectService init, aggConfigList:[{"aggFunc":"max","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_cpu_percent","targetMetric":"ob_tenant_server_max_cpu_used_percentage"},{"aggFunc":"max","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_memory_percent","targetMetric":"ob_tenant_server_max_memory_used_percentage"},{"aggFunc":"avg","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_cpu_percent","targetMetric":"ob_tenant_server_avg_cpu_used_percentage"},{"aggFunc":"avg","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_memory_percent","targetMetric":"ob_tenant_server_avg_memory_used_percentage"}] 2022-12-08 15:02:05.810 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 gets the leadership... 2022-12-08 15:02:07.445 INFO 42 --- [main,,] .o.s.m.o.c.ClusterSystemEventServiceImpl : Init eventTemplateCache: 172 cache entries, 172 elements. 2022-12-08 15:02:07.722 INFO 42 --- [main,,] c.a.o.s.a.c.AlarmConfiguration : alarm configuration set from system properties 2022-12-08 15:02:07.968 INFO 42 --- [main,,] c.a.o.s.a.c.n.NotificationSender : NotificationSender init, scriptDirectoryPath=/home/admin/ocp-server/alarm-channel-script 2022-12-08 15:02:08.299 INFO 42 --- [main,,] c.a.o.s.a.c.d.metrics.AlarmMetricsQuery : createMetricMetaMapping done, metasCount=88 2022-12-08 15:02:08.812 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:08.897 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:08.925 INFO 42 --- [main,,] c.a.o.s.a.c.d.metrics.SqlMetricsQuery : createMetricMetaMapping done, metasCount=88 2022-12-08 15:02:11.977 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:11.991 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:13.876 INFO 42 --- [part-initial-worker,,] c.a.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2022-12-08 15:02:13.890 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2022-12-08 15:02:13.924 INFO 42 --- [part-initial-worker,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=proxy, clusterName=obcluster, obClusterId=null, tenantName=meta_tenant, username=meta_user, address=192.168.28.54, port=2883, database=meta_database) 2022-12-08 15:02:13.924 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=meta_user, tenantName=meta_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=meta_database) 2022-12-08 15:02:14.010 INFO 42 --- [obsdk-init-thread-1,,ee6540035fed] com.alibaba.druid.pool.DruidDataSource : {dataSource-3,ob-connector-datasource_proxy_obcluster_null_meta_tenant_meta_user_192.168.28.54_2883} inited 2022-12-08 15:02:14.013 INFO 42 --- [obsdk-init-thread-1,,ee6540035fed] c.a.o.c.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=meta_user, tenantName=meta_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=meta_database) 2022-12-08 15:02:14.019 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2022-12-08 15:02:14.031 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:14.055 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:14.070 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:14.087 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2022-12-08 15:02:14.122 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:14.123 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:14.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:02:14.149 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:14.150 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:14.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2022-12-08 15:02:14.207 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1669910400 2022-12-08 15:02:14.216 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:14.217 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:14.221 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 15:02:14.254 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:14.396 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:02:14.471 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:14.697 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:02:14.883 INFO 42 --- [main,,] c.a.o.s.alarm.schedule.AlarmSchedules : AlarmSchedules construct done 2022-12-08 15:02:14.992 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:15.000 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:15.010 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 15:02:15.012 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize alarmDetectMetricExecutor 2022-12-08 15:02:15.016 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 'alarmDetectMetricExecutor' 2022-12-08 15:02:15.110 INFO 42 --- [main,,] o.s.s.concurrent.ThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 15:02:15.111 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize alarmTaskExecutor 2022-12-08 15:02:15.112 INFO 42 --- [main,,] o.s.s.concurrent.ThreadPoolTaskExecutor : Initializing ExecutorService 'alarmTaskExecutor' 2022-12-08 15:02:15.129 INFO 42 --- [main,,] c.a.o.s.a.utils.task.AlarmTaskManager : alarm task manager construct done, executorName=192.168.28.62:42 2022-12-08 15:02:15.197 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : OcpMonitorManager init start... 2022-12-08 15:02:15.203 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670482980, interval=60 2022-12-08 15:02:15.206 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486400, interval=3600 2022-12-08 15:02:15.208 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670482980, interval=60 2022-12-08 15:02:15.209 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486400, interval=3600 2022-12-08 15:02:15.217 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : OcpMonitorManager init success. 2022-12-08 15:02:15.223 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1001, sql=alter table `profile_credential_sharing` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 15:02:15.245 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:15.246 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:15.251 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 15:02:15.633 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1669996800 2022-12-08 15:02:15.645 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:15.646 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:15.650 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 15:02:15.850 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 15:02:15.851 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize notificationSendExecutor 2022-12-08 15:02:15.853 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 'notificationSendExecutor' 2022-12-08 15:02:16.008 INFO 42 --- [main,,] c.a.o.s.dataclean.TableCleaningService : Successfully init all table cleaning configurations: {"cleanTaskInstance":{"batchIntervalMillis":0,"batchSize":0,"condition":"create_time <= date_sub(now(), interval 30 day) and type = \"SYS_SCHEDULED\"","priority":1,"tableName":"task_instance"},"cleanSubTaskInstance":{"batchIntervalMillis":0,"batchSize":0,"condition":"task_id in (select id from task_instance where create_time <= date_sub(now(), interval 30 day) and type = \"SYS_SCHEDULED\")","priority":0,"tableName":"subtask_instance"}} 2022-12-08 15:02:16.752 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1102, sql=alter table `profile_credential_sharing` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 15:02:16.757 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:16.758 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:16.762 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 15:02:16.782 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670083200 2022-12-08 15:02:16.786 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:16.787 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:16.792 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 15:02:16.842 INFO 42 --- [main,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updater scheduler started on 192.168.28.62:8080 2022-12-08 15:02:17.219 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.print.sql = true 2022-12-08 15:02:17.222 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set sqlLogEnabled=true 2022-12-08 15:02:17.232 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.max-idle.seconds = 3600 2022-12-08 15:02:17.247 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set maxIdleSeconds=3600 2022-12-08 15:02:17.257 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.cleanup.period.seconds = 300 2022-12-08 15:02:17.258 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set cleanPeriod=300 2022-12-08 15:02:17.265 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.operation.global.timeout.millis = 300000 2022-12-08 15:02:17.266 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set ddlGlobalTimeoutMillis=300000 2022-12-08 15:02:17.274 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.timeout.millis = 3000 2022-12-08 15:02:17.276 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set initTimeoutMillis=3000 2022-12-08 15:02:17.284 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.slow.query.threshold.millis = 1000 2022-12-08 15:02:17.285 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set slowQueryThresholdMillis=1000 2022-12-08 15:02:17.295 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.holder.capacity = 100 2022-12-08 15:02:17.304 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set cacheSize=100 2022-12-08 15:02:17.312 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.read.timeout.millis = 1800000 2022-12-08 15:02:17.313 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketReadTimeoutMillis=1800000 2022-12-08 15:02:17.319 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.executor.thread-count = 16 2022-12-08 15:02:17.320 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketInitThreadCount=16 2022-12-08 15:02:17.327 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.connect.timeout.millis = 2000 2022-12-08 15:02:17.327 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketConnectTimeoutMillis=2000 2022-12-08 15:02:17.402 INFO 42 --- [main,,] c.a.o.service.maz.OcpAzoneDaemonService : Multi azone daemon not enabled 2022-12-08 15:02:17.529 INFO 42 --- [main,,] c.a.o.s.s.BuiltInFilesInitializeLoader : Load lib files, localBuiltInDir=/home/admin/ocp-server/lib 2022-12-08 15:02:17.530 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Remove built-in file:pos.py 2022-12-08 15:02:17.759 ERROR 42 --- [main,,] com.alipay.ocp.core.util.ExceptionUtils : Checked Exception: com.alipay.ocp.core.exception.IllegalArgumentException occurred with code error.file.meta.not.found, and args [built-in, pos.py] 2022-12-08 15:02:17.760 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Script:pos.py not exist. 2022-12-08 15:02:17.762 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Load built-in file:pos.py 2022-12-08 15:02:17.774 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:17.775 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:17.786 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 15:02:17.807 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670169600 2022-12-08 15:02:17.811 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:17.812 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:17.815 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 15:02:18.001 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:18.157 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:18.290 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=built-in, name=pos.py, objectId=1 2022-12-08 15:02:18.520 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:18.521 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:18.524 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 15:02:18.541 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670256000 2022-12-08 15:02:18.545 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:18.546 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:18.549 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 15:02:18.697 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=1, name=pos.py 2022-12-08 15:02:18.697 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Remove built-in file:obproxyd.sh 2022-12-08 15:02:18.716 ERROR 42 --- [main,,] com.alipay.ocp.core.util.ExceptionUtils : Checked Exception: com.alipay.ocp.core.exception.IllegalArgumentException occurred with code error.file.meta.not.found, and args [built-in, obproxyd.sh] 2022-12-08 15:02:18.717 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Script:obproxyd.sh not exist. 2022-12-08 15:02:18.719 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Load built-in file:obproxyd.sh 2022-12-08 15:02:18.886 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=built-in, name=obproxyd.sh, objectId=2 2022-12-08 15:02:19.078 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=2, name=obproxyd.sh 2022-12-08 15:02:19.106 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:19.107 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:19.113 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 15:02:19.128 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670342400 2022-12-08 15:02:19.132 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:19.133 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:19.137 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 15:02:19.146 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:libaio-0.3.112-1.el8.x86_64.rpm 2022-12-08 15:02:19.343 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:02:19.500 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=sys-package, name=libaio-0.3.112-1.el8.x86_64.rpm, objectId=3 2022-12-08 15:02:19.748 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=3, name=libaio-0.3.112-1.el8.x86_64.rpm 2022-12-08 15:02:19.874 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:19.875 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:19.880 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 15:02:19.897 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670428800 2022-12-08 15:02:19.901 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:19.901 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:19.904 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 15:02:20.023 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:t-oceanbase-ocp-agent-4.0.0-20221104145832.alios7.aarch64.rpm 2022-12-08 15:02:20.357 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=sys-package, name=t-oceanbase-ocp-agent-4.0.0-20221104145832.alios7.aarch64.rpm, objectId=4 2022-12-08 15:02:20.637 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:20.638 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:20.641 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 15:02:20.654 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670515200 2022-12-08 15:02:20.659 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:20.659 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:20.662 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 15:02:21.158 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:21.165 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:21.845 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:02:21.913 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1251, sql=alter table `profile_credential_sharing` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 15:02:21.917 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:21.918 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:21.921 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 15:02:21.933 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670601600 2022-12-08 15:02:21.937 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:21.937 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:21.941 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 15:02:22.603 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:22.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:22.608 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 15:02:22.629 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1670688000 2022-12-08 15:02:22.640 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:22.641 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:22.645 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 15:02:23.312 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:23.313 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:23.317 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2022-12-08 15:02:23.334 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2022-12-08 15:02:23.335 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2022-12-08 15:02:23.336 INFO 42 --- [part-initial-worker,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=proxy, clusterName=obcluster, obClusterId=null, tenantName=monitor_tenant, username=monitor_user, address=192.168.28.54, port=2883, database=monitor_database) 2022-12-08 15:02:23.336 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=monitor_user, tenantName=monitor_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=monitor_database) 2022-12-08 15:02:23.398 INFO 42 --- [obsdk-init-thread-2,,d414988e0435] com.alibaba.druid.pool.DruidDataSource : {dataSource-4,ob-connector-datasource_proxy_obcluster_null_monitor_tenant_monitor_user_192.168.28.54_2883} inited 2022-12-08 15:02:23.398 INFO 42 --- [obsdk-init-thread-2,,d414988e0435] c.a.o.c.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=monitor_user, tenantName=monitor_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=monitor_database) 2022-12-08 15:02:23.399 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2022-12-08 15:02:23.401 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:23.406 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:23.406 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:23.410 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2022-12-08 15:02:23.431 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:23.432 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:23.440 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:02:23.451 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:23.452 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:23.456 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2022-12-08 15:02:23.489 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1667836800000000 2022-12-08 15:02:23.495 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:23.496 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:23.503 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1667836800000000 values less than (1667836800000000)) 2022-12-08 15:02:24.167 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:24.174 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:24.288 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:24.289 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:24.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:24.312 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:24.497 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1667923200000000 2022-12-08 15:02:24.501 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:24.502 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:24.510 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1667923200000000 values less than (1667923200000000)) 2022-12-08 15:02:24.569 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:02:24.698 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:24.771 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:02:25.094 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:25.095 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:25.100 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:25.118 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668009600000000 2022-12-08 15:02:25.123 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:25.123 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:25.127 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668009600000000 values less than (1668009600000000)) 2022-12-08 15:02:25.891 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:25.892 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:25.897 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:25.916 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668096000000000 2022-12-08 15:02:25.920 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:25.921 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:25.930 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668096000000000 values less than (1668096000000000)) 2022-12-08 15:02:26.759 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:26.760 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:26.765 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:26.781 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668182400000000 2022-12-08 15:02:26.785 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:26.786 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:26.789 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668182400000000 values less than (1668182400000000)) 2022-12-08 15:02:26.930 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=4, name=t-oceanbase-ocp-agent-4.0.0-20221104145832.alios7.aarch64.rpm 2022-12-08 15:02:26.972 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:t-oceanbase-ocp-agent-4.0.0-20221104150026.alios7.x86_64.rpm 2022-12-08 15:02:27.176 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:27.191 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:27.198 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=sys-package, name=t-oceanbase-ocp-agent-4.0.0-20221104150026.alios7.x86_64.rpm, objectId=5 2022-12-08 15:02:27.347 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:27.348 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:27.351 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:27.365 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668268800000000 2022-12-08 15:02:27.369 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:27.369 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:27.373 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668268800000000 values less than (1668268800000000)) 2022-12-08 15:02:28.225 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:28.226 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:28.230 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:28.284 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668355200000000 2022-12-08 15:02:28.290 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:28.291 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:28.294 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668355200000000 values less than (1668355200000000)) 2022-12-08 15:02:28.952 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:28.952 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:28.955 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:28.969 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668441600000000 2022-12-08 15:02:28.973 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:28.973 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:28.976 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668441600000000 values less than (1668441600000000)) 2022-12-08 15:02:29.859 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:29.859 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:29.863 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:29.876 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668528000000000 2022-12-08 15:02:29.881 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:29.882 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:29.885 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668528000000000 values less than (1668528000000000)) 2022-12-08 15:02:30.192 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:30.202 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:31.814 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1929, sql=alter table `ob_cluster_system_event` add partition(partition p1668528000000000 values less than (1668528000000000)) 2022-12-08 15:02:31.818 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:31.819 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:31.822 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:31.839 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668614400000000 2022-12-08 15:02:31.844 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:31.845 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:31.848 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668614400000000 values less than (1668614400000000)) 2022-12-08 15:02:32.111 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:02:32.504 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:32.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:32.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:32.528 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668700800000000 2022-12-08 15:02:32.533 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:32.534 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:32.538 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668700800000000 values less than (1668700800000000)) 2022-12-08 15:02:33.203 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:33.211 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:33.449 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:33.450 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:33.454 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:33.468 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668787200000000 2022-12-08 15:02:33.475 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:33.475 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:33.480 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668787200000000 values less than (1668787200000000)) 2022-12-08 15:02:34.128 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:34.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:34.133 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:34.150 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668873600000000 2022-12-08 15:02:34.153 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:34.154 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:34.157 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668873600000000 values less than (1668873600000000)) 2022-12-08 15:02:34.159 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:02:34.328 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:02:03+08:00, updateTime=2022-12-08T15:02:03+08:00, expireTime=null, isLeader=false} 2022-12-08 15:02:34.364 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:02:34.488 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:02:34.570 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:34.643 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:02:34.688 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:02:34.770 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:02:34.810 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:34.870 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:02:35.076 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:35.077 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:35.080 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:35.103 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1668960000000000 2022-12-08 15:02:35.107 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:35.108 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:35.113 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1668960000000000 values less than (1668960000000000)) 2022-12-08 15:02:36.212 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:36.217 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:36.239 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1126, sql=alter table `ob_cluster_system_event` add partition(partition p1668960000000000 values less than (1668960000000000)) 2022-12-08 15:02:36.246 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:36.247 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:36.250 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:36.266 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669046400000000 2022-12-08 15:02:36.273 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:36.273 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:36.279 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669046400000000 values less than (1669046400000000)) 2022-12-08 15:02:37.125 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:37.126 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:37.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:37.141 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669132800000000 2022-12-08 15:02:37.146 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:37.147 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:37.151 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669132800000000 values less than (1669132800000000)) 2022-12-08 15:02:38.043 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:38.044 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:38.048 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:38.075 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669219200000000 2022-12-08 15:02:38.080 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:38.081 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:38.091 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669219200000000 values less than (1669219200000000)) 2022-12-08 15:02:39.219 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:40.329 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2238, sql=alter table `ob_cluster_system_event` add partition(partition p1669219200000000 values less than (1669219200000000)) 2022-12-08 15:02:40.341 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:40.342 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:40.348 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:40.369 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669305600000000 2022-12-08 15:02:40.375 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:40.375 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:40.379 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669305600000000 values less than (1669305600000000)) 2022-12-08 15:02:41.488 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1109, sql=alter table `ob_cluster_system_event` add partition(partition p1669305600000000 values less than (1669305600000000)) 2022-12-08 15:02:41.493 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:41.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:41.498 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:41.517 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669392000000000 2022-12-08 15:02:41.521 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:41.522 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:41.526 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669392000000000 values less than (1669392000000000)) 2022-12-08 15:02:42.197 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:02:42.342 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:42.343 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:42.347 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:42.371 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669478400000000 2022-12-08 15:02:42.376 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:42.377 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:42.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669478400000000 values less than (1669478400000000)) 2022-12-08 15:02:43.210 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:43.339 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:43.341 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:43.349 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:43.377 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669564800000000 2022-12-08 15:02:43.394 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:43.395 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:43.399 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669564800000000 values less than (1669564800000000)) 2022-12-08 15:02:44.389 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:44.391 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:44.396 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:44.414 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669651200000000 2022-12-08 15:02:44.419 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:44.420 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:44.423 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669651200000000 values less than (1669651200000000)) 2022-12-08 15:02:44.643 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:45.173 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:02:45.410 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:45.484 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:02:45.773 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=5, name=t-oceanbase-ocp-agent-4.0.0-20221104150026.alios7.x86_64.rpm 2022-12-08 15:02:45.914 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1491, sql=alter table `ob_cluster_system_event` add partition(partition p1669651200000000 values less than (1669651200000000)) 2022-12-08 15:02:45.924 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:45.925 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:45.929 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:45.941 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669737600000000 2022-12-08 15:02:45.945 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:45.946 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:45.949 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669737600000000 values less than (1669737600000000)) 2022-12-08 15:02:46.212 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:46.218 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:47.177 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1228, sql=alter table `ob_cluster_system_event` add partition(partition p1669737600000000 values less than (1669737600000000)) 2022-12-08 15:02:47.182 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:47.182 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:47.186 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:47.202 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669824000000000 2022-12-08 15:02:47.206 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:47.207 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:47.210 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669824000000000 values less than (1669824000000000)) 2022-12-08 15:02:47.798 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.performance.ash.scheduled.ObWaitEventSyncSchedule, newAction=com.oceanbase.ocp.perf.ash.internal.scheduled.ObWaitEventSyncSchedule 2022-12-08 15:02:48.318 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1108, sql=alter table `ob_cluster_system_event` add partition(partition p1669824000000000 values less than (1669824000000000)) 2022-12-08 15:02:48.324 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:48.325 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:48.329 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:48.343 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669910400000000 2022-12-08 15:02:48.349 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:48.350 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:48.353 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669910400000000 values less than (1669910400000000)) 2022-12-08 15:02:49.220 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:49.227 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:49.265 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:49.266 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:49.270 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:49.287 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1669996800000000 2022-12-08 15:02:49.291 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:49.291 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:49.295 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1669996800000000 values less than (1669996800000000)) 2022-12-08 15:02:49.550 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:02:50.044 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:50.045 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:50.048 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:50.065 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670083200000000 2022-12-08 15:02:50.070 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:50.070 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:50.073 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670083200000000 values less than (1670083200000000)) 2022-12-08 15:02:50.605 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:02:50.0, currentDate=Thu Dec 08 15:02:50 CST 2022 2022-12-08 15:02:50.606 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=null, nextRunTime=2022-12-08 15:02:50.0} 2022-12-08 15:02:50.925 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:50.926 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:50.930 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:50.947 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670169600000000 2022-12-08 15:02:50.950 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:50.951 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:50.955 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670169600000000 values less than (1670169600000000)) 2022-12-08 15:02:51.624 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:51.626 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:51.638 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:51.658 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670256000000000 2022-12-08 15:02:51.664 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:51.664 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:51.668 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670256000000000 values less than (1670256000000000)) 2022-12-08 15:02:52.229 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:02:52.651 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:52.652 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:52.656 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:52.672 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670342400000000 2022-12-08 15:02:52.677 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:52.678 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:52.681 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670342400000000 values less than (1670342400000000)) 2022-12-08 15:02:53.293 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:02:53.587 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:53.588 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:53.593 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:53.613 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670428800000000 2022-12-08 15:02:53.623 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:53.624 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:53.629 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670428800000000 values less than (1670428800000000)) 2022-12-08 15:02:54.808 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1179, sql=alter table `ob_cluster_system_event` add partition(partition p1670428800000000 values less than (1670428800000000)) 2022-12-08 15:02:54.813 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:54.813 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:54.817 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:54.834 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670515200000000 2022-12-08 15:02:54.838 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:54.839 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:54.843 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670515200000000 values less than (1670515200000000)) 2022-12-08 15:02:55.173 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:02:55.691 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:55.692 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:55.696 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:55.713 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670601600000000 2022-12-08 15:02:55.718 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:55.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:55.727 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670601600000000 values less than (1670601600000000)) 2022-12-08 15:02:56.539 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:56.540 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:56.544 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:56.557 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1670688000000000 2022-12-08 15:02:56.561 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:56.562 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:56.566 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1670688000000000 values less than (1670688000000000)) 2022-12-08 15:02:57.526 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:57.527 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:57.531 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2022-12-08 15:02:57.551 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:57.552 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:57.556 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:02:57.563 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:57.564 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:57.567 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2022-12-08 15:02:57.586 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1669824000 2022-12-08 15:02:57.590 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:57.590 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:57.593 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1669824000 values less than (1669824000)) 2022-12-08 15:02:58.190 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:58.191 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:58.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:02:58.213 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1669910400 2022-12-08 15:02:58.217 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:58.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:58.222 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 15:02:58.949 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:58.950 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:58.953 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:02:58.965 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1669996800 2022-12-08 15:02:58.974 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:02:58.974 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:02:58.978 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 15:02:59.602 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:02:59.739 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:02:59.742 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.scheduled.CollectClusterSnapshotSchedule, newAction=com.oceanbase.ocp.perf.sql.diag.internal.CollectClusterSnapshotSchedule 2022-12-08 15:02:59.943 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:00.205 INFO 42 --- [pool-prometheus-minute-schedule-1,,ce0a20279c73] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483040, interval=60 2022-12-08 15:03:00.209 INFO 42 --- [pool-prometheus-minute-schedule-2,,f23e0835495f] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483040, interval=60 2022-12-08 15:03:00.211 INFO 42 --- [pool-prometheus-minute-schedule-1,,ce0a20279c73] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670482980, count=0, elapsed=1668812497231 2022-12-08 15:03:00.212 INFO 42 --- [pool-prometheus-minute-schedule-2,,f23e0835495f] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670482980, count=0, elapsed=1668812497232 2022-12-08 15:03:00.460 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1481, sql=alter table `ocp_metric_data_1` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 15:03:00.467 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:00.468 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:00.471 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:03:00.488 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670083200 2022-12-08 15:03:00.493 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:00.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:00.497 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 15:03:01.235 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:01.235 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:01.239 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:03:01.259 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670169600 2022-12-08 15:03:01.264 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:01.264 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:01.268 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 15:03:01.832 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:01.833 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:01.837 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:03:01.854 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670256000 2022-12-08 15:03:01.859 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:01.860 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:01.863 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 15:03:02.365 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:02.366 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:02.373 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:03:02.388 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670342400 2022-12-08 15:03:02.392 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:02.393 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:02.397 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 15:03:02.604 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:02.904 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:02.905 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:02.909 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:03:02.931 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670428800 2022-12-08 15:03:02.937 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:02.937 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:02.944 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 15:03:03.765 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:03.811 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:03:03.832 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:03.833 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:03.838 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:03:03.859 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670515200 2022-12-08 15:03:03.867 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:03.868 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:03.872 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 15:03:04.466 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:04.467 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:04.472 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:03:04.493 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670601600 2022-12-08 15:03:04.498 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:04.499 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:04.506 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 15:03:05.007 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:05.008 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:05.011 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:03:05.025 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1670688000 2022-12-08 15:03:05.028 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:05.029 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:05.032 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 15:03:05.732 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:05.733 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:05.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2022-12-08 15:03:05.753 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:05.754 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:05.756 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:03:05.762 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:05.762 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:05.765 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2022-12-08 15:03:05.787 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1667836800 2022-12-08 15:03:05.791 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:05.791 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:05.794 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1667836800 values less than (1667836800)) 2022-12-08 15:03:06.276 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:06.277 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:06.284 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:06.309 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1667923200 2022-12-08 15:03:06.314 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:06.315 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:06.319 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1667923200 values less than (1667923200)) 2022-12-08 15:03:06.766 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:06.800 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:06.897 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:06.898 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:06.901 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:06.916 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668009600 2022-12-08 15:03:06.919 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:06.920 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:06.923 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668009600 values less than (1668009600)) 2022-12-08 15:03:07.043 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:02:04+08:00, updateTime=2022-12-08T15:02:34+08:00, expireTime=null, isLeader=false} 2022-12-08 15:03:07.142 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:02:34+08:00, updateTime=2022-12-08T15:02:34+08:00, expireTime=null, isLeader=false} 2022-12-08 15:03:07.219 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:02:04+08:00, updateTime=2022-12-08T15:02:34+08:00, expireTime=null, isLeader=false} 2022-12-08 15:03:07.274 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:03:07.283 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:03:07.311 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:03:07.390 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:03:07.407 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:03:07.449 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:03:07.477 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:07.478 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:03:07.479 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:07.483 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:07.513 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668096000 2022-12-08 15:03:07.522 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:07.523 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:07.527 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668096000 values less than (1668096000)) 2022-12-08 15:03:08.004 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.inspection.BuiltinOracleSequenceInspectionTemplate, newAction=com.oceanbase.ocp.inspection.internal.task.BuiltinOracleSequenceInspectionTemplate 2022-12-08 15:03:08.056 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:08.057 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:08.061 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:08.082 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668182400 2022-12-08 15:03:08.092 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:08.093 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:08.098 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668182400 values less than (1668182400)) 2022-12-08 15:03:08.102 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.inspection.BuiltinMysqlSequenceInspectionTemplate, newAction=com.oceanbase.ocp.inspection.internal.task.BuiltinMysqlSequenceInspectionTemplate 2022-12-08 15:03:08.203 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.inspection.BuiltinClusterPartitionInspectionTemplate, newAction=com.oceanbase.ocp.inspection.internal.task.BuiltinClusterPartitionInspectionTemplate 2022-12-08 15:03:08.293 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupSchedulePhysicalTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupSchedulePhysicalTemplateFactory 2022-12-08 15:03:08.345 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupSchedulePhysicalLogSecondaryTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupSchedulePhysicalLogSecondaryTemplateFactory 2022-12-08 15:03:08.400 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupScheduleLogicalTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupScheduleLogicalTemplateFactory 2022-12-08 15:03:08.498 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupScheduleAlarmTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupScheduleAlarmTemplateFactory 2022-12-08 15:03:08.583 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:08.584 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:08.590 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:08.608 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668268800 2022-12-08 15:03:08.613 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupScheduleCleanDataTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupScheduleCleanDataTemplateFactory 2022-12-08 15:03:08.615 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:08.616 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:08.623 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668268800 values less than (1668268800)) 2022-12-08 15:03:08.692 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupScheduleSamplingInspectTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupScheduleSamplingInspectTemplateFactory 2022-12-08 15:03:08.740 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupScheduleCleanLogTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupScheduleCleanLogTemplateFactory 2022-12-08 15:03:08.801 INFO 42 --- [main,,] c.a.o.s.task.init.BuiltInTemplateLoader : Save modified template info, originalAction=com.alipay.ocp.service.task.business.backup.BackupSchedulePhysicalDataWithSecondaryTemplateFactory, newAction=com.oceanbase.ocp.backup.internal.task.template.BackupSchedulePhysicalDataWithSecondaryTemplateFactory 2022-12-08 15:03:09.039 INFO 42 --- [main,,] f.a.AutowiredAnnotationBeanPostProcessor : Autowired annotation is not supported on static methods: public static void com.alipay.ocp.core.util.jpa.JsonNodeConverter.init(com.fasterxml.jackson.databind.ObjectMapper) 2022-12-08 15:03:09.055 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:09.056 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:09.059 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:09.087 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668355200 2022-12-08 15:03:09.092 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:09.093 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:09.097 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668355200 values less than (1668355200)) 2022-12-08 15:03:09.611 INFO 42 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup daemon submitted 2022-12-08 15:03:09.614 INFO 42 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup workers submitted 2022-12-08 15:03:09.739 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:09.743 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:03:09.802 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:09.810 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:10.130 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:03:10.132 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1035, sql=alter table `ocp_metric_data_60` add partition(partition p1668355200 values less than (1668355200)) 2022-12-08 15:03:10.144 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:10.145 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:10.150 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:10.168 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668441600 2022-12-08 15:03:10.172 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:10.172 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:10.175 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668441600 values less than (1668441600)) 2022-12-08 15:03:10.611 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 15:03:10.625 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:10.626 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:10.735 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:10.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:10.739 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:10.754 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668528000 2022-12-08 15:03:10.758 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:10.759 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:10.762 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668528000 values less than (1668528000)) 2022-12-08 15:03:11.243 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:11.243 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:11.248 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:11.266 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668614400 2022-12-08 15:03:11.276 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:11.276 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:11.280 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668614400 values less than (1668614400)) 2022-12-08 15:03:11.792 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:11.793 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:11.797 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:11.814 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668700800 2022-12-08 15:03:11.818 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:11.818 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:11.823 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668700800 values less than (1668700800)) 2022-12-08 15:03:12.543 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:12.544 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:12.548 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:12.564 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668787200 2022-12-08 15:03:12.567 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:12.568 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:12.575 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668787200 values less than (1668787200)) 2022-12-08 15:03:12.811 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:12.820 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:13.129 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:13.130 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:13.133 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:13.147 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668873600 2022-12-08 15:03:13.150 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:13.151 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:13.154 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668873600 values less than (1668873600)) 2022-12-08 15:03:13.811 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:13.813 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:13.813 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:13.817 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:13.837 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1668960000 2022-12-08 15:03:13.841 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:13.842 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:13.851 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1668960000 values less than (1668960000)) 2022-12-08 15:03:14.447 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:14.448 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:14.452 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:14.469 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669046400 2022-12-08 15:03:14.474 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:14.475 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:14.478 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669046400 values less than (1669046400)) 2022-12-08 15:03:15.042 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:15.043 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:15.049 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:15.069 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669132800 2022-12-08 15:03:15.074 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:15.075 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:15.082 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669132800 values less than (1669132800)) 2022-12-08 15:03:15.224 INFO 42 --- [pool-prometheus-cache-monitor1,,34a5e5ab9b64] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:03:15.225 INFO 42 --- [pool-prometheus-cache-monitor1,,34a5e5ab9b64] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:03:15.814 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:15.814 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:15.821 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:15.823 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:15.827 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:15.843 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669219200 2022-12-08 15:03:15.847 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:15.847 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:15.851 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669219200 values less than (1669219200)) 2022-12-08 15:03:16.331 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:16.331 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:16.335 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:16.348 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669305600 2022-12-08 15:03:16.352 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:16.352 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:16.355 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669305600 values less than (1669305600)) 2022-12-08 15:03:17.041 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:17.042 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:17.045 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:17.059 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669392000 2022-12-08 15:03:17.063 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:17.063 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:17.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669392000 values less than (1669392000)) 2022-12-08 15:03:17.274 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:03:17.353 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:03:00.0, currentDate=Thu Dec 08 15:03:17 CST 2022 2022-12-08 15:03:17.354 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:03:00.0} 2022-12-08 15:03:17.631 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:17.632 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:17.635 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:17.654 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669478400 2022-12-08 15:03:17.658 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:17.659 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:17.663 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669478400 values less than (1669478400)) 2022-12-08 15:03:17.768 INFO 42 --- [main,,] c.a.o.core.sharding.ShardingCoordinator : Sharding registry started, module=metric-collect 2022-12-08 15:03:18.478 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:18.479 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:18.482 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:18.492 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669564800 2022-12-08 15:03:18.495 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:18.495 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:18.498 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669564800 values less than (1669564800)) 2022-12-08 15:03:18.828 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:18.834 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:19.276 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:19.278 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:19.282 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:19.295 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669651200 2022-12-08 15:03:19.299 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:19.299 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:19.302 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669651200 values less than (1669651200)) 2022-12-08 15:03:19.837 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:19.845 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:03:20.169 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:20.170 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:20.172 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:20.181 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669737600 2022-12-08 15:03:20.184 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:20.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:20.186 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669737600 values less than (1669737600)) 2022-12-08 15:03:20.274 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:03:21.194 INFO 42 --- [main,,] c.a.o.c.t.engine.util.ThreadPrintStream : replaceSystemOut done 2022-12-08 15:03:21.202 INFO 42 --- [main,,] c.a.o.c.t.e.c.SubtaskCoordinator : Start subtask coordinator 2022-12-08 15:03:21.488 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1302, sql=alter table `ocp_metric_data_60` add partition(partition p1669737600 values less than (1669737600)) 2022-12-08 15:03:21.493 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:21.493 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:21.496 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:21.505 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669824000 2022-12-08 15:03:21.509 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:21.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:21.512 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669824000 values less than (1669824000)) 2022-12-08 15:03:21.830 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:03:21.831 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:21.832 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:21.844 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:21.849 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:21.920 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:03:00.0, currentDate=Thu Dec 08 15:03:21 CST 2022 2022-12-08 15:03:21.921 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:03:00.0} 2022-12-08 15:03:22.084 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:03:22.085 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:22.086 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:22.183 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:22.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:22.187 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:22.198 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669910400 2022-12-08 15:03:22.206 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:22.207 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:22.210 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 15:03:22.378 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:03:00.0, currentDate=Thu Dec 08 15:03:22 CST 2022 2022-12-08 15:03:22.380 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:03:00.0} 2022-12-08 15:03:22.390 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:03:22.437 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:03:22.438 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:22.438 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:22.532 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:03:00.0, currentDate=Thu Dec 08 15:03:22 CST 2022 2022-12-08 15:03:22.533 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=null, nextRunTime=2022-12-08 15:03:00.0} 2022-12-08 15:03:22.554 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:03:22.555 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:22.555 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:22.639 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:03:00.0, currentDate=Thu Dec 08 15:03:22 CST 2022 2022-12-08 15:03:22.640 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:03:00.0} 2022-12-08 15:03:22.783 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:22.784 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:22.788 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:22.802 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1669996800 2022-12-08 15:03:22.808 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:22.809 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:22.812 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 15:03:23.933 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:24.375 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1563, sql=alter table `ocp_metric_data_60` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 15:03:24.386 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:24.387 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:24.390 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:24.405 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670083200 2022-12-08 15:03:24.408 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:24.409 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:24.411 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 15:03:24.851 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:24.859 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:25.514 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:03:25.535 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:03:25.870 INFO 42 --- [pool-heartbeat-task-192.168.28.62:80801,,] c.a.o.c.s.registry.ConsumerRegistry : Init consumer, consumerInfo=ShardingConsumerEntity(id=3, module=task, name=192.168.28.62:8080, state=NEW, enabled=true, heartbeatTime=2022-12-08T15:03:25.694+08:00, createTime=null) 2022-12-08 15:03:26.177 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1766, sql=alter table `ocp_metric_data_60` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 15:03:26.180 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:26.181 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:26.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:26.202 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670169600 2022-12-08 15:03:26.206 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:26.206 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:26.209 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 15:03:27.352 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:03:27.438 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1229, sql=alter table `ocp_metric_data_60` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 15:03:27.445 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:27.446 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:27.452 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:27.475 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670256000 2022-12-08 15:03:27.504 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:27.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:27.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 15:03:27.863 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:27.868 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:28.279 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:28.281 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:28.282 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:28.286 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:28.295 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:28.313 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670342400 2022-12-08 15:03:28.326 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:28.327 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:28.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 15:03:28.497 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:03:28.826 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:28.827 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:28.838 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:28.850 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670428800 2022-12-08 15:03:28.855 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:28.855 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:28.866 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 15:03:29.400 INFO 42 --- [main,,] o.s.b.a.w.s.WelcomePageHandlerMapping : Adding welcome page: class path resource [static/index.html] 2022-12-08 15:03:29.633 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:29.634 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:29.637 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:29.649 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670515200 2022-12-08 15:03:29.653 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:29.653 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:29.656 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 15:03:29.920 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:30.011 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:03:30.320 WARN 42 --- [main,,] ion$DefaultTemplateResolverConfiguration : Cannot find template location: classpath:/templates/ (please add some templates or check your Thymeleaf configuration) 2022-12-08 15:03:30.370 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:03:30.668 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1012, sql=alter table `ocp_metric_data_60` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 15:03:30.674 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:30.674 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:30.677 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:30.696 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670601600 2022-12-08 15:03:30.699 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:30.699 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:30.710 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 15:03:30.869 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:30.872 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:31.433 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:03:31.434 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:03:31.452 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:03:31.452 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:03:31.999 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1289, sql=alter table `ocp_metric_data_60` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 15:03:32.004 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:32.004 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:32.008 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:32.019 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1670688000 2022-12-08 15:03:32.025 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:32.025 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:32.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 15:03:33.287 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1259, sql=alter table `ocp_metric_data_60` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 15:03:33.290 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:33.291 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:33.294 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2022-12-08 15:03:33.306 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:33.306 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:33.309 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:03:33.314 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:33.314 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:33.316 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2022-12-08 15:03:33.331 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2019 2022-12-08 15:03:33.335 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:33.335 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:33.338 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2019 values less than (1577836800)) 2022-12-08 15:03:33.554 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:03:33.555 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:33.555 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:33.715 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:03:33.721 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:03:33.721 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:33.721 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:33.724 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2022-12-08 15:03:33.736 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2020 2022-12-08 15:03:33.739 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:33.740 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:33.743 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2020 values less than (1609459200)) 2022-12-08 15:03:33.873 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:33.877 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:34.107 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:34.108 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:34.111 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2022-12-08 15:03:34.123 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2021 2022-12-08 15:03:34.126 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:34.127 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:34.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2021 values less than (1640995200)) 2022-12-08 15:03:34.539 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:34.539 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:34.541 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2022-12-08 15:03:34.552 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2022 2022-12-08 15:03:34.555 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:34.555 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:34.557 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2022 values less than (1672531200)) 2022-12-08 15:03:34.561 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:34.561 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:34.805 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:03:34.882 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:03:05.0, currentDate=Thu Dec 08 15:03:34 CST 2022 2022-12-08 15:03:34.883 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:03:05.0} 2022-12-08 15:03:34.899 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:03:34.899 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:34.899 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:34.962 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:03:20.0, currentDate=Thu Dec 08 15:03:34 CST 2022 2022-12-08 15:03:34.962 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:03:20.0} 2022-12-08 15:03:34.986 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:03:34.986 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:34.987 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:35.079 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:03:25.0, currentDate=Thu Dec 08 15:03:35 CST 2022 2022-12-08 15:03:35.080 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:03:25.0} 2022-12-08 15:03:35.146 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:35.147 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:35.149 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2022-12-08 15:03:35.161 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2023 2022-12-08 15:03:35.171 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:35.171 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:35.174 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2023 values less than (1704067200)) 2022-12-08 15:03:35.240 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:35.354 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:03:35.355 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:35.355 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:35.452 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:03:30.0, currentDate=Thu Dec 08 15:03:35 CST 2022 2022-12-08 15:03:35.453 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=null, nextRunTime=2022-12-08 15:03:30.0} 2022-12-08 15:03:35.577 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:03:35.592 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:35.592 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:35.595 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2022-12-08 15:03:35.609 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:35.609 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:35.611 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:03:35.615 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:35.616 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:35.618 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2022-12-08 15:03:35.621 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:02:51.0, nextRun=2022-12-08 15:02:55.0, currentDate=Thu Dec 08 15:03:35 CST 2022 2022-12-08 15:03:35.622 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 15:02:51.0, nextRunTime=2022-12-08 15:02:55.0} 2022-12-08 15:03:35.629 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2019 2022-12-08 15:03:35.632 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:35.632 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:35.636 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2019 values less than (1577836800)) 2022-12-08 15:03:35.641 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 15:03:35.642 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:35.642 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:35.740 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:23.0, nextRun=2022-12-08 15:03:30.0, currentDate=Thu Dec 08 15:03:35 CST 2022 2022-12-08 15:03:35.741 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:03:23.0, nextRunTime=2022-12-08 15:03:30.0} 2022-12-08 15:03:35.757 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:03:35.758 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:35.758 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:36.014 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:36.014 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:36.017 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2022-12-08 15:03:36.027 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2020 2022-12-08 15:03:36.030 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:36.030 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:36.033 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2020 values less than (1609459200)) 2022-12-08 15:03:36.380 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:36.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:36.385 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2022-12-08 15:03:36.394 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2021 2022-12-08 15:03:36.397 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:36.397 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:36.399 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2021 values less than (1640995200)) 2022-12-08 15:03:36.878 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:36.882 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:37.056 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:37.056 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:37.058 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2022-12-08 15:03:37.070 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2022 2022-12-08 15:03:37.073 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:37.073 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:37.077 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2022 values less than (1672531200)) 2022-12-08 15:03:37.311 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:03:37.397 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:03:37.423 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:37.424 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:37.427 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2022-12-08 15:03:37.437 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2023 2022-12-08 15:03:37.443 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:37.443 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:37.447 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:03:37.449 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2023 values less than (1704067200)) 2022-12-08 15:03:37.477 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:03:37.681 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:03:37.781 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:03:37.781 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:03:37.782 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:03:37.782 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:03:38.161 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:38.161 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:38.164 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2022-12-08 15:03:38.180 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:38.180 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:38.183 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:03:38.190 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:38.191 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:38.194 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2022-12-08 15:03:38.216 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221201 2022-12-08 15:03:38.222 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:38.223 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:38.227 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221201 values less than (1669824000)) 2022-12-08 15:03:38.977 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:38.977 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:38.980 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:38.991 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221202 2022-12-08 15:03:38.994 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:38.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:38.997 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221202 values less than (1669910400)) 2022-12-08 15:03:39.613 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:03:39.643 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=29ms, period=120000ms 2022-12-08 15:03:39.882 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:39.887 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:39.992 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:03:39.999 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:03:40.001 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:40.001 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:40.005 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:40.025 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221203 2022-12-08 15:03:40.037 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:40.037 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:40.043 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221203 values less than (1669996800)) 2022-12-08 15:03:40.279 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:40.405 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:03:40.448 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:03:40.550 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Local JDBC authentication enabled: whiteList [/api/status.*, /api/v2/time, /api/v2/mc/info, /api/v2/loginKey, .*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|GetObRootServiceInfoUrlTemplate).*, performance/ash/reports/.*/data], basicAuth true, CSRF true 2022-12-08 15:03:40.555 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/assets/**'], [] 2022-12-08 15:03:40.556 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/index.html'], [] 2022-12-08 15:03:40.556 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.js'], [] 2022-12-08 15:03:40.556 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.css'], [] 2022-12-08 15:03:40.556 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/webjars/**'], [] 2022-12-08 15:03:40.556 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.svg'], [] 2022-12-08 15:03:40.806 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:40.807 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:40.810 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:40.820 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221204 2022-12-08 15:03:40.823 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:40.824 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:40.827 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221204 values less than (1670083200)) 2022-12-08 15:03:40.922 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:40.922 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:41.128 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:03:41.219 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:36.0, nextRun=2022-12-08 15:03:40.0, currentDate=Thu Dec 08 15:03:41 CST 2022 2022-12-08 15:03:41.220 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 15:03:36.0, nextRunTime=2022-12-08 15:03:40.0} 2022-12-08 15:03:41.241 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 15:03:41.242 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:41.242 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:41.510 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:41.511 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:41.513 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:41.525 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221205 2022-12-08 15:03:41.529 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:41.529 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:41.532 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221205 values less than (1670169600)) 2022-12-08 15:03:41.680 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: com.alipay.ocp.server.config.security.BasicAuthenticationSecurityConfiguration$$Lambda$2017/1544938999@7bc847dd, [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@320075ea, org.springframework.security.web.context.SecurityContextPersistenceFilter@62e70e74, org.springframework.security.web.header.HeaderWriterFilter@445e0c69, org.springframework.security.web.authentication.logout.LogoutFilter@17c2d06, com.alipay.ocp.server.authentication.PreAuthenticationFilter@21e32876, org.springframework.security.oauth2.server.resource.web.BearerTokenAuthenticationFilter@4f405053, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@3077ee5, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@64252544, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@1b4cc473, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@7e66c414, org.springframework.security.web.session.SessionManagementFilter@745951bb, org.springframework.security.web.access.ExceptionTranslationFilter@192f8d6, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@5861484b] 2022-12-08 15:03:41.838 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: any request, [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@132d4bae, org.springframework.security.web.context.SecurityContextPersistenceFilter@31a3986d, org.springframework.security.web.header.HeaderWriterFilter@7f2717b3, org.springframework.security.web.csrf.CsrfFilter@550acc33, org.springframework.security.web.authentication.logout.LogoutFilter@264368ad, com.alipay.ocp.server.authentication.PreAuthenticationFilter@21e32876, org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter@6287b65f, org.springframework.security.oauth2.server.resource.web.BearerTokenAuthenticationFilter@4cc73927, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@49a03511, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@efd3919, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@67cafa68, org.springframework.security.web.session.SessionManagementFilter@7ccf3730, org.springframework.security.web.access.ExceptionTranslationFilter@47f8088, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@26c42aa8] 2022-12-08 15:03:42.543 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1011, sql=alter table `metric_data_second` add partition(partition p20221205 values less than (1670169600)) 2022-12-08 15:03:42.558 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:42.559 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:42.571 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:42.585 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221206 2022-12-08 15:03:42.589 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:42.589 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:42.593 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221206 values less than (1670256000)) 2022-12-08 15:03:42.888 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:42.893 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:43.304 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:43.305 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:43.308 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:43.320 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221207 2022-12-08 15:03:43.323 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:43.323 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:43.332 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221207 values less than (1670342400)) 2022-12-08 15:03:44.012 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:44.012 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:44.016 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:44.030 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221208 2022-12-08 15:03:44.034 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:44.035 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:44.039 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221208 values less than (1670428800)) 2022-12-08 15:03:44.043 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:03:44.044 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:03:44.058 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:03:44.058 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:03:44.077 INFO 42 --- [main,,] o.s.b.a.e.web.EndpointLinksResolver : Exposing 3 endpoint(s) beneath base path '/actuator' 2022-12-08 15:03:44.632 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:44.633 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:44.637 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:44.654 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221209 2022-12-08 15:03:44.658 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:44.658 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:44.662 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221209 values less than (1670515200)) 2022-12-08 15:03:45.379 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:45.394 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:45.395 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:45.406 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:45.429 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221210 2022-12-08 15:03:45.442 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:45.443 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:45.454 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221210 values less than (1670601600)) 2022-12-08 15:03:45.594 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:41.0, nextRun=2022-12-08 15:03:45.0, currentDate=Thu Dec 08 15:03:45 CST 2022 2022-12-08 15:03:45.596 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=17, name=Distribute replication task, templateName=ReplicationDaemonSchedule, scheduleRule=*/5 * * * * ?, lastRunTime=2022-12-08 15:03:41.0, nextRunTime=2022-12-08 15:03:45.0} 2022-12-08 15:03:45.621 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Replication Daemon Schedule, nodeCount=1, taskCount=1 2022-12-08 15:03:45.622 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:03:45.626 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Replication Daemon Schedule, taskDefinitionId=17, state=RUNNING, operation=EXECUTE} 2022-12-08 15:03:45.894 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:45.901 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:46.008 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:46.009 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:46.012 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:46.024 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20221211 2022-12-08 15:03:46.028 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:46.029 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:46.032 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20221211 values less than (1670688000)) 2022-12-08 15:03:46.113 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8080 (http) with context path '' 2022-12-08 15:03:46.143 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ************************* ACTIVE OCP PROPERTIES ****************************** 2022-12-08 15:03:46.143 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : Active profiles: [composite, default] 2022-12-08 15:03:46.154 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : apsara.audit.enabled=false 2022-12-08 15:03:46.154 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : backup.dbname.prefix=backup 2022-12-08 15:03:46.155 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : display-parse-failed-sql=true 2022-12-08 15:03:46.155 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : enable-sql.parse-service=true 2022-12-08 15:03:46.156 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file=/home/admin/ocp-server/log/ocp.log 2022-12-08 15:03:46.157 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.max-history=100 2022-12-08 15:03:46.157 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.max-size=100MB 2022-12-08 15:03:46.157 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.name=/home/admin/ocp-server/log/ocp.log 2022-12-08 15:03:46.158 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.total-size-cap=10GB 2022-12-08 15:03:46.158 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.com.alipay.ocp=INFO 2022-12-08 15:03:46.158 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.com.oceanbase.ocp=INFO 2022-12-08 15:03:46.158 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.org.hibernate.SQL=INFO 2022-12-08 15:03:46.159 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.web=INFO 2022-12-08 15:03:46.159 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.pattern.console=%clr(%d{yyyy-MM-dd HH:mm:ss.SSS}){faint} %clr(%5p) %clr(42){magenta} %clr(---){faint} %clr([%t,%X{traceId},%X{spanId}]){faint} %clr(%-40.40logger{39}){cyan} %clr(:){faint} %m%n%wEx 2022-12-08 15:03:46.159 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.pattern.file=%d{yyyy-MM-dd HH:mm:ss.SSS} %5p 42 --- [%t,%X{traceId},%X{spanId}] %-40.40logger{39} : %m%n%wEx 2022-12-08 15:03:46.160 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : mc.ocp.cluster.role.sync.check-timeout-seconds=120 2022-12-08 15:03:46.160 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : mgragent.log.level=info 2022-12-08 15:03:46.160 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : monagent.log.level=info 2022-12-08 15:03:46.160 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ob.logtailer.keyword.alarm.rules=[{"keyword":"partition table update task cost too much time to execute", "logLevel":"error", "svrType":"observer", "errorCode":4015, "alarmLevel":2}, {"keyword":"is_out_of_memstore_mem=true", "logLevel":"error", "svrType":"observer", "errorCode":100000, "alarmLevel":1}, {"keyword":"clog disk is almost full", "logLevel":"error", "svrType":"observer", "errorCode":100001, "alarmLevel":2}, {"keyword":"set_disk_error:attention!!!", "logLevel":"error", "svrType":"observer", "errorCode":100002, "alarmLevel":2}, {"keyword":"error occurs on data disk or slog disk", "logLevel":"warn", "svrType":"observer", "errorCode":100003, "alarmLevel":2}, {"keyword":"right_to_die_or_duty_to_live", "logLevel":"error", "svrType":"observer", "errorCode":100004, "alarmLevel":1}, {"keyword":"on_fatal_error", "logLevel":"error", "svrType":"observer", "errorCode":4070, "alarmLevel":1}] 2022-12-08 15:03:46.160 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.cleanup.period.seconds=300 2022-12-08 15:03:46.161 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.holder.capacity=100 2022-12-08 15:03:46.161 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.init.executor.thread-count=16 2022-12-08 15:03:46.161 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.init.timeout.millis=3000 2022-12-08 15:03:46.161 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.max-idle.seconds=3600 2022-12-08 15:03:46.162 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.operation.global.timeout.millis=300000 2022-12-08 15:03:46.162 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.print.sql=true 2022-12-08 15:03:46.162 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.slow.query.threshold.millis=1000 2022-12-08 15:03:46.162 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.socket.connect.timeout.millis=2000 2022-12-08 15:03:46.162 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.socket.read.timeout.millis=1800000 2022-12-08 15:03:46.163 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.auth.metric-auth-enabled=true 2022-12-08 15:03:46.163 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.auth.username=ocp_agent 2022-12-08 15:03:46.163 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.manager.http.port=62888 2022-12-08 15:03:46.163 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.monitor.http.port=62889 2022-12-08 15:03:46.163 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.ob-cleaner.config={"ob_log":{"path":"{INSTALL_PATH}/log","disk_threshold":80,"rules":[{"file_reg":"\\([a-z]\\+\\.\\)\\?[a-z]\\+\\.log\\.[0-9]\\+","retention_days":8,"keep_percentage":0.6},{"file_reg":"\\([a-z]\\+\\.\\)\\?[a-z]\\+\\.log\\.wf\\.[0-9]\\+","retention_days":30,"keep_percentage":0.8}]},"core_log":{"path":"{INSTALL_PATH}","disk_threshold":80,"rules":[{"file_reg":"core\\.[0-9]\\+","retention_days":8,"keep_percentage":0.6}]}} 2022-12-08 15:03:46.164 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-end-time-offset-seconds=130 2022-12-08 15:03:46.164 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-timeout-seconds=3 2022-12-08 15:03:46.164 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.slow-sql-exclude-obclusters=sys#* 2022-12-08 15:03:46.164 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-min-duration-seconds=60 2022-12-08 15:03:46.164 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-min-log-size-mb=0.5 2022-12-08 15:03:46.165 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-stat-exclude-obclusters= 2022-12-08 15:03:46.165 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans.query-end-time-offset-seconds=15 2022-12-08 15:03:46.166 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.detect.too-many-targets-alarm-threshold=20 2022-12-08 15:03:46.166 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.enabled=true 2022-12-08 15:03:46.166 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.host.property=svr_ip 2022-12-08 15:03:46.166 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.notification.expired-days=90 2022-12-08 15:03:46.167 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.recover-message-template= 2022-12-08 15:03:46.167 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.batch-max=20 2022-12-08 15:03:46.167 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.enabled=true 2022-12-08 15:03:46.167 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.once-retry-times=1 2022-12-08 15:03:46.168 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.once-timeout-ms=10000 2022-12-08 15:03:46.168 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.period.ms=2000 2022-12-08 15:03:46.168 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.retry-timeout-minutes=60 2022-12-08 15:03:46.169 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.total-failed-retry-times=3 2022-12-08 15:03:46.169 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.total-timeout-seconds=60 2022-12-08 15:03:46.169 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.will-be-sent-in-period-seconds=1800 2022-12-08 15:03:46.169 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.enabled=false 2022-12-08 15:03:46.170 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.addresses=null 2022-12-08 15:03:46.171 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.password=null 2022-12-08 15:03:46.171 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.username=null 2022-12-08 15:03:46.172 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.keep.days=7 2022-12-08 15:03:46.172 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.replicas=1 2022-12-08 15:03:46.172 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.shards=12 2022-12-08 15:03:46.172 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.ob.log.enabled=false 2022-12-08 15:03:46.173 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.ob.trace.enabled=false 2022-12-08 15:03:46.173 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.audit.enabled=true 2022-12-08 15:03:46.173 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.agent.relation.file.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/backup_agent_ob_relations_config.yaml')} 2022-12-08 15:03:46.173 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.backup-data-retention-days=7 2022-12-08 15:03:46.173 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.backup-liboblog-expire-days=7 2022-12-08 15:03:46.174 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.base-backup-last-finished-threshold=12960 2022-12-08 15:03:46.174 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.base-backup-timeout=10 2022-12-08 15:03:46.174 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.inc-backup-delay-threshold=3600 2022-12-08 15:03:46.174 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.last-data-backup-max-interval-minutes=1440 2022-12-08 15:03:46.175 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.backup-command.timeout=300 2022-12-08 15:03:46.175 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.logical.log.meta.time.continuity.threshold.seconds=10 2022-12-08 15:03:46.175 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.oss.support.cname=true 2022-12-08 15:03:46.175 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.restore-time-pre-check.enabled=true 2022-12-08 15:03:46.176 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.command.timeout=3600000 2022-12-08 15:03:46.176 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.host.task.concurrency=8 2022-12-08 15:03:46.176 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.max.retry.times=2 2022-12-08 15:03:46.177 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-interval-seconds=60 2022-12-08 15:03:46.177 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-times=60 2022-12-08 15:03:46.177 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.period.minutes=180 2022-12-08 15:03:46.177 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.schedule.enabled=true 2022-12-08 15:03:46.178 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.task.timeout=10800000 2022-12-08 15:03:46.179 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cloud.data.platform.site.url=null 2022-12-08 15:03:46.179 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cloud.meta.platform.site.url=null 2022-12-08 15:03:46.180 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.id=1 2022-12-08 15:03:46.180 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.name=ocp-cluster 2022-12-08 15:03:46.180 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.role=FOLLOWER 2022-12-08 15:03:46.180 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.config-url.site.url= 2022-12-08 15:03:46.183 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.config-url.use-request-address=true 2022-12-08 15:03:46.183 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.debug.web.cdn.enabled=false 2022-12-08 15:03:46.183 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.debug.web.cdn.location=https://gw-office.alipayobjects.com/a-sit/g/oceanbase/ocp-v2/2.5.0 2022-12-08 15:03:46.183 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.server.expire.seconds=30 2022-12-08 15:03:46.184 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.server.update.seconds=10 2022-12-08 15:03:46.184 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.service.expire.seconds={CMDB_SYNCER:30, TASK_MANAGER:30, RATE_LIMIT:30, PERF_SQL_ROLLUP:30, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:30} 2022-12-08 15:03:46.184 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.service.update.seconds={CMDB_SYNCER:10, TASK_MANAGER:10, RATE_LIMIT:10, PERF_SQL_ROLLUP:15, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:10} 2022-12-08 15:03:46.184 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.env=private 2022-12-08 15:03:46.184 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.access-key=****** 2022-12-08 15:03:46.185 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.access-secret=****** 2022-12-08 15:03:46.185 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.endpoint=TO_BE_REPLACED 2022-12-08 15:03:46.185 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.built-in.bucket=built-in 2022-12-08 15:03:46.185 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.default-block-split-size=1048576 2022-12-08 15:03:46.186 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.file-server.bucket.type=LOCAL 2022-12-08 15:03:46.186 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.local.built-in.dir=#{systemProperties['user.home'].concat('/ocp-server/lib')} 2022-12-08 15:03:46.186 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.local.dir=#{systemProperties['user.home'].concat('/data/files')} 2022-12-08 15:03:46.186 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.max-concurrent-count=16 2022-12-08 15:03:46.187 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.oss-block-split-size=1048576 2022-12-08 15:03:46.187 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.supported-architecture=x86_64,AArch64 2022-12-08 15:03:46.187 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.sys-package.bucket=sys-package 2022-12-08 15:03:46.187 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.try-lock-timeout-milliseconds=60000 2022-12-08 15:03:46.188 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.config.threshold={"-1":{"host_load":{"load1_per_cpu":2},"host_disk_status":{"host_disk_used_percent":85},"host_time":{"clock_diff":500,"ssh_interval":1000},"ob_server_disk_status":{"observer_disk_threshold_percentage":80},"ob_server_partition_count":{"ob_server_partition_count":100000},"obproxy_connection_count":{"obproxy_session_count_percentage":80}}} 2022-12-08 15:03:46.188 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.status.available-keyword=okay 2022-12-08 15:03:46.188 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.status.unavailable-keyword=bad 2022-12-08 15:03:46.188 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host-manager.staragent.enable=false 2022-12-08 15:03:46.189 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.check.clock-diff.enable=false 2022-12-08 15:03:46.189 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.check.clock-diff.max-diff=50 2022-12-08 15:03:46.189 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.remote-command.default-timeout-millis=30000 2022-12-08 15:03:46.189 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.remote-command.min-timeout-millis=30000 2022-12-08 15:03:46.190 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.ssh-ping.max-delay-millis=3000 2022-12-08 15:03:46.190 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.account.system.active=false 2022-12-08 15:03:46.190 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth=local 2022-12-08 15:03:46.190 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-key=****** 2022-12-08 15:03:46.191 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-secret=****** 2022-12-08 15:03:46.191 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-url=TO_BE_REPLACED 2022-12-08 15:03:46.191 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-domain=TO_BE_REPLACED 2022-12-08 15:03:46.191 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-login-url=TO_BE_REPLACED 2022-12-08 15:03:46.192 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-logout-url=TO_BE_REPLACED 2022-12-08 15:03:46.192 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-domain=TO_BE_REPLACED 2022-12-08 15:03:46.192 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-login-url=TO_BE_REPLACED 2022-12-08 15:03:46.193 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-logout-url=TO_BE_REPLACED 2022-12-08 15:03:46.193 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.access-key=****** 2022-12-08 15:03:46.193 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.access-secret=****** 2022-12-08 15:03:46.193 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.domain=TO_BE_REPLACED 2022-12-08 15:03:46.194 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.endpoint=TO_BE_REPLACED 2022-12-08 15:03:46.194 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.region-name=TO_BE_REPLACED 2022-12-08 15:03:46.194 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.ram.endpoint=TO_BE_REPLACED 2022-12-08 15:03:46.194 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.ram.region-name=TO_BE_REPLACED 2022-12-08 15:03:46.194 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.basic.enabled=true 2022-12-08 15:03:46.195 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.admin-employee-ids=146380,073156,032575 2022-12-08 15:03:46.195 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.app-name=TO_BE_REPLACED 2022-12-08 15:03:46.195 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.login-env=daily 2022-12-08 15:03:46.195 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.login-url=TO_BE_REPLACED 2022-12-08 15:03:46.196 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.logout-url=TO_BE_REPLACED 2022-12-08 15:03:46.196 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.whitelist=/api/v2/time,/api/v2/mc/info,/api/v2/loginKey,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|GetObRootServiceInfoUrlTemplate).*,performance/ash/reports/.*/data 2022-12-08 15:03:46.196 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.csrf.enabled=true 2022-12-08 15:03:46.196 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.csrf.url.excluded=/api/v2/iam/login.*,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName).* 2022-12-08 15:03:46.196 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.lockout-minutes=10 2022-12-08 15:03:46.197 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.max-attempts=10 2022-12-08 15:03:46.198 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.white-list=null 2022-12-08 15:03:46.198 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.lockout-minutes=30 2022-12-08 15:03:46.199 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.max-attempts=5 2022-12-08 15:03:46.199 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.preserved.username.list=admin,sys,system,sysdba,dba,oceanbase,obproxy,proxyro,ocp,ocp_monitor,ocp_agent,odc,oms,backup,drc,lbacsys,odp,temp 2022-12-08 15:03:46.199 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.enabled=true 2022-12-08 15:03:46.199 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.connect.timeout=1000 2022-12-08 15:03:46.200 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.read.timeout=1000 2022-12-08 15:03:46.200 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.on-ip.enabled=false 2022-12-08 15:03:46.200 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.on-user.enabled=true 2022-12-08 15:03:46.200 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.task.schedule.period=3 2022-12-08 15:03:46.201 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.role.forbidden.update.username.list=admin,system,obpass,obproxy,ocp_admin,monitor 2022-12-08 15:03:46.201 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.idempotent.client-token.expire.time=14d 2022-12-08 15:03:46.201 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.scrips.sequence-availability.threshold-percentage=0.8 2022-12-08 15:03:46.201 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-cluster-not-exists-name=__UNKNOWN__ 2022-12-08 15:03:46.202 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-database-not-exists-name=__UNKNOWN__ 2022-12-08 15:03:46.202 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-host-not-exists-ip=__UNKNOWN__ 2022-12-08 15:03:46.202 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-tenant-not-exists-name=__UNKNOWN__ 2022-12-08 15:03:46.203 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.core-pool-size=5 2022-12-08 15:03:46.203 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.max-pool-size=100 2022-12-08 15:03:46.203 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.queue-size=100 2022-12-08 15:03:46.203 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.thread-keep-alive-time=100 2022-12-08 15:03:46.203 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.internal.rpc.user.password=****** 2022-12-08 15:03:46.204 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.internal.rpc.user.username=system 2022-12-08 15:03:46.204 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.http.connect.timeout=180000 2022-12-08 15:03:46.204 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.http.read.timeout=180000 2022-12-08 15:03:46.205 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.tmp.dir=#{systemProperties['user.home'].concat('/logs/ocp')} 2022-12-08 15:03:46.205 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.max-download-speed=1024 2022-12-08 15:03:46.205 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.host=/var/log/message* 2022-12-08 15:03:46.205 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.obproxy=/home/admin/logs/obproxy/log/* 2022-12-08 15:03:46.205 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.observer=%s/log/* 2022-12-08 15:03:46.206 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.ocp_agent=/home/admin/ocp_agent/log/* 2022-12-08 15:03:46.206 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.enabled=true 2022-12-08 15:03:46.207 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.private-key=****** 2022-12-08 15:03:46.207 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.public-key=****** 2022-12-08 15:03:46.207 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.meta.cluster.name= 2022-12-08 15:03:46.207 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.metric.collect.interval.second=1 2022-12-08 15:03:46.208 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.host.enabled=true 2022-12-08 15:03:46.208 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.max-pool-size=3000 2022-12-08 15:03:46.208 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obcluster.enabled=true 2022-12-08 15:03:46.209 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obproxy.enabled=true 2022-12-08 15:03:46.209 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obsdk.sql-query-row-limit=10000 2022-12-08 15:03:46.209 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.data.retention-days={"ob_cluster_system_event":31,"ocp_metric_data_1":8,"ocp_metric_data_60":31,"metric_hour_data":1098,"metric_daily_data":1098} 2022-12-08 15:03:46.209 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.datasource.query.timeout.sec=120 2022-12-08 15:03:46.209 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.datasource.socket.timeout.ms=120000 2022-12-08 15:03:46.210 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.check-active-period-seconds=60 2022-12-08 15:03:46.210 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.check-inactive-period-seconds=50 2022-12-08 15:03:46.210 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.inactive.threshold.seconds=300 2022-12-08 15:03:46.210 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.host.exporters=/metrics/node/host,:62888/metrics/stat,:62889/metrics/stat 2022-12-08 15:03:46.211 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.host.metrics-list=load1,load5,load15,cpu_percent,io_read,io_write,io_read_time,io_write_time,io_read_byte,io_write_byte,net_recv,net_send,memory_used,memory_buffers,memory_free,host_disk_used,disk_percent,net_recv_percent,load1_per_cpu,memory_percent,net_send_percent,disk_readonly_flag,ssd_wear_indicator,tcp_retrans_percent,host_partition_usage_percent,memory_cached,ob_log_disk_usage_percent,ob_data_disk_usage_percent,ob_install_disk_usage_percent 2022-12-08 15:03:46.211 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.minute.exporters=:62888/metrics/stat,:62889/metrics/stat,/metrics/ob/extra,/metrics/obcloud/extra 2022-12-08 15:03:46.211 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.ob.exporters=/metrics/node/ob,/metrics/ob/basic,/metrics/ob/extra 2022-12-08 15:03:46.211 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.obproxy.exporters=/metrics/node/obproxy,/metrics/obproxy 2022-12-08 15:03:46.212 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.second.exporters=/metrics/node/host,/metrics/node/ob,/metrics/ob/basic,/metrics/node/obproxy,/metrics/obproxy 2022-12-08 15:03:46.212 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.database=monitor_database 2022-12-08 15:03:46.212 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.driverClassName=com.oceanbase.jdbc.Driver 2022-12-08 15:03:46.212 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.initialSize=10 2022-12-08 15:03:46.212 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.keepAlive=true 2022-12-08 15:03:46.213 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.maxActive=200 2022-12-08 15:03:46.213 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.maxWait=2000 2022-12-08 15:03:46.213 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.minIdle=2 2022-12-08 15:03:46.213 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.name=monitordb-connect-pool 2022-12-08 15:03:46.213 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.testWhileIdle=true 2022-12-08 15:03:46.214 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.validationQuery=SELECT 1 FROM DUAL 2022-12-08 15:03:46.214 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.host=192.168.28.54 2022-12-08 15:03:46.214 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.password=****** 2022-12-08 15:03:46.214 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.port=2883 2022-12-08 15:03:46.215 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.username=monitor_user@monitor_tenant#obcluster 2022-12-08 15:03:46.215 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.enabled=false 2022-12-08 15:03:46.215 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.heartbeat.expire.seconds=60 2022-12-08 15:03:46.215 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.heartbeat.interval.seconds=10 2022-12-08 15:03:46.216 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.replication.interval.seconds=30 2022-12-08 15:03:46.216 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.replication.properties.metadb.global-tables=[{"tableName":"mc_ocp_cluster", "mode":"FULL", "querySql":"select `id`, `name`, `role`, `address`, `metadb_config`, `version`, `status`, `last_heartbeat_time`, `create_time`, `update_time` from mc_ocp_cluster","writeSql":"replace into mc_ocp_cluster (`id`, `name`, `role`, `address`, `metadb_config`, `version`, `status`, `last_heartbeat_time`, `create_time`, `update_time`) values (:id, :name, :role, :address, :metadb_config, :version, :status, :last_heartbeat_time, :create_time, :update_time)"},{"tableName":"mc_common_sequence", "mode":"FULL", "querySql":"select `id`, `name`, `next_val`, `create_time`, `update_time` from mc_common_sequence","writeSql":"replace into mc_common_sequence (`id`, `name`, `next_val`, `create_time`, `update_time`) values (:id, :name, :next_val, :create_time, :update_time)"},{"tableName":"mc_ob_cluster", "mode": "FULL", "querySql":"select `ocp_cluster_id`, `ocp_ob_cluster_id`, `ob_cluster_name`, `ob_cluster_id`, `type`, `architecture`, `rootserver_json`, `ob_version`, `locker_id`, `lock_count`, `create_time`, `update_time` from mc_ob_cluster", "writeSql":"replace into mc_ob_cluster (`ocp_cluster_id`, `ocp_ob_cluster_id`, `ob_cluster_name`, `ob_cluster_id`, `type`, `architecture`, `rootserver_json`, `ob_version`, `locker_id`, `lock_count`, `create_time`, `update_time`) values (:ocp_cluster_id, :ocp_ob_cluster_id, :ob_cluster_name, :ob_cluster_id, :type, :architecture, :rootserver_json, :ob_version, :locker_id, :lock_count, :create_time, :update_time)"}, {"tableName":"mc_ocp_cluster_remote_call", "mode":"INCREMENTAL", "querySql":"select `uuid`, `caller_id`, `executor_id`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `max_retry_times`, `retry_interval`, `current_retry_time`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time` from mc_ocp_cluster_remote_call where update_time >= :INCREMENTAL_COLUMN_VALUE", "writeSql":"replace into mc_ocp_cluster_remote_call (`uuid`, `caller_id`, `executor_id`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `max_retry_times`, `retry_interval`, `current_retry_time`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time`) values (:uuid, :caller_id, :executor_id, :task_type, :request_type, :context, :arguments_json, :output_json, :max_retry_times, :retry_interval, :current_retry_time, :timeout, :status, :start_time, :finish_time, :create_time, :update_time)", "queryMaxRecordSql":"select max(update_time) from mc_ocp_cluster_remote_call"}, {"tableName":"mc_ocp_cluster_remote_call_instance", "mode":"INCREMENTAL", "querySql":"select `uuid`, `remote_call_uuid`, `caller_id`, `executor_id`, `server_ip_port`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time` from mc_ocp_cluster_remote_call_instance where update_time >= :INCREMENTAL_COLUMN_VALUE", "writeSql":"replace into mc_ocp_cluster_remote_call_instance (`uuid`, `remote_call_uuid`, `caller_id`, `executor_id`, `server_ip_port`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time`) values (:uuid, :remote_call_uuid, :caller_id, :executor_id, :server_ip_port, :task_type, :request_type, :context, :arguments_json, :output_json, :timeout, :status, :start_time, :finish_time, :create_time, :update_time)","queryMaxRecordSql":"select max(update_time) from mc_ocp_cluster_remote_call_instance"}] 2022-12-08 15:03:46.216 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.agent.socks-port=1080 2022-12-08 15:03:46.217 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.host-address=localhost 2022-12-08 15:03:46.217 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.socks-port=1080 2022-12-08 15:03:46.217 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.web-port=8088 2022-12-08 15:03:46.217 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.vpc.mode.enabled=false 2022-12-08 15:03:46.218 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.cluster.ops.blacklist= 2022-12-08 15:03:46.219 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.slowsql.threshold=100000 2022-12-08 15:03:46.219 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.upgrade.allow-downgrade=false 2022-12-08 15:03:46.219 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.upgrade.dependencies.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/oceanbase_upgrade_dep.yml')} 2022-12-08 15:03:46.220 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.obcloud.api.address= 2022-12-08 15:03:46.220 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.connector.cache.max-idle-seconds=3600 2022-12-08 15:03:46.220 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.connector.cache.max-size=1000 2022-12-08 15:03:46.221 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connect-timeout=5000 2022-12-08 15:03:46.221 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connection.max-per-route=100 2022-12-08 15:03:46.221 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connection.max-pool-size=100 2022-12-08 15:03:46.221 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.read-timeout=30000 2022-12-08 15:03:46.222 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.socket-timeout=3000 2022-12-08 15:03:46.223 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.core-pool-size=500 2022-12-08 15:03:46.223 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.keep-alive-time=120000 2022-12-08 15:03:46.223 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.max-pool-size=1500 2022-12-08 15:03:46.223 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.ssh.connect-timeout=10000 2022-12-08 15:03:46.224 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.ssh.default-command-timeout=10000 2022-12-08 15:03:46.224 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.delete-server.reserve-data-enabled=false 2022-12-08 15:03:46.225 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.resource.trend.collect.period=daily 2022-12-08 15:03:46.225 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.resource.trend.max-point=20 2022-12-08 15:03:46.225 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.single-idc-for-zone-enabled=true 2022-12-08 15:03:46.226 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.sql-execute.enabled=false 2022-12-08 15:03:46.226 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.sql-execute.sql-type.whitelist=SELECT,SHOW 2022-12-08 15:03:46.227 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.tenant.allow-small-unit=false 2022-12-08 15:03:46.227 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.tenant.whitelist.attach-default-whitelist=true 2022-12-08 15:03:46.227 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.unit.unused.max-reserve-hour=1 2022-12-08 15:03:46.228 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.password=****** 2022-12-08 15:03:46.228 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.username=proxyro 2022-12-08 15:03:46.228 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.start.command.template=./bin/obproxy -p 2883 -n %s -o obproxy_config_server_url='%s/services?User_ID=alibaba&UID=test&Action=GetObProxyConfig',enable_metadb_used=false,enable_strict_kernel_release=false,enable_proxy_scramble=true,proxy_mem_limited=2G,log_dir_size_threshold=10G,prometheus_sync_interval=1s 2022-12-08 15:03:46.229 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.odp.root.default.password=****** 2022-12-08 15:03:46.229 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.ash.earliest-analyse-time=8 2022-12-08 15:03:46.229 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.ash.max-analyse-range=60m 2022-12-08 15:03:46.230 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.parallel.sql.limit=2000 2022-12-08 15:03:46.230 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.parallel.sql.partition.retention.days=15 2022-12-08 15:03:46.230 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.awful-performance-index-used-config={"enabled":true, "cpuTimeLimitUs":100000, "execPsLimit":5.0, "fullLogicalReadsLimit":10000} 2022-12-08 15:03:46.231 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.cpu-time-proportion-high-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":10.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":30, "sqlCountLimit":20, "cpuTimePercentLimit":20} 2022-12-08 15:03:46.231 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.database-white-list=oceanbase,information_schema,mysql,__recyclebin,sys,__public 2022-12-08 15:03:46.231 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.diagnose.standby-cluster.enabled=0 2022-12-08 15:03:46.231 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.execution-spike-config={"enabled":true, "cpuTimeLimitUs":3000, "execPsLimit":5.0, "pointsLimit":5, "compareMin":20, "avgExecutionMultiply":{"0":6, "1":5, "5":4, "10":3, "50": 2.5, "100": 2, "500": 1.6}, "stdExecutionMultiply":{"0":80, "1":60 , "3": 30,"5":20, "10":15, "20":8, "30":6, "50":5, "80":4}} 2022-12-08 15:03:46.232 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.index-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2022-12-08 15:03:46.232 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.ineffective-hint-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 15:03:46.232 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.outline-history-query-days=30 2022-12-08 15:03:46.232 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.perf-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2022-12-08 15:03:46.232 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-after-plan-changed-config={"enabled":true, "compareMin":5, "cpuTimeMultiply":{"0":50, "1":30, "10":10, "100":8, "1000":6}} 2022-12-08 15:03:46.233 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":5.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":5, "compareMin":20, "cpuTimeMultiply":{"0":50, "1":30, "10":10, "100":8, "1000":6}} 2022-12-08 15:03:46.233 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.query-timeout=30000000 2022-12-08 15:03:46.233 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.row-lock-contention-high-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":100000, "elapsedTimeLimitUs":0} 2022-12-08 15:03:46.233 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.sql-diagnosis-retention-days=30 2022-12-08 15:03:46.234 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-exists-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 15:03:46.234 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-used-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 15:03:46.235 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.tenant-white-list=null 2022-12-08 15:03:46.235 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.advisor-plan-max-query-range=7d 2022-12-08 15:03:46.236 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag-plan-change-config={"enabled":true,"schedulePeriodMin":2, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":500,"diagPeriodSec":120,"diagOffsetSec":120,"maxDiagPeriodSec":600} 2022-12-08 15:03:46.236 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-queue-max-size=1000000 2022-12-08 15:03:46.236 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-core-size=30 2022-12-08 15:03:46.236 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-max-size=300 2022-12-08 15:03:46.237 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.earliest-query-time=8d 2022-12-08 15:03:46.237 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.index-advisor-cpu-time-threshold=10 2022-12-08 15:03:46.237 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.index-advisor-elapsed-time-threshold=20 2022-12-08 15:03:46.237 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.info.parameterize.sql=false 2022-12-08 15:03:46.237 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.info.parse.sql.type=true 2022-12-08 15:03:46.238 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.max-query-range=24h 2022-12-08 15:03:46.238 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.batch.insert.size=100 2022-12-08 15:03:46.238 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.core.thread=8 2022-12-08 15:03:46.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.insert.query.rate.limit=10 2022-12-08 15:03:46.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.max.thread=16 2022-12-08 15:03:46.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.query.limit=2000 2022-12-08 15:03:46.239 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.queue.size=20000 2022-12-08 15:03:46.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-granularity=30s 2022-12-08 15:03:46.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-query-interval=2h 2022-12-08 15:03:46.240 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-retention=8d 2022-12-08 15:03:46.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.prepare-partition-ahead=8 2022-12-08 15:03:46.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-digest-limit=0 2022-12-08 15:03:46.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-digest-trend.points=15 2022-12-08 15:03:46.241 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-timeout=30000000 2022-12-08 15:03:46.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.slow-sql-limit=2000 2022-12-08 15:03:46.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-audit-sample-retention=8d 2022-12-08 15:03:46.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-granularity=30s 2022-12-08 15:03:46.242 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-query-interval=2h 2022-12-08 15:03:46.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-retention=2d 2022-12-08 15:03:46.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-granularity=2m 2022-12-08 15:03:46.243 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-query-interval=12h 2022-12-08 15:03:46.244 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-retention=8d 2022-12-08 15:03:46.244 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-granularity=10m 2022-12-08 15:03:46.244 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-query-interval=48h 2022-12-08 15:03:46.244 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-retention=15d 2022-12-08 15:03:46.245 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-info-secondary-cache-expiration=30m 2022-12-08 15:03:46.245 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level0-query-interval=30m 2022-12-08 15:03:46.245 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level1-query-interval=2h 2022-12-08 15:03:46.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.top-sql-limit=2000 2022-12-08 15:03:46.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.tuning-advisor-cpu-time-ratio-of-plan-comparison=0.8 2022-12-08 15:03:46.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.transaction.partition.retention.days=7 2022-12-08 15:03:46.246 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.site.url=http://192.168.28.62:8080 2022-12-08 15:03:46.247 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.startup-check.metadb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2022-12-08 15:03:46.247 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.startup-check.monitordb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2022-12-08 15:03:46.247 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.default.language=zh-CN 2022-12-08 15:03:46.248 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.default.timezone= 2022-12-08 15:03:46.248 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.event.excluded={balancer: {'start_sql_bkgd_task','finish_sql_bkgd_task'}} 2022-12-08 15:03:46.248 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.address=localhost 2022-12-08 15:03:46.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.cluster-name=obdv1 2022-12-08 15:03:46.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.database=obproxy 2022-12-08 15:03:46.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.enabled=false 2022-12-08 15:03:46.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.user=root@obproxy 2022-12-08 15:03:46.249 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.port=2888 2022-12-08 15:03:46.250 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.batch-interval-millis=10 2022-12-08 15:03:46.250 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.batch-size=1000 2022-12-08 15:03:46.250 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.preserve-days=30 2022-12-08 15:03:46.250 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.thread.core-pool-size=4 2022-12-08 15:03:46.251 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.thread.maximum-pool-size=16 2022-12-08 15:03:46.251 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.version=4.0.0 2022-12-08 15:03:46.251 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.web.tracking.enabled=False 2022-12-08 15:03:46.251 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.client-id=TO_BE_REPLACED 2022-12-08 15:03:46.251 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.client-secret=****** 2022-12-08 15:03:46.252 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.issuer=https://example.com/oauth2/default 2022-12-08 15:03:46.252 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.redirect-uri=TO_BE_REPLACED 2022-12-08 15:03:46.252 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : server.port=8080 2022-12-08 15:03:46.252 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : server.servlet.session.timeout=30m 2022-12-08 15:03:46.253 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : slow-sql.query-sql-info-from.cache.directly=false 2022-12-08 15:03:46.253 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.data.web.pageable.one-indexed-parameters=true 2022-12-08 15:03:46.253 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.initialSize=10 2022-12-08 15:03:46.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.keepAlive=true 2022-12-08 15:03:46.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.maxActive=100 2022-12-08 15:03:46.254 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.maxWait=2000 2022-12-08 15:03:46.255 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.minIdle=2 2022-12-08 15:03:46.255 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.name=metadb-connect-pool 2022-12-08 15:03:46.255 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.testWhileIdle=true 2022-12-08 15:03:46.255 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.validationQuery=SELECT 1 FROM DUAL 2022-12-08 15:03:46.256 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.hibernate.naming-strategy=org.hibernate.cfg.ImprovedNamingStrategy 2022-12-08 15:03:46.256 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.properties.hibernate.dialect=org.hibernate.dialect.MySQL5Dialect 2022-12-08 15:03:46.256 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.properties.hibernate.globally_quoted_identifiers=true 2022-12-08 15:03:46.256 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.enabled=true 2022-12-08 15:03:46.256 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.max-file-size=2048MB 2022-12-08 15:03:46.257 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.max-request-size=2048MB 2022-12-08 15:03:46.257 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.api-docs.enabled=false 2022-12-08 15:03:46.257 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.api-docs.path=/doc/api-docs 2022-12-08 15:03:46.258 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.paths-to-exclude=null 2022-12-08 15:03:46.259 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.paths-to-match=/api/v2/** 2022-12-08 15:03:46.259 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.swagger-ui.path=/doc/swagger-ui.html 2022-12-08 15:03:46.259 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : sql-stat.flush-sql-info-to-cache=true 2022-12-08 15:03:46.260 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.core-pool-size=8 2022-12-08 15:03:46.260 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.max-pool-size=64 2022-12-08 15:03:46.260 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.task-queue-size=1800 2022-12-08 15:03:46.260 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : top-sql.query-sql-info-from.cache.directly=false 2022-12-08 15:03:46.261 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ****************************************************************************** 2022-12-08 15:03:46.720 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:03:46.726 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:03:46.987 INFO 42 --- [pool-ocp-schedules-1,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 15:03:47.022 INFO 42 --- [pool-ocp-schedules-9,,8eea44606741] .s.a.AnnotationAsyncExecutionInterceptor : More than one TaskExecutor bean found within the context, and none is named 'taskExecutor'. Mark one of them as primary or name it 'taskExecutor' (possibly as an alias) in order to use it for async processing: [alarmTaskExecutor, notificationSendExecutor, alarmDetectMetricExecutor] 2022-12-08 15:03:47.031 INFO 42 --- [pool-ocp-schedules-8,,715c811e15f4] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:03:47.035 INFO 42 --- [pool-ocp-schedules-17,,3090840cb089] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:03:47.037 INFO 42 --- [pool-ocp-schedules-18,,fbd1d4d79f08] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:03:47.037 INFO 42 --- [pool-ocp-schedules-18,,fbd1d4d79f08] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:03:47.038 INFO 42 --- [pool-ocp-schedules-18,,351c987dcc05] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:03:47.041 INFO 42 --- [pool-ocp-schedules-3,,5ae7c796de0d] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:03:47.049 INFO 42 --- [pool-ocp-schedules-17,,561717d127b2] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 15:03:47.322 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:47.323 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:47.364 INFO 42 --- [pool-ocp-schedules-8,,715c811e15f4] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:03:47.430 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.service.TaskRepositoryService : fetchNeedExecute, tryAcquireTasksCount=2, fetchedCount=2 2022-12-08 15:03:47.433 INFO 42 --- [pool-ocp-schedules-6,,9e1a3156c518] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:03:47.434 INFO 42 --- [pool-ocp-schedules-5,,9eed10931b57] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:03:47.435 INFO 42 --- [pool-ocp-schedules-20,,c60d7b7de7eb] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:03:47.444 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1412, sql=alter table `metric_data_second` add partition(partition p20221211 values less than (1670688000)) 2022-12-08 15:03:47.452 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:03:47.452 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:47.453 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:47.463 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2022-12-08 15:03:47.498 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:47.499 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:47.512 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:03:47.527 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:47.527 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:47.535 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.alarm.core.task.AlarmDetectTask : AlarmDetectTask created 2022-12-08 15:03:47.539 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2022-12-08 15:03:47.550 INFO 42 --- [pool-ocp-schedules-19,,412e170dbb8c] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 15:03:47.564 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221108 2022-12-08 15:03:47.568 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=1, uuid=5d1c7c8a-1780-40fe-8c4f-b46ce797f238, taskType=AlarmDetect, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T07:02:01.539848Z, startAt=2022-12-08T07:03:47.160Z, endAt=null, heartbeatAt=2022-12-08T07:03:47.160Z, result=executing) 2022-12-08 15:03:47.577 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:47.577 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:47.581 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221108 values less than (1667836800)) 2022-12-08 15:03:47.609 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:03:47.627 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : Started OcpServerApplication in 383.478 seconds (JVM running for 388.927) 2022-12-08 15:03:47.640 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:03:47.668 INFO 42 --- [pool-ocp-schedules-3,,842d5e8e769a] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:03:47.672 INFO 42 --- [pool-ocp-schedules-3,,842d5e8e769a] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:03:47.674 INFO 42 --- [pool-ocp-schedules-3,,842d5e8e769a] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:03:47.814 INFO 42 --- [SimpleAsyncTaskExecutor-9,,] c.o.o.p.a.i.SessionEventSyncService : start to sync session wait event info, cluster ids is [] 2022-12-08 15:03:47.815 INFO 42 --- [SimpleAsyncTaskExecutor-9,,] c.o.o.p.a.i.SessionEventSyncService : Sync session wait event info finished, cluster ids is [] 2022-12-08 15:03:47.872 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100000, channelName=钉钉群消息样例 2022-12-08 15:03:47.872 INFO 42 --- [pool-ocp-schedules-14,,e2595c758f0b] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100000, channelName=钉钉群消息样例 2022-12-08 15:03:47.873 INFO 42 --- [pool-ocp-schedules-14,,e2595c758f0b] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=钉钉群消息样例 2022-12-08 15:03:47.873 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=钉钉群消息样例 2022-12-08 15:03:48.082 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100001, channelName=自定义脚本通道(待配置样例) 2022-12-08 15:03:48.083 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=自定义脚本通道(待配置样例) 2022-12-08 15:03:48.083 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=2, updatedCount=2, failedToUpdateCount=0 2022-12-08 15:03:48.101 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.core.process.AlarmProcessor : AlarmProcessor init done, lastProcessTime=2022-12-08T15:03:48.087114+08:00 2022-12-08 15:03:48.102 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.core.task.AlarmProcessTask : AlarmProcessTask created 2022-12-08 15:03:48.110 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=2, uuid=142cf501-1f3a-4dfd-adba-cf2d83e0b467, taskType=AlarmProcess, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T07:02:01.647237Z, startAt=2022-12-08T07:03:47.160Z, endAt=null, heartbeatAt=2022-12-08T07:03:47.160Z, result=executing) 2022-12-08 15:03:48.111 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.utils.task.AlarmTaskManager : startNeedExecute, activeCount=0, tryStartCount=2, startedCount=2 2022-12-08 15:03:48.120 INFO 42 --- [pool-ocp-schedules-14,,e2595c758f0b] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100001, channelName=自定义脚本通道(待配置样例) 2022-12-08 15:03:48.121 INFO 42 --- [pool-ocp-schedules-14,,e2595c758f0b] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=自定义脚本通道(待配置样例) 2022-12-08 15:03:48.121 INFO 42 --- [pool-ocp-schedules-14,,e2595c758f0b] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=2, updatedCount=2, failedToUpdateCount=0 2022-12-08 15:03:48.297 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:03:48.298 INFO 42 --- [pool-ocp-schedules-15,,2ceba5263ebc] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:03:48.316 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:03:48.312077+08:00, lastProcessTime=2022-12-08T15:03:48.087114+08:00 2022-12-08 15:03:48.467 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obagent_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.469 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obagent_dead 2022-12-08 15:03:48.469 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obagent_dead 2022-12-08 15:03:48.471 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cannot_connected, duration=PT1M, resolveTimeout=PT10S 2022-12-08 15:03:48.471 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cannot_connected 2022-12-08 15:03:48.471 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cannot_connected 2022-12-08 15:03:48.474 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_connection_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.474 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_connection_percent_over_threshold 2022-12-08 15:03:48.475 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_connection_percent_over_threshold 2022-12-08 15:03:48.475 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 15:03:48.476 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_cpu_percent_over_threshold 2022-12-08 15:03:48.476 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_cpu_percent_over_threshold 2022-12-08 15:03:48.477 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 15:03:48.477 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cpu_percent_over_threshold 2022-12-08 15:03:48.477 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cpu_percent_over_threshold 2022-12-08 15:03:48.478 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.479 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold 2022-12-08 15:03:48.479 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_frozen_version_delta_over_threshold 2022-12-08 15:03:48.480 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_net_recv_percent_over_threshold, duration=PT2M, resolveTimeout=PT1M 2022-12-08 15:03:48.480 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_recv_percent_over_threshold 2022-12-08 15:03:48.480 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_net_recv_percent_over_threshold 2022-12-08 15:03:48.481 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_exists_inactive_server, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:03:48.482 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_inactive_server 2022-12-08 15:03:48.482 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_exists_inactive_server 2022-12-08 15:03:48.483 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_exists_index_fail_table, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.483 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_index_fail_table 2022-12-08 15:03:48.484 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_exists_index_fail_table 2022-12-08 15:03:48.485 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_load1_per_cpu_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 15:03:48.485 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_load1_per_cpu_over_threshold 2022-12-08 15:03:48.486 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_load1_per_cpu_over_threshold 2022-12-08 15:03:48.487 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_mem_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.487 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_mem_percent_over_threshold 2022-12-08 15:03:48.488 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_mem_percent_over_threshold 2022-12-08 15:03:48.488 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_merge_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.489 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_timeout 2022-12-08 15:03:48.489 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_merge_timeout 2022-12-08 15:03:48.490 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_merge_error, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.490 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_error 2022-12-08 15:03:48.491 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_merge_error 2022-12-08 15:03:48.492 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_no_frozen, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.498 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_frozen 2022-12-08 15:03:48.499 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_no_frozen 2022-12-08 15:03:48.501 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_no_merge, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.502 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_merge 2022-12-08 15:03:48.502 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_no_merge 2022-12-08 15:03:48.503 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_net_send_percent_over_threshold, duration=PT2M, resolveTimeout=PT1M 2022-12-08 15:03:48.503 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_send_percent_over_threshold 2022-12-08 15:03:48.503 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_net_send_percent_over_threshold 2022-12-08 15:03:48.504 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_partition_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.505 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_partition_count_over_threshold 2022-12-08 15:03:48.505 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_partition_count_over_threshold 2022-12-08 15:03:48.506 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_disk_readonly, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.507 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_disk_readonly 2022-12-08 15:03:48.507 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_disk_readonly 2022-12-08 15:03:48.508 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant500_mem_hold_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.508 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_over_threshold 2022-12-08 15:03:48.508 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant500_mem_hold_over_threshold 2022-12-08 15:03:48.509 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_server_sstable_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.510 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_sstable_percent_over_threshold 2022-12-08 15:03:48.510 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_server_sstable_percent_over_threshold 2022-12-08 15:03:48.510 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:48.510 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:48.511 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_zone_sstable_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.512 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_zone_sstable_percent_over_threshold 2022-12-08 15:03:48.512 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_zone_sstable_percent_over_threshold 2022-12-08 15:03:48.513 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold, duration=PT1M, resolveTimeout=PT10S 2022-12-08 15:03:48.513 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold 2022-12-08 15:03:48.513 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_tcp_retrans_percent_over_threshold 2022-12-08 15:03:48.514 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:48.514 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.515 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold 2022-12-08 15:03:48.515 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant500_mem_hold_percent_over_threshold 2022-12-08 15:03:48.516 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_active_memstore_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.516 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_active_memstore_percent_over_threshold 2022-12-08 15:03:48.517 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_active_memstore_percent_over_threshold 2022-12-08 15:03:48.517 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 15:03:48.518 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_cpu_percent_over_threshold 2022-12-08 15:03:48.518 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_cpu_percent_over_threshold 2022-12-08 15:03:48.519 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_memstore_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.520 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_memstore_percent_over_threshold 2022-12-08 15:03:48.520 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_memstore_percent_over_threshold 2022-12-08 15:03:48.521 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_sync_failed, duration=PT2M, resolveTimeout=PT1M 2022-12-08 15:03:48.521 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_failed 2022-12-08 15:03:48.521 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_sync_failed 2022-12-08 15:03:48.522 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_status_check_failed, duration=PT2M, resolveTimeout=PT1M 2022-12-08 15:03:48.522 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_status_check_failed 2022-12-08 15:03:48.523 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_status_check_failed 2022-12-08 15:03:48.523 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_sync_delay_time_too_long, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.524 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_delay_time_too_long 2022-12-08 15:03:48.524 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_sync_delay_time_too_long 2022-12-08 15:03:48.525 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_exists_expired_xa_trans, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.525 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_exists_expired_xa_trans 2022-12-08 15:03:48.525 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_exists_expired_xa_trans 2022-12-08 15:03:48.526 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=backup_storage_capacity_retry_times_exceeded, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.527 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_retry_times_exceeded 2022-12-08 15:03:48.527 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=backup_storage_capacity_retry_times_exceeded 2022-12-08 15:03:48.528 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=backup_storage_capacity_timeout_or_interrupted, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.528 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_timeout_or_interrupted 2022-12-08 15:03:48.528 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=backup_storage_capacity_timeout_or_interrupted 2022-12-08 15:03:48.529 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_unavailable, duration=PT2M, resolveTimeout=PT1M 2022-12-08 15:03:48.529 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_unavailable 2022-12-08 15:03:48.530 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_unavailable 2022-12-08 15:03:48.531 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ocp_remote_server_time_diff_too_large, duration=PT1M, resolveTimeout=PT1M 2022-12-08 15:03:48.531 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_remote_server_time_diff_too_large 2022-12-08 15:03:48.531 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ocp_remote_server_time_diff_too_large 2022-12-08 15:03:48.532 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxy_process_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.532 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_dead 2022-12-08 15:03:48.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxy_process_dead 2022-12-08 15:03:48.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxyd_process_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_dead 2022-12-08 15:03:48.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxyd_process_dead 2022-12-08 15:03:48.534 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221109 2022-12-08 15:03:48.535 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxy_cannot_connected, duration=PT1M, resolveTimeout=PT10S 2022-12-08 15:03:48.535 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_cannot_connected 2022-12-08 15:03:48.535 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxy_cannot_connected 2022-12-08 15:03:48.537 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_install_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.537 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_install_disk_percent_over_threshold 2022-12-08 15:03:48.537 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_install_disk_percent_over_threshold 2022-12-08 15:03:48.538 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_data_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.538 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_data_disk_percent_over_threshold 2022-12-08 15:03:48.539 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_data_disk_percent_over_threshold 2022-12-08 15:03:48.540 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_log_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.540 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:48.540 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:48.540 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_log_disk_percent_over_threshold 2022-12-08 15:03:48.541 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_log_disk_percent_over_threshold 2022-12-08 15:03:48.541 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=monitor_exporter_unavaliable, duration=PT3M, resolveTimeout=PT1M 2022-12-08 15:03:48.542 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monitor_exporter_unavaliable 2022-12-08 15:03:48.542 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=monitor_exporter_unavaliable 2022-12-08 15:03:48.543 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_ntp_service_not_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.543 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_service_not_exist 2022-12-08 15:03:48.543 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_ntp_service_not_exist 2022-12-08 15:03:48.544 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_ntp_offset_too_large, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.545 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_offset_too_large 2022-12-08 15:03:48.545 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_ntp_offset_too_large 2022-12-08 15:03:48.545 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ic_server_connect_failed, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.546 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ic_server_connect_failed 2022-12-08 15:03:48.546 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ic_server_connect_failed 2022-12-08 15:03:48.547 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=vpc_connect_failed, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.547 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=vpc_connect_failed 2022-12-08 15:03:48.547 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=vpc_connect_failed 2022-12-08 15:03:48.548 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221109 values less than (1667923200)) 2022-12-08 15:03:48.548 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_disk_readonly, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.548 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_disk_readonly 2022-12-08 15:03:48.548 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_disk_readonly 2022-12-08 15:03:48.549 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_goroutine_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.549 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_goroutine_count_over_threshold 2022-12-08 15:03:48.550 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_goroutine_count_over_threshold 2022-12-08 15:03:48.550 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_open_fd_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.551 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_open_fd_count_over_threshold 2022-12-08 15:03:48.551 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_open_fd_count_over_threshold 2022-12-08 15:03:48.551 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_res_memory_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.552 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_res_memory_over_threshold 2022-12-08 15:03:48.552 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_res_memory_over_threshold 2022-12-08 15:03:48.552 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_compaction_error, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.553 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_compaction_error 2022-12-08 15:03:48.553 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_compaction_error 2022-12-08 15:03:48.554 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_no_frozen, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.554 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_frozen 2022-12-08 15:03:48.554 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_no_frozen 2022-12-08 15:03:48.555 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_no_compaction, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.555 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_compaction 2022-12-08 15:03:48.555 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_no_compaction 2022-12-08 15:03:48.556 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_log_disk_usage_high, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.556 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_disk_usage_high 2022-12-08 15:03:48.556 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_log_disk_usage_high 2022-12-08 15:03:48.557 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_task_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.557 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_task_timeout 2022-12-08 15:03:48.557 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_task_timeout 2022-12-08 15:03:48.558 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_task_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.559 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_task_timeout 2022-12-08 15:03:48.559 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_task_timeout 2022-12-08 15:03:48.560 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_expired_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.561 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_expired_trans_exist 2022-12-08 15:03:48.561 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_expired_trans_exist 2022-12-08 15:03:48.562 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_long_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.562 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_long_trans_exist 2022-12-08 15:03:48.562 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_long_trans_exist 2022-12-08 15:03:48.563 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_large_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:03:48.564 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_large_trans_exist 2022-12-08 15:03:48.564 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_large_trans_exist 2022-12-08 15:03:48.565 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=node_file_root_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:03:48.565 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_root_usage 2022-12-08 15:03:48.565 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=node_file_root_usage 2022-12-08 15:03:48.573 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_fd_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:03:48.573 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_fd_usage 2022-12-08 15:03:48.574 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_fd_usage 2022-12-08 15:03:48.575 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_sys_abnormal, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.575 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_sys_abnormal 2022-12-08 15:03:48.575 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_sys_abnormal 2022-12-08 15:03:48.578 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_util_full, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.578 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_full 2022-12-08 15:03:48.578 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_util_full 2022-12-08 15:03:48.581 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_util_hwm, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.581 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_hwm 2022-12-08 15:03:48.581 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_util_hwm 2022-12-08 15:03:48.583 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_kernel_io_hang, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.583 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_kernel_io_hang 2022-12-08 15:03:48.583 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_kernel_io_hang 2022-12-08 15:03:48.584 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_sda_ioawait, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.584 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_sda_ioawait 2022-12-08 15:03:48.585 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_sda_ioawait 2022-12-08 15:03:48.585 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_nvme_ioawait, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.586 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_nvme_ioawait 2022-12-08 15:03:48.586 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_nvme_ioawait 2022-12-08 15:03:48.587 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_drop, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.587 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_drop 2022-12-08 15:03:48.587 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_drop 2022-12-08 15:03:48.588 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_error, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.588 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_error 2022-12-08 15:03:48.588 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_error 2022-12-08 15:03:48.589 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_not_exist, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:03:48.589 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_not_exist 2022-12-08 15:03:48.589 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_not_exist 2022-12-08 15:03:48.590 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_core_dump, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:03:48.591 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_core_dump 2022-12-08 15:03:48.592 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_core_dump 2022-12-08 15:03:48.593 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_nic_1000m_full, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.593 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_full 2022-12-08 15:03:48.594 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_nic_1000m_full 2022-12-08 15:03:48.594 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_nic_1000m_hwm, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.595 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_hwm 2022-12-08 15:03:48.598 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_nic_1000m_hwm 2022-12-08 15:03:48.600 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_overload, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:03:48.601 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_overload 2022-12-08 15:03:48.601 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_overload 2022-12-08 15:03:48.602 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=node_file_inode_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:03:48.602 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_inode_usage 2022-12-08 15:03:48.603 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=node_file_inode_usage 2022-12-08 15:03:48.604 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_cpu_irq_error, duration=PT1M, resolveTimeout=PT10S 2022-12-08 15:03:48.604 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_cpu_irq_error 2022-12-08 15:03:48.604 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_cpu_irq_error 2022-12-08 15:03:48.604 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=75, updatedCount=75, failedToUpdateCount=0 2022-12-08 15:03:48.902 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:48.914 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:49.174 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:49.174 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:49.178 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:49.190 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221110 2022-12-08 15:03:49.194 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:49.194 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:49.197 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221110 values less than (1668009600)) 2022-12-08 15:03:49.317 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:03:48.312077+08:00, resultsCount=0 2022-12-08 15:03:49.318 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:03:48.312077+08:00, resultsCount=0 2022-12-08 15:03:49.319 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:03:48.312077+08:00 2022-12-08 15:03:50.003 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:50.003 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:50.005 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:50.015 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221111 2022-12-08 15:03:50.017 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:50.018 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:50.020 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221111 values less than (1668096000)) 2022-12-08 15:03:50.487 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:03:50.490 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:50.536 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:03:50.536 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:03:50.603 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:03:50.604 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:03:50.649 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:03:51.179 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1159, sql=alter table `metric_data_minute` add partition(partition p20221111 values less than (1668096000)) 2022-12-08 15:03:51.182 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:51.183 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:51.186 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:51.198 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221112 2022-12-08 15:03:51.205 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:51.206 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:51.209 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221112 values less than (1668182400)) 2022-12-08 15:03:51.747 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:51.748 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:51.750 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:51.760 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221113 2022-12-08 15:03:51.763 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:51.763 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:51.767 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221113 values less than (1668268800)) 2022-12-08 15:03:51.915 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:51.919 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:52.317 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:52.318 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:52.321 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:52.335 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221114 2022-12-08 15:03:52.339 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:52.339 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:52.344 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221114 values less than (1668355200)) 2022-12-08 15:03:52.478 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:03:53.225 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:53.226 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:53.230 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:53.252 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221115 2022-12-08 15:03:53.258 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:53.258 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:53.274 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221115 values less than (1668441600)) 2022-12-08 15:03:53.355 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:03:53.363 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:03:53.662 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:53.714 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:54.157 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:03:54.467 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1193, sql=alter table `metric_data_minute` add partition(partition p20221115 values less than (1668441600)) 2022-12-08 15:03:54.477 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:54.478 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:54.483 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:54.507 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221116 2022-12-08 15:03:54.517 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:54.518 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:54.522 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221116 values less than (1668528000)) 2022-12-08 15:03:54.920 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:54.939 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:55.442 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:03:55.704 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1182, sql=alter table `metric_data_minute` add partition(partition p20221116 values less than (1668528000)) 2022-12-08 15:03:55.708 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:55.709 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:55.712 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:55.735 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221117 2022-12-08 15:03:55.742 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:55.743 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:55.749 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221117 values less than (1668614400)) 2022-12-08 15:03:56.561 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:56.562 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:56.570 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:56.587 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221118 2022-12-08 15:03:56.590 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:56.591 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:56.594 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221118 values less than (1668700800)) 2022-12-08 15:03:56.776 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:03:56.776 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:03:57.036 INFO 42 --- [pool-ocp-schedules-4,,d2b92cfb5391] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:03:57.041 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:03:57.041 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:03:57.219 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:57.220 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:57.224 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:57.242 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221119 2022-12-08 15:03:57.248 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:57.249 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:57.252 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221119 values less than (1668787200)) 2022-12-08 15:03:57.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:03:57.580 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:03:57.648 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:03:57.626572+08:00, lastProcessTime=2022-12-08T15:03:48.312077+08:00 2022-12-08 15:03:57.850 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:03:57.626572+08:00, resultsCount=0 2022-12-08 15:03:57.850 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:03:57.626572+08:00, resultsCount=0 2022-12-08 15:03:57.851 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:03:57.626572+08:00 2022-12-08 15:03:57.940 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:03:57.943 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:57.943 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:57.948 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:03:57.949 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:57.966 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221120 2022-12-08 15:03:57.972 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:57.973 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:57.979 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221120 values less than (1668873600)) 2022-12-08 15:03:58.704 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:58.705 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:58.708 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:58.742 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221121 2022-12-08 15:03:58.759 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:58.760 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:58.764 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221121 values less than (1668960000)) 2022-12-08 15:03:59.314 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:59.315 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:59.323 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:03:59.325 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:03:59.329 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:03:59.342 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221122 2022-12-08 15:03:59.346 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:03:59.347 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:03:59.350 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221122 values less than (1669046400)) 2022-12-08 15:03:59.852 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:03:59.999 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:00.000 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:00.003 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:00.021 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221123 2022-12-08 15:04:00.026 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:00.027 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:00.030 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221123 values less than (1669132800)) 2022-12-08 15:04:00.141 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:00.205 INFO 42 --- [pool-prometheus-minute-schedule-1,,be01d516bc04] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483100, interval=60 2022-12-08 15:04:00.205 INFO 42 --- [pool-prometheus-minute-schedule-1,,be01d516bc04] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483040, count=0, elapsed=1668812557165 2022-12-08 15:04:00.208 INFO 42 --- [pool-prometheus-minute-schedule-2,,c70a740e4434] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483100, interval=60 2022-12-08 15:04:00.209 INFO 42 --- [pool-prometheus-minute-schedule-2,,c70a740e4434] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483040, count=0, elapsed=1668812557169 2022-12-08 15:04:00.464 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:04:00.650 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:00.653 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:04:00.744 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:04:00.768 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:00.769 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:00.772 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:00.784 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221124 2022-12-08 15:04:00.787 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:00.787 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:00.790 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221124 values less than (1669219200)) 2022-12-08 15:04:00.881 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:04:00.0, currentDate=Thu Dec 08 15:04:00 CST 2022 2022-12-08 15:04:00.882 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=null, nextRunTime=2022-12-08 15:04:00.0} 2022-12-08 15:04:00.913 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:04:00.949 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:00.954 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:00.989 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:17.0, nextRun=2022-12-08 15:04:00.0, currentDate=Thu Dec 08 15:04:00 CST 2022 2022-12-08 15:04:00.990 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:03:17.0, nextRunTime=2022-12-08 15:04:00.0} 2022-12-08 15:04:01.007 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:04:01.008 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:04:01.008 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:04:01.134 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:22.0, nextRun=2022-12-08 15:04:00.0, currentDate=Thu Dec 08 15:04:01 CST 2022 2022-12-08 15:04:01.135 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:03:22.0, nextRunTime=2022-12-08 15:04:00.0} 2022-12-08 15:04:01.226 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.o.o.p.t.i.a.CollectTransSatatSchedule : The last trans sql collect task is still running, skip current task 2022-12-08 15:04:01.226 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Collect trans stat to SqlAggregateData for alarm 2022-12-08 15:04:01.346 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:22.0, nextRun=2022-12-08 15:04:00.0, currentDate=Thu Dec 08 15:04:01 CST 2022 2022-12-08 15:04:01.347 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:03:22.0, nextRunTime=2022-12-08 15:04:00.0} 2022-12-08 15:04:01.380 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.o.o.p.s.i.a.CollectSlowSqlSchedule : The last slow sql collect task is still running, skip current task 2022-12-08 15:04:01.381 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Collect SlowSql to SqlAggregateData for alarm 2022-12-08 15:04:01.487 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:36.0, nextRun=2022-12-08 15:04:00.0, currentDate=Thu Dec 08 15:04:01 CST 2022 2022-12-08 15:04:01.488 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:03:36.0, nextRunTime=2022-12-08 15:04:00.0} 2022-12-08 15:04:01.506 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:04:01.507 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:04:01.507 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:04:01.607 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:23.0, nextRun=2022-12-08 15:04:00.0, currentDate=Thu Dec 08 15:04:01 CST 2022 2022-12-08 15:04:01.608 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:03:23.0, nextRunTime=2022-12-08 15:04:00.0} 2022-12-08 15:04:01.635 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:04:01.636 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:04:01.636 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:04:01.649 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:01.650 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:01.657 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:01.675 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221125 2022-12-08 15:04:01.679 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:01.682 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:01.687 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221125 values less than (1669305600)) 2022-12-08 15:04:02.739 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1052, sql=alter table `metric_data_minute` add partition(partition p20221125 values less than (1669305600)) 2022-12-08 15:04:02.743 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:02.744 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:02.747 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:02.759 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221126 2022-12-08 15:04:02.764 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:02.765 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:02.768 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221126 values less than (1669392000)) 2022-12-08 15:04:02.941 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:02.942 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:03.240 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:03.241 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:03.696 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:03.697 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:03.700 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:03.717 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221127 2022-12-08 15:04:03.720 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:03.721 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:03.729 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221127 values less than (1669478400)) 2022-12-08 15:04:03.955 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:03.960 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:04.569 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:04.569 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:04.573 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:04.595 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221128 2022-12-08 15:04:04.598 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:04.599 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:04.602 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221128 values less than (1669564800)) 2022-12-08 15:04:05.487 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:05.754 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:04:05.768 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:04:05.837 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1235, sql=alter table `metric_data_minute` add partition(partition p20221128 values less than (1669564800)) 2022-12-08 15:04:05.841 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:05.842 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:05.845 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:05.862 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221129 2022-12-08 15:04:05.865 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:05.866 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:05.869 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221129 values less than (1669651200)) 2022-12-08 15:04:06.094 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:35.0, nextRun=2022-12-08 15:04:05.0, currentDate=Thu Dec 08 15:04:06 CST 2022 2022-12-08 15:04:06.095 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:03:35.0, nextRunTime=2022-12-08 15:04:05.0} 2022-12-08 15:04:06.103 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:06.116 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:04:06.117 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:04:06.117 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:04:06.331 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:06.478 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:04:06.628 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:06.628 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:06.631 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:06.643 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221130 2022-12-08 15:04:06.647 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:06.647 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:06.650 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221130 values less than (1669737600)) 2022-12-08 15:04:06.961 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:06.973 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:07.038 INFO 42 --- [pool-ocp-schedules-7,,b1fd4d3fa32f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:04:07.363 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:04:07.374 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:07.375 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:07.382 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:07.410 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221201 2022-12-08 15:04:07.416 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:07.416 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:07.420 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221201 values less than (1669824000)) 2022-12-08 15:04:07.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:04:07.563 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:04:07.675 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:04:07.666983+08:00, lastProcessTime=2022-12-08T15:03:57.626572+08:00 2022-12-08 15:04:07.760 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:04:07.843 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:04:07.950 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:04:07.666983+08:00, resultsCount=0 2022-12-08 15:04:07.950 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:04:07.666983+08:00, resultsCount=0 2022-12-08 15:04:07.951 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:04:07.666983+08:00 2022-12-08 15:04:08.044 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:04:08.406 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:03:07+08:00, updateTime=2022-12-08T15:03:37+08:00, expireTime=null, isLeader=false} 2022-12-08 15:04:08.413 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:04:08.524 INFO 42 --- [pool-ocp-schedules-18,,2535fc60ea3b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:04:08.525 INFO 42 --- [pool-ocp-schedules-18,,2535fc60ea3b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:04:08.817 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1397, sql=alter table `metric_data_minute` add partition(partition p20221201 values less than (1669824000)) 2022-12-08 15:04:08.827 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:08.827 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:08.837 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:08.848 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221202 2022-12-08 15:04:08.853 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:08.853 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:08.856 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221202 values less than (1669910400)) 2022-12-08 15:04:09.184 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:09.184 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:09.451 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:09.451 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:09.865 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1009, sql=alter table `metric_data_minute` add partition(partition p20221202 values less than (1669910400)) 2022-12-08 15:04:09.869 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:09.870 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:09.879 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:09.898 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221203 2022-12-08 15:04:09.902 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:09.903 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:09.906 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221203 values less than (1669996800)) 2022-12-08 15:04:09.974 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:09.990 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:10.725 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:10.728 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:04:10.825 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:04:11.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1387, sql=alter table `metric_data_minute` add partition(partition p20221203 values less than (1669996800)) 2022-12-08 15:04:11.297 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:11.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:11.303 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:11.326 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221204 2022-12-08 15:04:11.330 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:11.331 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:11.334 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221204 values less than (1670083200)) 2022-12-08 15:04:11.639 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:04:11.647 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:04:12.057 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:12.057 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:12.060 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:12.092 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221205 2022-12-08 15:04:12.096 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:12.096 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:12.099 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221205 values less than (1670169600)) 2022-12-08 15:04:12.310 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:12.596 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:12.760 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:04:12.991 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:12.997 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:13.083 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:13.083 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:13.086 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:13.102 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221206 2022-12-08 15:04:13.113 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:13.113 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:13.116 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221206 values less than (1670256000)) 2022-12-08 15:04:14.187 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1071, sql=alter table `metric_data_minute` add partition(partition p20221206 values less than (1670256000)) 2022-12-08 15:04:14.191 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:14.192 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:14.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:14.212 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221207 2022-12-08 15:04:14.216 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:14.216 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:14.219 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221207 values less than (1670342400)) 2022-12-08 15:04:15.138 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:15.139 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:15.147 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:15.167 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221208 2022-12-08 15:04:15.171 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:15.172 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:15.177 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221208 values less than (1670428800)) 2022-12-08 15:04:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,0699cd1b5e08] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:04:15.213 INFO 42 --- [pool-prometheus-cache-monitor1,,0699cd1b5e08] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:04:15.405 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:15.406 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:15.589 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:15.767 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:15.768 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:15.998 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:16.014 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:16.330 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1153, sql=alter table `metric_data_minute` add partition(partition p20221208 values less than (1670428800)) 2022-12-08 15:04:16.339 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:16.339 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:16.345 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:16.358 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221209 2022-12-08 15:04:16.363 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:16.364 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:16.371 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221209 values less than (1670515200)) 2022-12-08 15:04:17.039 INFO 42 --- [pool-ocp-schedules-16,,331139ec08aa] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:04:17.114 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:17.115 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:17.121 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:17.146 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221210 2022-12-08 15:04:17.156 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:17.157 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:17.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221210 values less than (1670601600)) 2022-12-08 15:04:17.318 ERROR 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing PLAN_CHANGE_DETECTOR org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=333) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=333) Table has no partition for value ; (conn=333) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=333) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.insert(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy412.save(Unknown Source) ~[na:na] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:49) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$ad3ec26.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=333) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_312] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_312] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 26 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 40 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 41 common frames omitted 2022-12-08 15:04:17.334 ERROR 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing SQL_PERF_DIAGNOSER org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=2097358) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=2097358) Table has no partition for value ; (conn=2097358) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=2097358) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.insert(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy412.save(Unknown Source) ~[na:na] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:49) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$ad3ec26.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=2097358) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_312] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_312] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 26 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 40 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 41 common frames omitted 2022-12-08 15:04:17.344 ERROR 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing SQL_INDEX_DIAGNOSER org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=334) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=334) Table has no partition for value ; (conn=334) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=334) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.insert(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy412.save(Unknown Source) ~[na:na] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:49) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$ad3ec26.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=334) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_312] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_312] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 26 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 40 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 41 common frames omitted 2022-12-08 15:04:17.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:04:17.612 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:04:17.609039+08:00, lastProcessTime=2022-12-08T15:04:07.666983+08:00 2022-12-08 15:04:17.852 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:04:17.915 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:04:17.609039+08:00, resultsCount=0 2022-12-08 15:04:17.916 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:04:17.609039+08:00, resultsCount=0 2022-12-08 15:04:17.916 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:04:17.609039+08:00 2022-12-08 15:04:18.330 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1170, sql=alter table `metric_data_minute` add partition(partition p20221210 values less than (1670601600)) 2022-12-08 15:04:18.333 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:18.333 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:18.338 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:18.349 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20221211 2022-12-08 15:04:18.352 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:18.352 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:18.355 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20221211 values less than (1670688000)) 2022-12-08 15:04:18.397 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:04:18.403 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:04:18.653 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:18.849 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:18.975 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:18.975 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:18.978 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2022-12-08 15:04:18.992 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:18.992 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:18.995 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:04:19.000 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:19.001 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:19.004 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2022-12-08 15:04:19.015 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:19.019 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:04:19.022 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:19.022 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2019 2022-12-08 15:04:19.025 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:19.026 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:19.032 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2019 values less than (1577836800)) 2022-12-08 15:04:19.850 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:19.851 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:19.854 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2022-12-08 15:04:19.870 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2020 2022-12-08 15:04:19.876 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:19.876 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:19.879 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2020 values less than (1609459200)) 2022-12-08 15:04:20.205 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:35.0, nextRun=2022-12-08 15:04:20.0, currentDate=Thu Dec 08 15:04:20 CST 2022 2022-12-08 15:04:20.206 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:03:35.0, nextRunTime=2022-12-08 15:04:20.0} 2022-12-08 15:04:20.230 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:04:20.230 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:04:20.231 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:04:20.713 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:20.713 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:20.716 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2022-12-08 15:04:20.732 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2021 2022-12-08 15:04:20.738 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:20.739 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:20.742 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2021 values less than (1640995200)) 2022-12-08 15:04:20.826 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:20.864 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:04:20.990 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:04:21.481 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 1, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:21.601 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=1, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T15:04:21.419+08:00, endTime=null} 2022-12-08 15:04:21.610 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:21.610 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:21.614 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2022-12-08 15:04:21.635 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2022 2022-12-08 15:04:21.639 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:21.640 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:21.644 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2022 values less than (1672531200)) 2022-12-08 15:04:21.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:21.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:21.735 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 2, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:21.784 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=2, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:04:21.715+08:00, endTime=null} 2022-12-08 15:04:21.868 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 3, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:21.970 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=3, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:04:21.848+08:00, endTime=null} 2022-12-08 15:04:22.013 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:22.014 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:22.023 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:22.027 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:22.058 INFO 42 --- [pool-subtask-executor2,d267e73849fc4df0,b4fc76c8bb5a] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=2, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=2, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:21.713+08:00, sub_task_instance_id=2}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:22.058 INFO 42 --- [pool-subtask-executor1,d267e73849fc4df0,83daf3665f4f] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=1, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:21.418+08:00, sub_task_instance_id=1}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:22.059 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 4, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:22.288 INFO 42 --- [pool-subtask-executor1,d267e73849fc4df0,83daf3665f4f] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 1, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:22.292 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=4, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:04:22.046+08:00, endTime=null} 2022-12-08 15:04:22.355 INFO 42 --- [pool-subtask-executor2,d267e73849fc4df0,b4fc76c8bb5a] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 2, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:22.365 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 5, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:22.390 INFO 42 --- [pool-subtask-executor3,d267e73849fc4df0,8a53d556d5db] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=3, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=3, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:21.847+08:00, sub_task_instance_id=3}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:22.442 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=5, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:04:22.352+08:00, endTime=null} 2022-12-08 15:04:22.508 INFO 42 --- [pool-subtask-executor3,d267e73849fc4df0,8a53d556d5db] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 3, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:22.522 INFO 42 --- [pool-subtask-executor4,d267e73849fc4df0,6e9951302f9a] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=4, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=4, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:22.044+08:00, sub_task_instance_id=4}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:22.528 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 6, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:22.594 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:22.594 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:22.597 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2022-12-08 15:04:22.607 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=6, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:04:22.511+08:00, endTime=null} 2022-12-08 15:04:22.613 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2023 2022-12-08 15:04:22.620 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:22.621 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:22.624 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2023 values less than (1704067200)) 2022-12-08 15:04:22.665 INFO 42 --- [pool-subtask-executor5,d267e73849fc4df0,76fc87f43214] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=5, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=5, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:22.351+08:00, sub_task_instance_id=5}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:22.666 INFO 42 --- [pool-subtask-executor5,d267e73849fc4df0,76fc87f43214] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:04:22.690 INFO 42 --- [pool-subtask-executor5,d267e73849fc4df0,76fc87f43214] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:04:22.691 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 7, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:22.694 INFO 42 --- [pool-subtask-executor4,d267e73849fc4df0,6e9951302f9a] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 4, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:22.740 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:1, status:SUCCESS 2022-12-08 15:04:22.746 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=7, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:04:22.675+08:00, endTime=null} 2022-12-08 15:04:22.760 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:04:22.774 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:1, status:SUCCESS 2022-12-08 15:04:22.774 INFO 42 --- [pool-subtask-executor5,d267e73849fc4df0,76fc87f43214] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 5, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:22.834 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 8, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:22.907 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:2, status:SUCCESS 2022-12-08 15:04:22.929 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:2, status:SUCCESS 2022-12-08 15:04:22.970 INFO 42 --- [pool-subtask-executor7,d267e73849fc4df0,a42d4dc780c5] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=7, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=7, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:22.674+08:00, sub_task_instance_id=7}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:23.158 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=8, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:04:22.819+08:00, endTime=null} 2022-12-08 15:04:23.225 INFO 42 --- [pool-subtask-executor7,d267e73849fc4df0,a42d4dc780c5] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 7, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:23.246 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:3, status:SUCCESS 2022-12-08 15:04:23.256 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:3, status:SUCCESS 2022-12-08 15:04:23.267 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 9, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:23.372 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=9, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:04:23.246+08:00, endTime=null} 2022-12-08 15:04:23.443 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:4, status:SUCCESS 2022-12-08 15:04:23.443 INFO 42 --- [pool-subtask-executor8,d267e73849fc4df0,6dd5f4241308] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=8, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=8, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:22.817+08:00, sub_task_instance_id=8}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:23.454 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:4, status:SUCCESS 2022-12-08 15:04:23.494 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 10, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:23.527 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:23.528 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:23.531 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2022-12-08 15:04:23.545 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:23.545 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:23.551 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:04:23.557 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:23.558 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:23.561 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2022-12-08 15:04:23.580 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2019 2022-12-08 15:04:23.584 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:23.585 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:23.588 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2019 values less than (1577836800)) 2022-12-08 15:04:23.697 INFO 42 --- [pool-subtask-executor8,d267e73849fc4df0,6dd5f4241308] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 8, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:23.702 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=10, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T15:04:23.480+08:00, endTime=null} 2022-12-08 15:04:23.723 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:5, status:SUCCESS 2022-12-08 15:04:23.731 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:5, status:SUCCESS 2022-12-08 15:04:23.779 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 11, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:23.789 INFO 42 --- [pool-subtask-executor9,d267e73849fc4df0,c433e0ae1aef] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=9, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=9, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:23.245+08:00, sub_task_instance_id=9}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 15:04:23.849 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:6, status:SUCCESS 2022-12-08 15:04:23.854 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=11, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:04:23.764+08:00, endTime=null} 2022-12-08 15:04:23.857 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:6, status:SUCCESS 2022-12-08 15:04:23.965 INFO 42 --- [pool-subtask-executor10,d267e73849fc4df0,e3976d474fb0] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=10, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=10, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:23.479+08:00, sub_task_instance_id=10}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:23.966 INFO 42 --- [pool-subtask-executor9,d267e73849fc4df0,c433e0ae1aef] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 9, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:23.972 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 12, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:23.992 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:7, status:SUCCESS 2022-12-08 15:04:23.999 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:7, status:SUCCESS 2022-12-08 15:04:24.061 INFO 42 --- [pool-subtask-executor11,d267e73849fc4df0,1c3670b1847d] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=11, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=11, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:23.763+08:00, sub_task_instance_id=11}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:24.061 INFO 42 --- [pool-subtask-executor11,d267e73849fc4df0,1c3670b1847d] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:04:24.063 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=12, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T15:04:23.949+08:00, endTime=null} 2022-12-08 15:04:24.068 INFO 42 --- [pool-subtask-executor10,d267e73849fc4df0,e3976d474fb0] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 10, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:24.084 INFO 42 --- [pool-subtask-executor11,d267e73849fc4df0,1c3670b1847d] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:04:24.138 INFO 42 --- [pool-subtask-executor11,d267e73849fc4df0,1c3670b1847d] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 11, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:24.141 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:8, status:SUCCESS 2022-12-08 15:04:24.148 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:8, status:SUCCESS 2022-12-08 15:04:24.151 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 13, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:24.210 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:04:24.215 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:04:24.230 INFO 42 --- [pool-subtask-executor12,d267e73849fc4df0,0db4ae3ba8ac] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=12, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=12, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:23.947+08:00, sub_task_instance_id=12}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:24.362 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:24.362 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:24.363 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=13, name=Replication Daemon Task, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.mc.replication.ReplicationDaemonTask, seriesId=0, startTime=2022-12-08T15:04:24.137+08:00, endTime=null} 2022-12-08 15:04:24.366 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2022-12-08 15:04:24.381 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2020 2022-12-08 15:04:24.386 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:24.387 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:24.390 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2020 values less than (1609459200)) 2022-12-08 15:04:24.444 INFO 42 --- [pool-subtask-executor12,d267e73849fc4df0,0db4ae3ba8ac] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 12, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:24.461 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:9, status:SUCCESS 2022-12-08 15:04:24.469 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:9, status:SUCCESS 2022-12-08 15:04:24.472 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 14, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:24.529 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=14, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:04:24.456+08:00, endTime=null} 2022-12-08 15:04:24.566 INFO 42 --- [pool-subtask-executor13,d267e73849fc4df0,be5bbb441e93] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=13, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=13, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:24.136+08:00, sub_task_instance_id=13}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:24.588 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:10, status:SUCCESS 2022-12-08 15:04:24.595 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:10, status:SUCCESS 2022-12-08 15:04:24.605 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 15, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:24.622 INFO 42 --- [pool-subtask-executor13,d267e73849fc4df0,be5bbb441e93] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 13, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:24.640 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=15, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:04:24.590+08:00, endTime=null} 2022-12-08 15:04:24.681 INFO 42 --- [pool-subtask-executor14,d267e73849fc4df0,b87a5a3c5e5f] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=14, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=14, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:24.454+08:00, sub_task_instance_id=14}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:24.703 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:11, status:SUCCESS 2022-12-08 15:04:24.713 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:11, status:SUCCESS 2022-12-08 15:04:24.713 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 16, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:24.791 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:24.817 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=16, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:04:24.697+08:00, endTime=null} 2022-12-08 15:04:24.826 INFO 42 --- [pool-subtask-executor15,d267e73849fc4df0,95e72e8dd7b2] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=15, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=15, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:24.589+08:00, sub_task_instance_id=15}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:24.827 INFO 42 --- [pool-subtask-executor15,d267e73849fc4df0,95e72e8dd7b2] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:04:24.834 INFO 42 --- [pool-subtask-executor14,d267e73849fc4df0,b87a5a3c5e5f] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 14, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:24.843 INFO 42 --- [pool-subtask-executor15,d267e73849fc4df0,95e72e8dd7b2] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:04:24.854 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:12, status:SUCCESS 2022-12-08 15:04:24.861 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:12, status:SUCCESS 2022-12-08 15:04:24.892 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 17, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:24.927 INFO 42 --- [pool-subtask-executor15,d267e73849fc4df0,95e72e8dd7b2] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 15, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:25.002 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=17, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:04:24.875+08:00, endTime=null} 2022-12-08 15:04:25.027 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:25.035 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:25.137 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:25.209 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:25.215 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2022-12-08 15:04:25.229 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:13, status:SUCCESS 2022-12-08 15:04:25.234 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2021 2022-12-08 15:04:25.238 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:13, status:SUCCESS 2022-12-08 15:04:25.242 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:25.243 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:25.246 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2021 values less than (1640995200)) 2022-12-08 15:04:25.248 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 18, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:25.298 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:25.343 INFO 42 --- [pool-subtask-executor17,d267e73849fc4df0,b4c7b7e84f4a] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=17, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=17, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:24.873+08:00, sub_task_instance_id=17}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:25.463 INFO 42 --- [pool-subtask-executor17,d267e73849fc4df0,b4c7b7e84f4a] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 17, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:25.466 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=18, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:04:25.222+08:00, endTime=null} 2022-12-08 15:04:25.487 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:04:25.489 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:14, status:SUCCESS 2022-12-08 15:04:25.506 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:14, status:SUCCESS 2022-12-08 15:04:25.668 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:15, status:SUCCESS 2022-12-08 15:04:25.682 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:15, status:SUCCESS 2022-12-08 15:04:25.704 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:25.767 INFO 42 --- [pool-subtask-executor18,d267e73849fc4df0,029a54444a34] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=18, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=18, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:25.221+08:00, sub_task_instance_id=18}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:25.838 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:16, status:SUCCESS 2022-12-08 15:04:25.845 INFO 42 --- [pool-subtask-executor18,d267e73849fc4df0,029a54444a34] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 18, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:25.847 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:16, status:SUCCESS 2022-12-08 15:04:25.978 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:17, status:SUCCESS 2022-12-08 15:04:25.987 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:17, status:SUCCESS 2022-12-08 15:04:26.146 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:26.147 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:26.151 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2022-12-08 15:04:26.171 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2022 2022-12-08 15:04:26.178 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:26.179 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:26.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2022 values less than (1672531200)) 2022-12-08 15:04:26.223 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:18, status:SUCCESS 2022-12-08 15:04:26.230 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:18, status:SUCCESS 2022-12-08 15:04:26.402 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:35.0, nextRun=2022-12-08 15:04:25.0, currentDate=Thu Dec 08 15:04:26 CST 2022 2022-12-08 15:04:26.403 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:03:35.0, nextRunTime=2022-12-08 15:04:25.0} 2022-12-08 15:04:26.447 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:04:26.447 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:04:26.447 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:04:26.906 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:26.907 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:26.910 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2022-12-08 15:04:26.928 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2023 2022-12-08 15:04:26.932 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:26.933 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:26.937 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2023 values less than (1704067200)) 2022-12-08 15:04:27.059 INFO 42 --- [pool-ocp-schedules-15,,247b80b97a76] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:04:27.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:04:27.629 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 19, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:27.645 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:04:27.640121+08:00, lastProcessTime=2022-12-08T15:04:17.609039+08:00 2022-12-08 15:04:27.704 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:27.705 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:27.708 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2022-12-08 15:04:27.754 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:27.754 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:27.759 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:04:27.773 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:27.774 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:27.780 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2022-12-08 15:04:27.783 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=19, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:04:27.594+08:00, endTime=null} 2022-12-08 15:04:27.807 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1669824000 2022-12-08 15:04:27.831 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:27.832 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:27.836 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1669824000 values less than (1669824000)) 2022-12-08 15:04:27.911 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:27.911 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:27.969 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:04:27.640121+08:00, resultsCount=0 2022-12-08 15:04:27.969 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:04:27.640121+08:00, resultsCount=0 2022-12-08 15:04:27.970 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:04:27.640121+08:00 2022-12-08 15:04:28.036 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:28.042 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:28.082 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:04:28.147 INFO 42 --- [pool-subtask-executor19,d267e73849fc4df0,fd54311c6126] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=19, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=19, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:27.593+08:00, sub_task_instance_id=19}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 15:04:28.366 INFO 42 --- [pool-subtask-executor19,d267e73849fc4df0,fd54311c6126] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 19, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:28.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:28.479 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:28.651 INFO 42 --- [pool-ocp-schedules-12,,871532c1ce92] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:04:28.652 INFO 42 --- [pool-ocp-schedules-12,,871532c1ce92] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:04:28.697 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:28.698 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:28.702 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:28.714 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1669910400 2022-12-08 15:04:28.718 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:28.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:28.723 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 15:04:28.809 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:19, status:SUCCESS 2022-12-08 15:04:28.819 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:19, status:SUCCESS 2022-12-08 15:04:29.279 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:29.280 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:29.283 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:29.303 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1669996800 2022-12-08 15:04:29.307 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:29.308 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:29.318 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 15:04:30.158 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:30.159 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:30.163 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:30.181 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670083200 2022-12-08 15:04:30.184 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:30.185 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:30.188 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 15:04:30.720 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:04:30.723 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:30.724 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:30.727 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:04:30.727 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:30.741 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670169600 2022-12-08 15:04:30.746 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:30.747 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:30.750 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 15:04:30.871 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:30.954 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:04:31.043 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:31.053 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:31.069 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:31.129 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:03:35.0, nextRun=2022-12-08 15:04:30.0, currentDate=Thu Dec 08 15:04:31 CST 2022 2022-12-08 15:04:31.131 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:03:35.0, nextRunTime=2022-12-08 15:04:30.0} 2022-12-08 15:04:31.159 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:04:31.188 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:04:31.283 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:01.0, nextRun=2022-12-08 15:04:30.0, currentDate=Thu Dec 08 15:04:31 CST 2022 2022-12-08 15:04:31.284 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:04:01.0, nextRunTime=2022-12-08 15:04:30.0} 2022-12-08 15:04:31.317 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:04:31.318 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:04:31.318 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:04:31.380 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:31.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:31.385 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:31.399 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670256000 2022-12-08 15:04:31.405 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:31.406 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:31.410 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 15:04:31.595 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:31.950 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:04:31.954 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:31.954 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:31.958 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:31.974 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670342400 2022-12-08 15:04:31.978 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:31.978 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:31.981 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 15:04:31.984 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 20, operation:EXECUTE, state: RUNNING 2022-12-08 15:04:32.088 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=20, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:04:31.962+08:00, endTime=null} 2022-12-08 15:04:32.282 INFO 42 --- [pool-subtask-executor20,d267e73849fc4df0,4e0c138b4ce8] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=20, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=20, task_operation=execute, latest_execution_start_time=2022-12-08T15:04:31.960+08:00, sub_task_instance_id=20}, listMap={}}, executor=192.168.28.62 2022-12-08 15:04:32.282 INFO 42 --- [pool-subtask-executor20,d267e73849fc4df0,4e0c138b4ce8] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:04:32.304 INFO 42 --- [pool-subtask-executor20,d267e73849fc4df0,4e0c138b4ce8] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:04:32.378 INFO 42 --- [pool-subtask-executor20,d267e73849fc4df0,4e0c138b4ce8] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 20, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:04:32.576 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:32.576 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:32.582 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:32.608 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670428800 2022-12-08 15:04:32.614 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:32.615 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:32.619 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 15:04:33.445 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:33.446 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:33.451 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:33.469 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670515200 2022-12-08 15:04:33.473 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:33.473 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:33.480 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 15:04:33.527 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:20, status:SUCCESS 2022-12-08 15:04:33.538 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:20, status:SUCCESS 2022-12-08 15:04:34.054 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:34.061 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:34.149 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:34.149 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:34.196 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:34.197 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:34.200 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:34.213 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670601600 2022-12-08 15:04:34.218 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:34.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:34.221 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 15:04:34.656 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:34.657 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:34.832 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:34.833 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:34.838 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:34.853 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1670688000 2022-12-08 15:04:34.857 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:34.858 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:34.862 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 15:04:35.424 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:35.425 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:35.429 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2022-12-08 15:04:35.444 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:35.444 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:35.447 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:04:35.452 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:35.453 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:35.456 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2022-12-08 15:04:35.476 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2019 2022-12-08 15:04:35.481 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:35.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:35.484 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2019 values less than (1577836800)) 2022-12-08 15:04:35.800 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:36.192 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:36.192 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:36.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2022-12-08 15:04:36.210 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2020 2022-12-08 15:04:36.214 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:36.214 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:36.217 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2020 values less than (1609459200)) 2022-12-08 15:04:37.060 INFO 42 --- [pool-ocp-schedules-3,,4c7e78e706c6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:04:37.061 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:37.068 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:37.504 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:04:37.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:04:37.570 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:04:37.579 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:04:37.609 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:04:37.604325+08:00, lastProcessTime=2022-12-08T15:04:27.640121+08:00 2022-12-08 15:04:37.614 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1397, sql=alter table `ob_hist_partition_stats_compressed` add partition(partition p2020 values less than (1609459200)) 2022-12-08 15:04:37.617 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:37.617 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:37.620 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2022-12-08 15:04:37.640 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2021 2022-12-08 15:04:37.653 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:37.654 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:37.658 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2021 values less than (1640995200)) 2022-12-08 15:04:37.726 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:37.769 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:04:37.604325+08:00, resultsCount=0 2022-12-08 15:04:37.770 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:04:37.604325+08:00, resultsCount=0 2022-12-08 15:04:37.770 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:04:37.604325+08:00 2022-12-08 15:04:37.838 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:04:38.044 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:04:38.095 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:03:07+08:00, updateTime=2022-12-08T15:04:07+08:00, expireTime=null, isLeader=false} 2022-12-08 15:04:38.103 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:04:38.160 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:04:38.568 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:04:38.784 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1127, sql=alter table `ob_hist_partition_stats_compressed` add partition(partition p2021 values less than (1640995200)) 2022-12-08 15:04:38.788 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:38.790 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:38.793 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2022-12-08 15:04:38.804 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2022 2022-12-08 15:04:38.808 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:38.808 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:38.812 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2022 values less than (1672531200)) 2022-12-08 15:04:40.070 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:40.076 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:40.334 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1523, sql=alter table `ob_hist_partition_stats_compressed` add partition(partition p2022 values less than (1672531200)) 2022-12-08 15:04:40.339 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:40.340 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:40.343 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2022-12-08 15:04:40.363 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2023 2022-12-08 15:04:40.368 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:40.368 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:40.374 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2023 values less than (1704067200)) 2022-12-08 15:04:40.540 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:40.820 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:04:40.976 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:41.039 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:04:41.176 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:41.177 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:41.285 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:04:41.774 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1400, sql=alter table `ob_hist_partition_stats_compressed` add partition(partition p2023 values less than (1704067200)) 2022-12-08 15:04:41.779 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:41.779 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:41.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2022-12-08 15:04:41.802 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:41.802 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:41.805 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:04:41.811 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:41.812 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:41.815 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2022-12-08 15:04:41.837 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1669910400 2022-12-08 15:04:41.842 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:41.842 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:41.845 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1669910400 values less than (1669910400)) 2022-12-08 15:04:42.571 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:42.572 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:42.577 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 15:04:42.596 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1669996800 2022-12-08 15:04:42.604 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:42.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:42.607 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1669996800 values less than (1669996800)) 2022-12-08 15:04:43.078 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:43.090 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:43.440 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:43.440 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:43.443 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 15:04:43.458 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670083200 2022-12-08 15:04:43.463 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:43.464 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:43.471 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670083200 values less than (1670083200)) 2022-12-08 15:04:43.805 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:43.806 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:44.191 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:44.191 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:44.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 15:04:44.211 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670169600 2022-12-08 15:04:44.215 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:44.215 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:44.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670169600 values less than (1670169600)) 2022-12-08 15:04:44.950 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:44.951 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:44.964 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 15:04:44.982 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670256000 2022-12-08 15:04:44.987 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:44.987 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:44.991 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 15:04:45.838 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:46.092 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:46.098 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:46.582 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:04:46.591 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:04:46.789 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1798, sql=alter table `ob_tenant_mini_compaction_info` add partition(partition p1670256000 values less than (1670256000)) 2022-12-08 15:04:46.793 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:46.794 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:46.797 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 15:04:46.815 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670342400 2022-12-08 15:04:46.820 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:46.821 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:46.824 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670342400 values less than (1670342400)) 2022-12-08 15:04:46.904 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:47.007 INFO 42 --- [pool-ocp-schedules-16,,4410eefc10fd] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:04:47.048 INFO 42 --- [pool-ocp-schedules-17,,210a6f57cff8] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:04:47.061 INFO 42 --- [pool-ocp-schedules-16,,4410eefc10fd] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:04:47.061 INFO 42 --- [pool-ocp-schedules-17,,688e6fa049c4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:04:47.185 INFO 42 --- [pool-ocp-schedules-12,,15ae26a319be] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:04:47.394 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:47.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:04:47.584 INFO 42 --- [pool-ocp-schedules-18,,14425453b81b] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:04:47.606 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:47.606 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:47.615 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 15:04:47.631 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:04:47.626449+08:00, lastProcessTime=2022-12-08T15:04:37.604325+08:00 2022-12-08 15:04:47.636 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670428800 2022-12-08 15:04:47.642 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:47.642 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:47.648 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 15:04:47.688 INFO 42 --- [pool-ocp-schedules-13,,4557efa76cc6] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:04:47.719 INFO 42 --- [pool-ocp-schedules-7,,c9f2607a676a] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:04:47.734 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:04:47.838 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:04:47.626449+08:00, resultsCount=0 2022-12-08 15:04:47.839 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:04:47.626449+08:00, resultsCount=0 2022-12-08 15:04:47.839 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:04:47.626449+08:00 2022-12-08 15:04:47.843 INFO 42 --- [pool-ocp-schedules-11,,aa9df0f1d70e] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:04:47.844 INFO 42 --- [pool-ocp-schedules-11,,aa9df0f1d70e] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:04:47.844 INFO 42 --- [pool-ocp-schedules-11,,aa9df0f1d70e] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:04:48.228 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:04:48.725 INFO 42 --- [pool-ocp-schedules-9,,8e04849cad95] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:04:48.726 INFO 42 --- [pool-ocp-schedules-9,,8e04849cad95] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:04:48.928 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1280, sql=alter table `ob_tenant_mini_compaction_info` add partition(partition p1670428800 values less than (1670428800)) 2022-12-08 15:04:48.932 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:48.932 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:48.934 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 15:04:48.950 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670515200 2022-12-08 15:04:48.953 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:48.954 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:48.957 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670515200 values less than (1670515200)) 2022-12-08 15:04:49.100 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:49.105 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:49.721 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:49.722 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:49.726 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 15:04:49.743 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670601600 2022-12-08 15:04:49.747 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:49.748 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:49.751 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 15:04:49.969 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:49.970 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:50.475 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:50.475 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:51.285 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:51.289 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:04:51.354 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:04:51.484 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1733, sql=alter table `ob_tenant_mini_compaction_info` add partition(partition p1670601600 values less than (1670601600)) 2022-12-08 15:04:51.488 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:51.488 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:51.492 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 15:04:51.505 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1670688000 2022-12-08 15:04:51.511 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:51.512 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:51.515 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1670688000 values less than (1670688000)) 2022-12-08 15:04:52.105 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:52.113 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:52.241 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:52.241 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:52.244 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2022-12-08 15:04:52.263 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:52.263 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:52.266 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:04:52.271 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:52.272 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:52.279 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2022-12-08 15:04:52.343 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221206 2022-12-08 15:04:52.347 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:52.347 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:52.351 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:04:52.942 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:04:52.960 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:04:52.969 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:04:53.140 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:53.141 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:53.144 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:04:53.163 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221207 2022-12-08 15:04:53.170 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:53.170 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:53.174 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:04:53.211 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:53.989 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:04:54.035 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:54.036 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:54.041 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:04:54.056 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221208 2022-12-08 15:04:54.060 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:54.060 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:54.064 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:04:54.110 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:04:54.888 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:54.888 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:54.892 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:04:54.910 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221209 2022-12-08 15:04:54.916 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:54.917 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:54.921 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:04:55.114 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:55.119 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:55.640 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:55.640 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:55.644 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:04:55.662 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221210 2022-12-08 15:04:55.686 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:55.687 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:55.691 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:04:55.965 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:04:56.444 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:56.444 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:56.629 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:56.630 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:56.633 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:04:56.645 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221211 2022-12-08 15:04:56.649 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:56.650 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:56.655 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:04:57.063 INFO 42 --- [pool-ocp-schedules-7,,72ffe1ac6ba5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:04:57.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:04:57.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:04:57.463 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:57.464 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:57.469 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:04:57.490 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221212 2022-12-08 15:04:57.494 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:57.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:57.498 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:04:57.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:04:57.616 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:04:57.613454+08:00, lastProcessTime=2022-12-08T15:04:47.626449+08:00 2022-12-08 15:04:57.827 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:04:57.613454+08:00, resultsCount=0 2022-12-08 15:04:57.828 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:04:57.613454+08:00, resultsCount=0 2022-12-08 15:04:57.828 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:04:57.613454+08:00 2022-12-08 15:04:58.120 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:04:58.125 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:04:58.515 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:04:58.671 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1173, sql=alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:04:58.675 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:58.676 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:58.679 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:04:58.696 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221213 2022-12-08 15:04:58.701 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:58.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:58.704 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:04:59.521 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:04:59.528 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:04:59.830 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1126, sql=alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:04:59.834 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:59.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:59.837 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:04:59.850 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221214 2022-12-08 15:04:59.854 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:04:59.854 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:04:59.858 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:05:00.158 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:00.204 INFO 42 --- [pool-prometheus-minute-schedule-2,,cdc025ad201a] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483160, interval=60 2022-12-08 15:05:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,cdc025ad201a] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483100, count=0, elapsed=1668812617105 2022-12-08 15:05:00.208 INFO 42 --- [pool-prometheus-minute-schedule-1,,fdf4ee2105d5] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483160, interval=60 2022-12-08 15:05:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,fdf4ee2105d5] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483100, count=0, elapsed=1668812617109 2022-12-08 15:05:01.080 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:05:00.0, currentDate=Thu Dec 08 15:05:01 CST 2022 2022-12-08 15:05:01.081 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=null, nextRunTime=2022-12-08 15:05:00.0} 2022-12-08 15:05:01.108 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 15:05:01.109 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:01.110 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:01.126 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:01.134 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:01.148 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1290, sql=alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:05:01.152 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:01.152 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:01.156 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:05:01.174 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221215 2022-12-08 15:05:01.178 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:01.179 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:01.182 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:05:01.223 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:05:00.0, currentDate=Thu Dec 08 15:05:01 CST 2022 2022-12-08 15:05:01.224 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:05:00.0} 2022-12-08 15:05:01.354 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:01.359 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:05:01.439 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:05:01.476 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 15:05:01.477 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 15:05:01.547 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:01.0, nextRun=2022-12-08 15:05:00.0, currentDate=Thu Dec 08 15:05:01 CST 2022 2022-12-08 15:05:01.548 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:04:01.0, nextRunTime=2022-12-08 15:05:00.0} 2022-12-08 15:05:01.577 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:05:01.578 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:01.578 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:01.585 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 21, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:01.611 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=21, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T15:05:01.550+08:00, endTime=null} 2022-12-08 15:05:01.647 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:01.0, nextRun=2022-12-08 15:05:00.0, currentDate=Thu Dec 08 15:05:01 CST 2022 2022-12-08 15:05:01.647 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:04:01.0, nextRunTime=2022-12-08 15:05:00.0} 2022-12-08 15:05:01.671 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:05:01.672 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:01.672 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:01.756 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:01.0, nextRun=2022-12-08 15:05:00.0, currentDate=Thu Dec 08 15:05:01 CST 2022 2022-12-08 15:05:01.757 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:04:01.0, nextRunTime=2022-12-08 15:05:00.0} 2022-12-08 15:05:01.792 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:05:01.793 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:01.793 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:01.839 INFO 42 --- [pool-subtask-executor21,d267e73849fc4df0,dc22cbf54b71] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=21, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=21, task_operation=execute, latest_execution_start_time=2022-12-08T15:05:01.548+08:00, sub_task_instance_id=21}, listMap={}}, executor=192.168.28.62 2022-12-08 15:05:01.861 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:31.0, nextRun=2022-12-08 15:05:00.0, currentDate=Thu Dec 08 15:05:01 CST 2022 2022-12-08 15:05:01.861 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:04:31.0, nextRunTime=2022-12-08 15:05:00.0} 2022-12-08 15:05:01.881 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:05:01.882 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:01.882 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:01.947 INFO 42 --- [pool-subtask-executor21,d267e73849fc4df0,dc22cbf54b71] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 21, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:05:01.971 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:01.972 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:05:00.0, currentDate=Thu Dec 08 15:05:01 CST 2022 2022-12-08 15:05:01.972 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:05:00.0} 2022-12-08 15:05:01.972 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:01.975 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:05:01.991 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20221216 2022-12-08 15:05:01.994 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 15:05:01.994 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:01.994 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:01.995 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:01.995 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:01.999 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:05:02.070 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:02.0, nextRun=2022-12-08 15:05:00.0, currentDate=Thu Dec 08 15:05:02 CST 2022 2022-12-08 15:05:02.071 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:04:02.0, nextRunTime=2022-12-08 15:05:00.0} 2022-12-08 15:05:02.094 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:05:02.094 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:02.095 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:02.230 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:21, status:SUCCESS 2022-12-08 15:05:02.237 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:21, status:SUCCESS 2022-12-08 15:05:02.644 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:02.725 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 22, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:02.767 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:05:02.773 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=22, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:05:02.689+08:00, endTime=null} 2022-12-08 15:05:02.881 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 23, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:02.991 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=23, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:05:02.859+08:00, endTime=null} 2022-12-08 15:05:03.111 INFO 42 --- [pool-subtask-executor22,d267e73849fc4df0,5b08ed91e1b4] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=22, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=22, task_operation=execute, latest_execution_start_time=2022-12-08T15:05:02.687+08:00, sub_task_instance_id=22}, listMap={}}, executor=192.168.28.62 2022-12-08 15:05:03.128 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 24, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:03.151 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1152, sql=alter table `ob_hist_sql_audit_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:05:03.155 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:03.156 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:03.158 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2022-12-08 15:05:03.183 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:03.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:03.188 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:05:03.193 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:03.194 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:03.196 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=24, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:05:03.111+08:00, endTime=null} 2022-12-08 15:05:03.197 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2022-12-08 15:05:03.237 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221130 2022-12-08 15:05:03.241 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:03.241 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:03.244 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:05:03.249 INFO 42 --- [pool-subtask-executor22,d267e73849fc4df0,5b08ed91e1b4] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 22, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:05:03.284 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 25, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:03.301 INFO 42 --- [pool-subtask-executor23,d267e73849fc4df0,baf3d019d0ed] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=23, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=23, task_operation=execute, latest_execution_start_time=2022-12-08T15:05:02.857+08:00, sub_task_instance_id=23}, listMap={}}, executor=192.168.28.62 2022-12-08 15:05:03.327 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:03.328 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:03.373 INFO 42 --- [pool-subtask-executor24,d267e73849fc4df0,890e14275270] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=24, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=24, task_operation=execute, latest_execution_start_time=2022-12-08T15:05:03.109+08:00, sub_task_instance_id=24}, listMap={}}, executor=192.168.28.62 2022-12-08 15:05:03.384 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=25, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:05:03.268+08:00, endTime=null} 2022-12-08 15:05:03.392 INFO 42 --- [pool-subtask-executor23,d267e73849fc4df0,baf3d019d0ed] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 23, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:05:03.452 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 26, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:03.468 INFO 42 --- [pool-subtask-executor24,d267e73849fc4df0,890e14275270] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 24, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:05:03.515 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=26, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T15:05:03.439+08:00, endTime=null} 2022-12-08 15:05:03.570 INFO 42 --- [pool-subtask-executor25,d267e73849fc4df0,4b885645431b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=25, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=25, task_operation=execute, latest_execution_start_time=2022-12-08T15:05:03.266+08:00, sub_task_instance_id=25}, listMap={}}, executor=192.168.28.62 2022-12-08 15:05:03.570 INFO 42 --- [pool-subtask-executor25,d267e73849fc4df0,4b885645431b] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:05:03.585 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 27, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:03.590 INFO 42 --- [pool-subtask-executor25,d267e73849fc4df0,4b885645431b] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:05:03.644 INFO 42 --- [pool-subtask-executor25,d267e73849fc4df0,4b885645431b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 25, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:05:03.649 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=27, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:05:03.568+08:00, endTime=null} 2022-12-08 15:05:03.678 INFO 42 --- [pool-subtask-executor26,d267e73849fc4df0,9190e716f8a9] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=26, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=26, task_operation=execute, latest_execution_start_time=2022-12-08T15:05:03.436+08:00, sub_task_instance_id=26}, listMap={}}, executor=192.168.28.62 2022-12-08 15:05:03.679 INFO 42 --- [pool-subtask-executor26,d267e73849fc4df0,9190e716f8a9] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2022-12-08 15:05:03.704 INFO 42 --- [pool-subtask-executor26,d267e73849fc4df0,9190e716f8a9] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2022-12-08 15:05:03.748 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:22, status:SUCCESS 2022-12-08 15:05:03.756 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:22, status:SUCCESS 2022-12-08 15:05:03.774 INFO 42 --- [pool-subtask-executor26,d267e73849fc4df0,9190e716f8a9] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 26, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:05:03.876 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:23, status:SUCCESS 2022-12-08 15:05:03.922 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:23, status:SUCCESS 2022-12-08 15:05:03.990 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:03.991 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:03.993 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:04.007 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:24, status:SUCCESS 2022-12-08 15:05:04.010 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221201 2022-12-08 15:05:04.013 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:04.014 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:04.015 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:24, status:SUCCESS 2022-12-08 15:05:04.021 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:05:04.135 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:04.137 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:25, status:SUCCESS 2022-12-08 15:05:04.139 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:04.144 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:25, status:SUCCESS 2022-12-08 15:05:04.234 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:26, status:SUCCESS 2022-12-08 15:05:04.241 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:26, status:SUCCESS 2022-12-08 15:05:04.375 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:27, status:SUCCESS 2022-12-08 15:05:04.390 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:27, status:SUCCESS 2022-12-08 15:05:04.705 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:04.705 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:04.708 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:04.723 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221202 2022-12-08 15:05:04.726 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:04.726 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:04.729 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:05:05.463 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:05.463 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:05.466 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:05.479 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221203 2022-12-08 15:05:05.482 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:05.482 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:05.485 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:05:05.759 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:05.760 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:05.989 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:06.0, nextRun=2022-12-08 15:05:05.0, currentDate=Thu Dec 08 15:05:05 CST 2022 2022-12-08 15:05:05.990 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:04:06.0, nextRunTime=2022-12-08 15:05:05.0} 2022-12-08 15:05:06.009 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:05:06.010 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:06.010 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:06.065 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:06.065 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:06.068 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:06.086 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221204 2022-12-08 15:05:06.090 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:06.090 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:06.094 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:05:06.163 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:06.781 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 28, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:06.831 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=28, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:05:06.764+08:00, endTime=null} 2022-12-08 15:05:06.954 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:06.955 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:06.962 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:06.978 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221205 2022-12-08 15:05:06.981 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:06.981 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:06.984 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:05:07.025 INFO 42 --- [pool-subtask-executor28,d267e73849fc4df0,bf81c139ace7] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=28, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=28, task_operation=execute, latest_execution_start_time=2022-12-08T15:05:06.762+08:00, sub_task_instance_id=28}, listMap={}}, executor=192.168.28.62 2022-12-08 15:05:07.064 INFO 42 --- [pool-ocp-schedules-7,,7a28444a0578] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:05:07.140 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:07.146 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:07.235 INFO 42 --- [pool-subtask-executor28,d267e73849fc4df0,bf81c139ace7] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 28, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:05:07.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:05:07.743 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:05:07.816 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:05:07.811607+08:00, lastProcessTime=2022-12-08T15:04:57.613454+08:00 2022-12-08 15:05:07.909 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:07.910 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:07.913 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:07.949 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221206 2022-12-08 15:05:07.959 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:07.960 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:07.966 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:05:07.981 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:05:08.088 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:05:07.811607+08:00, resultsCount=0 2022-12-08 15:05:08.089 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:05:07.811607+08:00, resultsCount=0 2022-12-08 15:05:08.089 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:05:07.811607+08:00 2022-12-08 15:05:08.100 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:05:08.107 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:05:08.124 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:28, status:SUCCESS 2022-12-08 15:05:08.132 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:28, status:SUCCESS 2022-12-08 15:05:08.161 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:05:08.610 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:05:08.690 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:05:08.801 INFO 42 --- [pool-ocp-schedules-8,,12318f90eaad] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:05:08.803 INFO 42 --- [pool-ocp-schedules-8,,12318f90eaad] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:05:08.841 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:09.002 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1036, sql=alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:05:09.007 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:09.007 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:09.010 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:09.022 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221207 2022-12-08 15:05:09.026 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:09.027 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:09.030 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:05:09.541 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:09.719 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:05:09.768 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:09.769 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:09.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:09.798 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221208 2022-12-08 15:05:09.803 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:09.803 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:09.807 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:05:10.147 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:10.154 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:10.474 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:10.475 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:10.478 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:10.497 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221209 2022-12-08 15:05:10.502 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:10.502 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:10.506 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:05:11.187 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:11.188 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:11.192 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:11.211 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221210 2022-12-08 15:05:11.215 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:11.215 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:11.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:05:11.439 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:11.442 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:05:11.508 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:05:11.937 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:11.938 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:12.203 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:12.204 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:12.208 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:12.225 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221211 2022-12-08 15:05:12.229 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:12.229 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:12.232 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:05:12.631 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:12.631 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:13.064 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:13.064 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:13.068 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:13.088 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221212 2022-12-08 15:05:13.093 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:13.094 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:13.097 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:05:13.155 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:13.164 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:14.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1284, sql=alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:05:14.388 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:14.388 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:14.391 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:14.406 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221213 2022-12-08 15:05:14.410 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:14.410 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:14.414 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:05:14.948 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:05:14.954 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:05:15.213 INFO 42 --- [pool-prometheus-cache-monitor1,,badcc6478654] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:05:15.214 INFO 42 --- [pool-prometheus-cache-monitor1,,badcc6478654] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:05:15.246 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:15.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:16.112 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1698, sql=alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:05:16.116 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:16.117 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:16.120 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:16.137 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221214 2022-12-08 15:05:16.140 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:16.141 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:16.144 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:05:16.165 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:16.170 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:16.280 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:05:16.392 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:17.034 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:17.034 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:17.037 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:17.054 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221215 2022-12-08 15:05:17.057 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:17.058 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:17.061 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:05:17.065 INFO 42 --- [pool-ocp-schedules-13,,41e63253d718] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:05:17.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:05:17.604 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:05:17.600179+08:00, lastProcessTime=2022-12-08T15:05:07.811607+08:00 2022-12-08 15:05:17.849 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:05:17.600179+08:00, resultsCount=0 2022-12-08 15:05:17.849 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:05:17.600179+08:00, resultsCount=0 2022-12-08 15:05:17.849 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:05:17.600179+08:00 2022-12-08 15:05:17.962 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:17.963 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:17.967 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:17.986 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20221216 2022-12-08 15:05:17.993 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:17.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:17.997 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:05:18.547 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:18.547 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:18.666 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:18.666 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:18.669 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2022-12-08 15:05:18.686 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:18.686 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:18.689 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:05:18.694 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:18.695 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:18.697 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2022-12-08 15:05:18.738 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221123 2022-12-08 15:05:18.741 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:18.742 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:18.745 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 15:05:18.764 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:05:18.849 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:18.850 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:19.171 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:19.177 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:19.375 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:19.375 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:19.378 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:19.403 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221124 2022-12-08 15:05:19.407 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:19.408 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:19.411 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 15:05:19.996 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:19.996 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:20.000 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:20.013 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221125 2022-12-08 15:05:20.017 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:20.017 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:20.021 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 15:05:20.864 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:20.0, nextRun=2022-12-08 15:05:20.0, currentDate=Thu Dec 08 15:05:20 CST 2022 2022-12-08 15:05:20.866 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:04:20.0, nextRunTime=2022-12-08 15:05:20.0} 2022-12-08 15:05:20.891 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:05:20.891 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:20.892 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:20.944 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:20.944 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:20.947 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:20.960 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221126 2022-12-08 15:05:20.963 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:20.964 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:20.967 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 15:05:21.105 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 29, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:21.178 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=29, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:05:21.086+08:00, endTime=null} 2022-12-08 15:05:21.381 INFO 42 --- [pool-subtask-executor29,d267e73849fc4df0,492c25f3acc8] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=29, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=29, task_operation=execute, latest_execution_start_time=2022-12-08T15:05:21.084+08:00, sub_task_instance_id=29}, listMap={}}, executor=192.168.28.62 2022-12-08 15:05:21.473 INFO 42 --- [pool-subtask-executor29,d267e73849fc4df0,492c25f3acc8] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 29, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:05:21.491 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:21.494 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:05:21.637 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:21.637 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:21.640 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:21.652 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221127 2022-12-08 15:05:21.655 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:21.655 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:21.658 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 15:05:21.684 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:05:21.690 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:05:21.741 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:05:21.823 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:21.942 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:22.178 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:22.183 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:22.291 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:05:22.372 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:29, status:SUCCESS 2022-12-08 15:05:22.382 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:29, status:SUCCESS 2022-12-08 15:05:22.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1043, sql=alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 15:05:22.705 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:22.706 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:22.709 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:22.728 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221128 2022-12-08 15:05:22.731 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:22.731 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:22.734 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 15:05:23.094 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:05:23.389 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:23.389 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:23.392 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:23.406 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221129 2022-12-08 15:05:23.409 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:23.409 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:23.414 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 15:05:24.398 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:24.399 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:24.402 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:24.414 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221130 2022-12-08 15:05:24.418 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:24.418 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:24.421 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:05:24.907 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:24.907 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:25.098 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:25.098 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:25.186 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:25.200 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:25.487 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:26.0, nextRun=2022-12-08 15:05:25.0, currentDate=Thu Dec 08 15:05:25 CST 2022 2022-12-08 15:05:25.488 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:04:26.0, nextRunTime=2022-12-08 15:05:25.0} 2022-12-08 15:05:25.539 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:05:25.539 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:25.540 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:25.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1183, sql=alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:05:25.608 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:25.608 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:25.611 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:25.628 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221201 2022-12-08 15:05:25.631 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:25.632 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:25.635 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:05:26.334 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 30, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:26.412 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=30, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:05:26.322+08:00, endTime=null} 2022-12-08 15:05:26.514 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:26.693 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,5864c3093cb3] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=30, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=30, task_operation=execute, latest_execution_start_time=2022-12-08T15:05:26.320+08:00, sub_task_instance_id=30}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 15:05:26.813 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,5864c3093cb3] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 30, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:05:26.972 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1337, sql=alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:05:26.976 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:26.977 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:26.980 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:26.995 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221202 2022-12-08 15:05:26.998 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:26.999 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:27.002 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:05:27.067 INFO 42 --- [pool-ocp-schedules-14,,66f524aa229e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:05:27.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:05:27.545 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:05:27.551 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:05:27.620 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:05:27.603688+08:00, lastProcessTime=2022-12-08T15:05:17.600179+08:00 2022-12-08 15:05:27.682 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:27.682 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:27.685 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:27.707 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221203 2022-12-08 15:05:27.710 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:27.710 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:27.713 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:05:27.730 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:05:27.603688+08:00, resultsCount=0 2022-12-08 15:05:27.730 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:05:27.603688+08:00, resultsCount=0 2022-12-08 15:05:27.730 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:05:27.603688+08:00 2022-12-08 15:05:28.201 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:28.206 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:28.276 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:28.391 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:28.712 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:30, status:SUCCESS 2022-12-08 15:05:28.719 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:30, status:SUCCESS 2022-12-08 15:05:28.831 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:05:28.864 INFO 42 --- [pool-ocp-schedules-17,,f4bf89229ca2] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:05:28.865 INFO 42 --- [pool-ocp-schedules-17,,f4bf89229ca2] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:05:28.868 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:05:29.223 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1509, sql=alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:05:29.227 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:29.227 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:29.230 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:29.242 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221204 2022-12-08 15:05:29.247 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:29.247 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:29.250 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:05:30.105 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:30.106 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:30.109 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:30.125 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221205 2022-12-08 15:05:30.129 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:30.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:30.133 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:05:30.840 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:30.841 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:30.844 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:30.861 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221206 2022-12-08 15:05:30.870 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:30.870 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:30.876 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:05:31.037 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:31.0, nextRun=2022-12-08 15:05:30.0, currentDate=Thu Dec 08 15:05:31 CST 2022 2022-12-08 15:05:31.038 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:04:31.0, nextRunTime=2022-12-08 15:05:30.0} 2022-12-08 15:05:31.061 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:05:31.146 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:02.0, nextRun=2022-12-08 15:05:30.0, currentDate=Thu Dec 08 15:05:31 CST 2022 2022-12-08 15:05:31.147 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:05:02.0, nextRunTime=2022-12-08 15:05:30.0} 2022-12-08 15:05:31.168 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:05:31.169 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:05:31.169 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:05:31.207 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:31.212 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:31.481 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:31.482 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:31.485 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:31.500 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221207 2022-12-08 15:05:31.503 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:31.504 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:31.510 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:05:31.557 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:31.561 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:05:31.580 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 31, operation:EXECUTE, state: RUNNING 2022-12-08 15:05:31.629 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:31.629 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:31.629 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:31.629 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:31.684 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=31, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:05:31.565+08:00, endTime=null} 2022-12-08 15:05:31.847 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:05:31.853 INFO 42 --- [pool-subtask-executor31,d267e73849fc4df0,d5bb245d3b0d] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=31, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=31, task_operation=execute, latest_execution_start_time=2022-12-08T15:05:31.563+08:00, sub_task_instance_id=31}, listMap={}}, executor=192.168.28.62 2022-12-08 15:05:31.853 INFO 42 --- [pool-subtask-executor31,d267e73849fc4df0,d5bb245d3b0d] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:05:31.875 INFO 42 --- [pool-subtask-executor31,d267e73849fc4df0,d5bb245d3b0d] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:05:32.118 INFO 42 --- [pool-subtask-executor31,d267e73849fc4df0,d5bb245d3b0d] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 31, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:05:32.404 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:32.405 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:32.408 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:32.426 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221208 2022-12-08 15:05:32.429 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:32.430 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:32.433 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:05:32.504 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:31, status:SUCCESS 2022-12-08 15:05:32.511 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:31, status:SUCCESS 2022-12-08 15:05:33.206 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:33.206 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:33.209 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:33.223 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221209 2022-12-08 15:05:33.227 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:33.228 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:33.231 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:05:34.032 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:05:34.038 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:05:34.117 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:34.117 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:34.120 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:34.132 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221210 2022-12-08 15:05:34.137 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:34.137 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:34.140 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:05:34.213 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:34.218 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:34.708 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:34.709 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:34.770 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:34.771 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:34.773 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:34.788 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221211 2022-12-08 15:05:34.791 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:34.791 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:34.794 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:05:35.136 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:05:35.528 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:35.528 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:35.531 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:35.550 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221212 2022-12-08 15:05:35.553 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:35.553 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:35.557 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:05:36.194 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:36.194 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:36.199 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:36.212 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221213 2022-12-08 15:05:36.216 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:36.216 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:36.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:05:36.652 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:36.732 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:36.733 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:36.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:36.746 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221214 2022-12-08 15:05:36.749 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:36.749 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:36.754 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:05:37.069 INFO 42 --- [pool-ocp-schedules-7,,e0a0f062d115] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:05:37.219 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:37.223 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:37.501 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:37.502 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:37.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:37.518 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221215 2022-12-08 15:05:37.521 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:37.521 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:37.524 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:05:37.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:05:37.615 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:05:37.610955+08:00, lastProcessTime=2022-12-08T15:05:27.603688+08:00 2022-12-08 15:05:37.790 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:37.790 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:05:37.610955+08:00, resultsCount=0 2022-12-08 15:05:37.791 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:37.792 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:05:37.610955+08:00, resultsCount=0 2022-12-08 15:05:37.792 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:05:37.610955+08:00 2022-12-08 15:05:37.795 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:37.795 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:37.843 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:05:38.150 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:05:38.353 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:38.354 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:38.357 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:38.370 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20221216 2022-12-08 15:05:38.374 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:38.374 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:38.377 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:05:38.462 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:05:38.691 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:05:38.941 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:05:39.289 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:39.290 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:39.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2022-12-08 15:05:39.310 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:39.310 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:39.314 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:05:39.319 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:39.320 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:39.322 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2022-12-08 15:05:39.368 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221108 2022-12-08 15:05:39.372 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:39.372 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:39.375 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221108 values less than (1667952000000000)) 2022-12-08 15:05:39.611 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:05:39.634 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=22ms, period=120000ms 2022-12-08 15:05:40.208 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:40.209 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:40.212 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:40.224 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:40.229 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:40.230 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221109 2022-12-08 15:05:40.233 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:40.234 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:40.238 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221109 values less than (1668038400000000)) 2022-12-08 15:05:40.337 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:05:40.345 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:05:40.906 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:40.906 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:40.911 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:40.931 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221110 2022-12-08 15:05:40.934 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:40.935 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:40.939 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221110 values less than (1668124800000000)) 2022-12-08 15:05:40.940 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:40.940 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:41.453 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:05:41.547 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:41.548 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:41.551 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:41.567 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221111 2022-12-08 15:05:41.573 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:41.573 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:41.577 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221111 values less than (1668211200000000)) 2022-12-08 15:05:41.589 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:41.679 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:05:42.051 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:05:42.188 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:42.189 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:42.192 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:42.204 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221112 2022-12-08 15:05:42.208 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:42.208 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:42.211 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221112 values less than (1668297600000000)) 2022-12-08 15:05:43.156 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:43.157 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:43.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:43.176 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221113 2022-12-08 15:05:43.180 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:43.180 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:43.183 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221113 values less than (1668384000000000)) 2022-12-08 15:05:43.230 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:43.236 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:43.723 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:43.724 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:43.727 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:43.746 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221114 2022-12-08 15:05:43.749 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:43.750 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:43.753 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221114 values less than (1668470400000000)) 2022-12-08 15:05:44.014 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:44.014 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:44.054 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:44.054 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:44.586 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:44.587 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:44.590 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:44.606 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221115 2022-12-08 15:05:44.609 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:44.610 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:44.613 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221115 values less than (1668556800000000)) 2022-12-08 15:05:45.499 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:45.501 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:45.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:45.521 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221116 2022-12-08 15:05:45.524 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:45.525 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:45.528 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221116 values less than (1668643200000000)) 2022-12-08 15:05:46.236 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:46.241 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:46.684 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:46.715 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:05:46.722 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:05:46.788 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1260, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221116 values less than (1668643200000000)) 2022-12-08 15:05:46.792 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:46.792 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:46.796 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:46.812 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221117 2022-12-08 15:05:46.816 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:46.817 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:46.821 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221117 values less than (1668729600000000)) 2022-12-08 15:05:47.004 INFO 42 --- [pool-ocp-schedules-8,,3cf30ad2996f] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:05:47.038 INFO 42 --- [pool-ocp-schedules-8,,3cf30ad2996f] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:05:47.039 INFO 42 --- [pool-ocp-schedules-17,,2b8a85885247] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:05:47.039 INFO 42 --- [pool-ocp-schedules-17,,2b8a85885247] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:05:47.049 INFO 42 --- [pool-ocp-schedules-19,,fc18814a2c8e] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:05:47.070 INFO 42 --- [pool-ocp-schedules-7,,d7bbefaefb0c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:05:47.154 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:47.156 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:47.218 INFO 42 --- [pool-ocp-schedules-16,,22d94b95668f] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:05:47.349 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:05:47.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:05:47.591 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:47.591 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:47.594 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:47.612 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221118 2022-12-08 15:05:47.612 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:05:47.606727+08:00, lastProcessTime=2022-12-08T15:05:37.610955+08:00 2022-12-08 15:05:47.624 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:47.624 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:47.628 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221118 values less than (1668816000000000)) 2022-12-08 15:05:47.812 INFO 42 --- [pool-ocp-schedules-15,,9b4aea129cfe] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:05:47.866 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:05:47.606727+08:00, resultsCount=0 2022-12-08 15:05:47.867 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:05:47.606727+08:00, resultsCount=0 2022-12-08 15:05:47.868 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:05:47.606727+08:00 2022-12-08 15:05:47.950 INFO 42 --- [pool-ocp-schedules-18,,724afaae8d63] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:05:48.028 INFO 42 --- [pool-ocp-schedules-5,,aa31df9cc759] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:05:48.135 INFO 42 --- [pool-ocp-schedules-3,,cd14b02efdc6] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:05:48.136 INFO 42 --- [pool-ocp-schedules-3,,cd14b02efdc6] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:05:48.136 INFO 42 --- [pool-ocp-schedules-3,,cd14b02efdc6] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:05:48.721 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1093, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221118 values less than (1668816000000000)) 2022-12-08 15:05:48.726 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:48.726 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:48.737 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:48.750 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221119 2022-12-08 15:05:48.753 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:48.754 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:48.757 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221119 values less than (1668902400000000)) 2022-12-08 15:05:48.976 INFO 42 --- [pool-ocp-schedules-1,,2cf273c326a2] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:05:48.976 INFO 42 --- [pool-ocp-schedules-1,,2cf273c326a2] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:05:49.154 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:05:49.242 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:49.249 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:49.802 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1045, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221119 values less than (1668902400000000)) 2022-12-08 15:05:49.806 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:49.806 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:49.809 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:49.822 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221120 2022-12-08 15:05:49.826 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:49.827 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:49.830 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221120 values less than (1668988800000000)) 2022-12-08 15:05:50.272 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:50.273 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:50.273 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:50.273 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:51.107 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1277, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221120 values less than (1668988800000000)) 2022-12-08 15:05:51.111 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:51.112 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:51.115 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:51.134 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221121 2022-12-08 15:05:51.138 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:51.139 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:51.143 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221121 values less than (1669075200000000)) 2022-12-08 15:05:51.624 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:51.724 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:05:51.752 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:51.752 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:51.755 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:51.768 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221122 2022-12-08 15:05:51.772 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:51.772 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:51.775 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221122 values less than (1669161600000000)) 2022-12-08 15:05:52.119 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:05:52.249 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:52.254 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:52.517 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:05:52.530 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:05:52.573 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:52.574 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:52.578 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:52.595 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221123 2022-12-08 15:05:52.598 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:52.598 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:52.602 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 15:05:53.196 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:05:53.544 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:53.546 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:53.566 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:53.567 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:53.571 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:53.587 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221124 2022-12-08 15:05:53.591 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:53.591 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:53.595 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 15:05:53.808 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:05:54.540 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:54.541 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:54.544 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:54.562 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221125 2022-12-08 15:05:54.565 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:54.565 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:54.570 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 15:05:55.255 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:55.260 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:56.288 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1718, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 15:05:56.292 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:56.292 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:56.295 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:56.312 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221126 2022-12-08 15:05:56.316 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:56.316 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:56.321 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 15:05:56.731 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:56.731 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:05:56.732 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:56.732 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:05:56.735 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:05:57.016 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:57.016 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:57.019 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:57.035 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221127 2022-12-08 15:05:57.038 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:57.039 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:57.042 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 15:05:57.071 INFO 42 --- [pool-ocp-schedules-3,,736896227c6c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:05:57.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:05:57.603 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:05:57.599559+08:00, lastProcessTime=2022-12-08T15:05:47.606727+08:00 2022-12-08 15:05:57.727 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:05:57.599559+08:00, resultsCount=0 2022-12-08 15:05:57.728 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:05:57.599559+08:00, resultsCount=0 2022-12-08 15:05:57.728 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:05:57.599559+08:00 2022-12-08 15:05:57.906 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:57.907 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:57.910 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:57.925 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221128 2022-12-08 15:05:57.968 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:57.968 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:57.973 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 15:05:58.261 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:05:58.270 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:05:58.657 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:58.658 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:58.661 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:58.676 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221129 2022-12-08 15:05:58.680 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:58.680 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:58.684 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 15:05:59.041 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:05:59.047 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:05:59.426 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:05:59.486 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:59.487 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:59.491 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:05:59.506 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221130 2022-12-08 15:05:59.509 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:05:59.510 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:05:59.512 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:05:59.801 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:05:59.801 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:00.001 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:06:00.207 INFO 42 --- [pool-prometheus-minute-schedule-1,,e2e324f01693] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483220, interval=60 2022-12-08 15:06:00.208 INFO 42 --- [pool-prometheus-minute-schedule-2,,903ff67050c0] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483220, interval=60 2022-12-08 15:06:00.209 INFO 42 --- [pool-prometheus-minute-schedule-2,,903ff67050c0] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483160, count=0, elapsed=1668812677049 2022-12-08 15:06:00.208 INFO 42 --- [pool-prometheus-minute-schedule-1,,e2e324f01693] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483160, count=0, elapsed=1668812677048 2022-12-08 15:06:00.258 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:06:00.359 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:00.360 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:00.363 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:00.384 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221201 2022-12-08 15:06:00.392 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:00.393 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:00.396 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:06:00.997 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:04:01.0, nextRun=2022-12-08 15:06:00.0, currentDate=Thu Dec 08 15:06:00 CST 2022 2022-12-08 15:06:00.998 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:04:01.0, nextRunTime=2022-12-08 15:06:00.0} 2022-12-08 15:06:01.001 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:01.002 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:01.005 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:01.020 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:06:01.024 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221202 2022-12-08 15:06:01.027 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:01.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:01.030 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:06:01.097 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:02.0, nextRun=2022-12-08 15:06:00.0, currentDate=Thu Dec 08 15:06:01 CST 2022 2022-12-08 15:06:01.098 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:05:02.0, nextRunTime=2022-12-08 15:06:00.0} 2022-12-08 15:06:01.116 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:06:01.116 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:06:01.116 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:06:01.183 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:02.0, nextRun=2022-12-08 15:06:00.0, currentDate=Thu Dec 08 15:06:01 CST 2022 2022-12-08 15:06:01.184 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:05:02.0, nextRunTime=2022-12-08 15:06:00.0} 2022-12-08 15:06:01.217 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:06:01.217 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:06:01.217 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:06:01.271 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:01.276 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:01.279 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:02.0, nextRun=2022-12-08 15:06:00.0, currentDate=Thu Dec 08 15:06:01 CST 2022 2022-12-08 15:06:01.279 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:05:02.0, nextRunTime=2022-12-08 15:06:00.0} 2022-12-08 15:06:01.305 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:06:01.305 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:06:01.305 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:06:01.375 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:31.0, nextRun=2022-12-08 15:06:00.0, currentDate=Thu Dec 08 15:06:01 CST 2022 2022-12-08 15:06:01.376 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:05:31.0, nextRunTime=2022-12-08 15:06:00.0} 2022-12-08 15:06:01.400 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:06:01.400 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:06:01.401 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:06:01.502 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:02.0, nextRun=2022-12-08 15:06:00.0, currentDate=Thu Dec 08 15:06:01 CST 2022 2022-12-08 15:06:01.503 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:05:02.0, nextRunTime=2022-12-08 15:06:00.0} 2022-12-08 15:06:01.521 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:06:01.521 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:06:01.522 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:06:01.566 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:01.567 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:01.570 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:01.588 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221203 2022-12-08 15:06:01.592 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:01.592 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:01.596 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:06:01.667 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:01.779 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:06:02.205 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:06:02.258 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 32, operation:EXECUTE, state: RUNNING 2022-12-08 15:06:02.259 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:02.259 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:02.269 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:02.286 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221204 2022-12-08 15:06:02.292 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:02.292 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:02.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:06:02.321 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=32, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:06:02.237+08:00, endTime=null} 2022-12-08 15:06:02.400 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 33, operation:EXECUTE, state: RUNNING 2022-12-08 15:06:02.444 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=33, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:06:02.380+08:00, endTime=null} 2022-12-08 15:06:02.494 INFO 42 --- [pool-subtask-executor32,d267e73849fc4df0,5eb846b2efe3] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=32, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=32, task_operation=execute, latest_execution_start_time=2022-12-08T15:06:02.236+08:00, sub_task_instance_id=32}, listMap={}}, executor=192.168.28.62 2022-12-08 15:06:02.510 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 34, operation:EXECUTE, state: RUNNING 2022-12-08 15:06:02.628 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=34, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:06:02.497+08:00, endTime=null} 2022-12-08 15:06:02.644 INFO 42 --- [pool-subtask-executor31,d267e73849fc4df0,997ce7aa9f0b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=33, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=33, task_operation=execute, latest_execution_start_time=2022-12-08T15:06:02.379+08:00, sub_task_instance_id=33}, listMap={}}, executor=192.168.28.62 2022-12-08 15:06:02.717 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 35, operation:EXECUTE, state: RUNNING 2022-12-08 15:06:02.773 INFO 42 --- [pool-subtask-executor32,d267e73849fc4df0,5eb846b2efe3] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 32, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:06:02.800 INFO 42 --- [pool-subtask-executor31,d267e73849fc4df0,997ce7aa9f0b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 33, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:06:02.816 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=35, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:06:02.694+08:00, endTime=null} 2022-12-08 15:06:02.874 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,195a4bc3b78e] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=34, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=34, task_operation=execute, latest_execution_start_time=2022-12-08T15:06:02.496+08:00, sub_task_instance_id=34}, listMap={}}, executor=192.168.28.62 2022-12-08 15:06:02.881 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 36, operation:EXECUTE, state: RUNNING 2022-12-08 15:06:02.916 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:02.916 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:02.920 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:02.920 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:02.943 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=36, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:06:02.865+08:00, endTime=null} 2022-12-08 15:06:03.139 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,195a4bc3b78e] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 34, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:06:03.179 INFO 42 --- [pool-subtask-executor29,d267e73849fc4df0,4ba289434717] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=35, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=35, task_operation=execute, latest_execution_start_time=2022-12-08T15:06:02.693+08:00, sub_task_instance_id=35}, listMap={}}, executor=192.168.28.62 2022-12-08 15:06:03.179 INFO 42 --- [pool-subtask-executor29,d267e73849fc4df0,4ba289434717] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:06:03.208 INFO 42 --- [pool-subtask-executor29,d267e73849fc4df0,4ba289434717] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:06:03.221 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:03.221 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:03.224 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:03.239 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221205 2022-12-08 15:06:03.243 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:03.243 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:03.246 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:06:03.392 INFO 42 --- [pool-subtask-executor29,d267e73849fc4df0,4ba289434717] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 35, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:06:03.496 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:32, status:SUCCESS 2022-12-08 15:06:03.503 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:32, status:SUCCESS 2022-12-08 15:06:03.629 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:33, status:SUCCESS 2022-12-08 15:06:03.635 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:33, status:SUCCESS 2022-12-08 15:06:03.749 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:34, status:SUCCESS 2022-12-08 15:06:03.755 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:34, status:SUCCESS 2022-12-08 15:06:03.849 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:35, status:SUCCESS 2022-12-08 15:06:03.855 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:35, status:SUCCESS 2022-12-08 15:06:03.968 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:36, status:SUCCESS 2022-12-08 15:06:03.977 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:36, status:SUCCESS 2022-12-08 15:06:04.086 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:04.086 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:04.088 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:04.101 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221206 2022-12-08 15:06:04.104 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:04.104 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:04.107 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:06:04.276 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:04.280 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:04.585 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:04.585 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:04.587 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:04.598 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221207 2022-12-08 15:06:04.601 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:04.601 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:04.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:06:05.081 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:05.081 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:05.084 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:05.096 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221208 2022-12-08 15:06:05.100 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:05.100 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:05.103 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:06:05.600 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:05.600 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:05.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:05.623 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221209 2022-12-08 15:06:05.626 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:05.627 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:05.629 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:06:05.676 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:06:05.682 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:06:05.786 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:06.0, nextRun=2022-12-08 15:06:05.0, currentDate=Thu Dec 08 15:06:05 CST 2022 2022-12-08 15:06:05.787 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:05:06.0, nextRunTime=2022-12-08 15:06:05.0} 2022-12-08 15:06:05.805 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:06:05.805 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:06:05.805 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:06:06.153 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:06.162 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:06.179 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 37, operation:EXECUTE, state: RUNNING 2022-12-08 15:06:06.507 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=37, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:06:06.130+08:00, endTime=null} 2022-12-08 15:06:06.520 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:06:06.744 INFO 42 --- [pool-ocp-schedules-15,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:06:06.778 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:06.890 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1261, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:06:06.912 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:06.912 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:06.915 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:06.931 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221210 2022-12-08 15:06:06.934 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:06.934 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:06.941 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:06:07.072 INFO 42 --- [pool-ocp-schedules-3,,bd994a2403ca] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:06:07.281 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:07.285 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:07.411 INFO 42 --- [pool-ocp-schedules-15,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:06:07.587 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:07.588 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:07.592 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:07.601 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:06:07.617 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221211 2022-12-08 15:06:07.630 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:07.648 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:07.653 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:06:07.657 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:06:07.648860+08:00, lastProcessTime=2022-12-08T15:05:57.599559+08:00 2022-12-08 15:06:07.934 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:06:07.648860+08:00, resultsCount=0 2022-12-08 15:06:07.935 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:06:07.648860+08:00, resultsCount=0 2022-12-08 15:06:07.935 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:06:07.648860+08:00 2022-12-08 15:06:07.965 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:06:08.016 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:37, status:SUCCESS 2022-12-08 15:06:08.026 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:37, status:SUCCESS 2022-12-08 15:06:08.195 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : Started application in 7.991 seconds (JVM running for 529.495) 2022-12-08 15:06:08.251 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:06:08.393 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:08.393 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:08.396 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:08.415 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221212 2022-12-08 15:06:08.419 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:08.419 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:08.424 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:06:08.500 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:06:08.751 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:06:09.033 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:09.034 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:09.037 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:09.054 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221213 2022-12-08 15:06:09.058 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:09.058 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:09.062 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:06:09.216 INFO 42 --- [pool-ocp-schedules-20,,9031032fbe36] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:06:09.217 INFO 42 --- [pool-ocp-schedules-20,,9031032fbe36] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:06:09.511 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:09.511 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:09.513 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:09.514 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:09.538 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:06:10.286 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:10.293 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:10.333 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1271, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:06:10.337 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:10.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:10.340 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:10.357 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221214 2022-12-08 15:06:10.361 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:10.361 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:10.364 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:06:11.300 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:06:11.300+08:00 2022-12-08 15:06:11.521 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1157, sql=alter table `ob_hist_sql_audit_stat` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:06:11.525 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:11.525 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:11.528 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:11.544 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221215 2022-12-08 15:06:11.549 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:11.549 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:11.553 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:06:11.727 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:11.818 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:06:11.820 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:06:11.841 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:06:12.200 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:12.201 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:12.205 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:12.224 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20221216 2022-12-08 15:06:12.228 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:12.228 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:12.231 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:06:12.233 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:06:12.680 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:12.696 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:12.869 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:12.870 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:12.873 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2022-12-08 15:06:12.911 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:12.912 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:12.915 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:06:12.922 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:12.922 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:12.925 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2022-12-08 15:06:12.950 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221123 2022-12-08 15:06:12.953 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:12.954 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:12.957 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 15:06:12.958 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:06:13.296 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:13.301 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:14.484 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1527, sql=alter table `ob_hist_sqltext` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 15:06:14.488 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:14.489 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:14.492 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:14.507 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221124 2022-12-08 15:06:14.511 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:14.511 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:14.515 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 15:06:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,0500264d5ef1] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:06:15.213 INFO 42 --- [pool-prometheus-cache-monitor1,,0500264d5ef1] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:06:15.286 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:15.286 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:15.289 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:15.302 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221125 2022-12-08 15:06:15.309 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:15.310 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:15.312 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 15:06:15.762 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:15.762 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:15.951 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:15.951 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:16.071 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:16.072 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:16.075 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:16.093 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221126 2022-12-08 15:06:16.097 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:16.097 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:16.100 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 15:06:16.301 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:16.312 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:16.841 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:16.867 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:16.868 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:16.871 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:16.887 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221127 2022-12-08 15:06:16.891 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:16.892 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:16.895 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 15:06:17.075 INFO 42 --- [pool-ocp-schedules-3,,ac732dcbbbdc] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:06:17.411 ERROR 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing PLAN_CHANGE_DETECTOR org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=332) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=332) Table has no partition for value ; (conn=332) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=332) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.insert(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy412.save(Unknown Source) ~[na:na] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:49) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$ad3ec26.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=332) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_312] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_312] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 26 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 40 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 41 common frames omitted 2022-12-08 15:06:17.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:06:17.599 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:06:17.595641+08:00, lastProcessTime=2022-12-08T15:06:07.648860+08:00 2022-12-08 15:06:17.735 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:17.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:17.749 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:17.749 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:06:17.595641+08:00, resultsCount=0 2022-12-08 15:06:17.750 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:06:17.595641+08:00, resultsCount=0 2022-12-08 15:06:17.750 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:06:17.595641+08:00 2022-12-08 15:06:17.775 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221128 2022-12-08 15:06:17.782 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:17.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:17.785 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 15:06:18.527 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:06:18.532 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:06:18.764 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:18.764 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:18.768 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:18.792 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221129 2022-12-08 15:06:18.796 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:18.797 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:18.800 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 15:06:18.840 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:19.002 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:19.146 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:06:19.313 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:19.318 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:19.659 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:06:19.913 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1113, sql=alter table `ob_hist_sqltext` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 15:06:19.918 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:19.918 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:19.921 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:19.936 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221130 2022-12-08 15:06:19.939 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:19.939 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:19.942 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:06:20.350 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:21.0, nextRun=2022-12-08 15:06:20.0, currentDate=Thu Dec 08 15:06:20 CST 2022 2022-12-08 15:06:20.351 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:05:21.0, nextRunTime=2022-12-08 15:06:20.0} 2022-12-08 15:06:20.378 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:06:20.379 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:06:20.379 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:06:21.112 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1170, sql=alter table `ob_hist_sqltext` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:06:21.116 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:21.116 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:21.119 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:21.137 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221201 2022-12-08 15:06:21.141 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:21.141 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:21.147 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:06:21.147 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 38, operation:EXECUTE, state: RUNNING 2022-12-08 15:06:21.230 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=38, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:06:21.117+08:00, endTime=null} 2022-12-08 15:06:21.815 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:21.859 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:06:21.907 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:21.908 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:21.914 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:21.915 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:21.918 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:21.933 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221202 2022-12-08 15:06:21.936 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:21.936 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:21.939 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:06:21.987 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:38, status:SUCCESS 2022-12-08 15:06:21.995 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:38, status:SUCCESS 2022-12-08 15:06:22.081 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:22.081 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:22.273 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:06:22.319 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:22.325 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:23.247 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1308, sql=alter table `ob_hist_sqltext` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:06:23.251 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:23.252 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:23.256 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:23.282 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221203 2022-12-08 15:06:23.287 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:23.287 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:23.290 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:06:23.492 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:06:24.283 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:24.284 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:24.288 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:24.301 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221204 2022-12-08 15:06:24.307 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:24.308 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:24.312 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:06:24.463 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:06:24.469 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:06:25.018 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:25.0, nextRun=2022-12-08 15:06:25.0, currentDate=Thu Dec 08 15:06:25 CST 2022 2022-12-08 15:06:25.019 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:05:25.0, nextRunTime=2022-12-08 15:06:25.0} 2022-12-08 15:06:25.066 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:06:25.066 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:06:25.067 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:06:25.105 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:25.189 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:25.326 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:25.331 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:25.357 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 39, operation:EXECUTE, state: RUNNING 2022-12-08 15:06:25.397 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1085, sql=alter table `ob_hist_sqltext` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:06:25.401 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:25.401 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:25.405 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:25.426 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221205 2022-12-08 15:06:25.435 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:25.435 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:25.438 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:06:25.525 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=39, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:06:25.346+08:00, endTime=null} 2022-12-08 15:06:25.566 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:06:26.385 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:26.385 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:26.390 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:26.405 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221206 2022-12-08 15:06:26.408 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:26.409 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:26.411 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:06:26.875 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:26.970 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:39, status:SUCCESS 2022-12-08 15:06:26.977 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:39, status:SUCCESS 2022-12-08 15:06:27.077 INFO 42 --- [pool-ocp-schedules-4,,ebc6332bd4bb] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:06:27.339 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:27.340 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:27.345 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:27.366 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221207 2022-12-08 15:06:27.370 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:27.370 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:27.373 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:06:27.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:06:27.603 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:06:27.599902+08:00, lastProcessTime=2022-12-08T15:06:17.595641+08:00 2022-12-08 15:06:27.783 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:06:27.599902+08:00, resultsCount=0 2022-12-08 15:06:27.783 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:06:27.599902+08:00, resultsCount=0 2022-12-08 15:06:27.783 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:06:27.599902+08:00 2022-12-08 15:06:28.156 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:28.156 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:28.204 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:28.204 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:28.207 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:28.223 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221208 2022-12-08 15:06:28.226 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:28.226 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:28.230 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:06:28.278 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:28.279 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:28.332 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:28.336 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:29.054 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:29.054 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:29.057 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:29.070 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221209 2022-12-08 15:06:29.072 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:29.073 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:29.076 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:06:29.279 INFO 42 --- [pool-ocp-schedules-18,,8d5b0c370c02] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:06:29.280 INFO 42 --- [pool-ocp-schedules-18,,8d5b0c370c02] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:06:29.705 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:06:29.887 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:29.888 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:29.892 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:29.903 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221210 2022-12-08 15:06:29.912 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:29.913 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:29.916 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:06:30.498 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:31.0, nextRun=2022-12-08 15:06:30.0, currentDate=Thu Dec 08 15:06:30 CST 2022 2022-12-08 15:06:30.499 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:05:31.0, nextRunTime=2022-12-08 15:06:30.0} 2022-12-08 15:06:30.542 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:06:30.802 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:01.0, nextRun=2022-12-08 15:06:30.0, currentDate=Thu Dec 08 15:06:30 CST 2022 2022-12-08 15:06:30.803 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:06:01.0, nextRunTime=2022-12-08 15:06:30.0} 2022-12-08 15:06:30.829 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:06:30.837 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:06:30.853 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:06:30.853 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:06:30.854 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:06:31.216 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:31.337 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:31.342 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:31.344 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:31.358 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1442, sql=alter table `ob_hist_sqltext` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:06:31.361 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:31.362 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:31.365 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:31.378 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221211 2022-12-08 15:06:31.381 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:31.382 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:31.385 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:06:31.466 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:06:31.693 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 40, operation:EXECUTE, state: RUNNING 2022-12-08 15:06:31.751 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=40, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:06:31.676+08:00, endTime=null} 2022-12-08 15:06:32.091 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:32.096 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:06:32.497 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:06:32.620 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1235, sql=alter table `ob_hist_sqltext` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:06:32.624 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:32.624 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:32.629 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:32.644 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221212 2022-12-08 15:06:32.648 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:32.649 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:32.652 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:06:33.260 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:40, status:SUCCESS 2022-12-08 15:06:33.268 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:40, status:SUCCESS 2022-12-08 15:06:34.286 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:34.286 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:34.343 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:34.348 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:34.403 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1751, sql=alter table `ob_hist_sqltext` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:06:34.406 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:34.407 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:34.409 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:34.409 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:34.410 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:34.425 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221213 2022-12-08 15:06:34.429 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:34.429 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:34.432 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:06:36.533 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2101, sql=alter table `ob_hist_sqltext` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:06:36.539 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:36.539 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:36.542 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:36.555 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221214 2022-12-08 15:06:36.559 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:36.559 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:36.562 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:06:36.624 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:06:36.629 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:06:36.904 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:37.079 INFO 42 --- [pool-ocp-schedules-6,,2e9ec1902b7d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:06:37.349 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:37.370 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:37.396 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:37.396 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:37.400 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:37.433 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221215 2022-12-08 15:06:37.440 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:37.440 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:37.446 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:06:37.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:06:37.608 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:06:37.604718+08:00, lastProcessTime=2022-12-08T15:06:27.599902+08:00 2022-12-08 15:06:37.628 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:37.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:37.716 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:06:37.604718+08:00, resultsCount=0 2022-12-08 15:06:37.717 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:06:37.604718+08:00, resultsCount=0 2022-12-08 15:06:37.717 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:06:37.604718+08:00 2022-12-08 15:06:38.011 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:06:38.130 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:06:38.159 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:03:07+08:00, updateTime=2022-12-08T15:06:07+08:00, expireTime=null, isLeader=false} 2022-12-08 15:06:38.173 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:06:38.544 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:06:38.746 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:06:38.812 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:06:39.343 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1897, sql=alter table `ob_hist_sqltext` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:06:39.348 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:39.348 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:39.351 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:39.367 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20221216 2022-12-08 15:06:39.372 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:39.372 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:39.375 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:06:39.739 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:06:40.372 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:40.378 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:41.127 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:41.127 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:41.128 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:41.129 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:41.244 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1869, sql=alter table `ob_hist_sqltext` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:06:41.248 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:41.249 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:41.255 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2022-12-08 15:06:41.281 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:41.281 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:41.290 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:06:41.296 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:41.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:41.302 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2022-12-08 15:06:41.326 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221130 2022-12-08 15:06:41.332 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:41.333 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:41.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:06:42.252 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:42.252 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:42.262 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:42.281 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221201 2022-12-08 15:06:42.285 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:42.285 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:42.289 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:06:42.377 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:42.419 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:06:42.530 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:06:43.162 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:43.162 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:43.167 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:43.183 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221202 2022-12-08 15:06:43.188 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:43.188 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:43.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:06:43.379 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:43.385 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:43.386 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:06:43.394 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:06:43.907 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:43.907 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:43.913 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:43.926 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221203 2022-12-08 15:06:43.933 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:43.933 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:43.936 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:06:44.358 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:44.361 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:44.497 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:06:44.820 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:44.820 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:44.823 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:44.842 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221204 2022-12-08 15:06:44.845 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:44.846 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:44.849 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:06:46.007 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1158, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:06:46.010 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:46.011 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:46.014 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:46.031 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221205 2022-12-08 15:06:46.036 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:46.036 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:46.040 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:06:46.386 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:46.391 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:46.951 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:46.952 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:46.956 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:46.964 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:46.981 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221206 2022-12-08 15:06:46.985 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:46.985 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:46.988 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:06:47.007 INFO 42 --- [pool-ocp-schedules-1,,b1b24cc52cbd] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:06:47.049 INFO 42 --- [pool-ocp-schedules-1,,b1b24cc52cbd] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:06:47.050 INFO 42 --- [pool-ocp-schedules-1,,5658c76d55bb] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:06:47.080 INFO 42 --- [pool-ocp-schedules-16,,b79e86b39a57] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:06:47.223 INFO 42 --- [pool-ocp-schedules-10,,0d5b5a5fc0e8] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:06:47.438 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:47.438 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:47.460 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:47.460 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:47.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:06:47.598 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:06:47.595762+08:00, lastProcessTime=2022-12-08T15:06:37.604718+08:00 2022-12-08 15:06:47.750 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:06:47.595762+08:00, resultsCount=0 2022-12-08 15:06:47.751 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:06:47.595762+08:00, resultsCount=0 2022-12-08 15:06:47.751 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:06:47.595762+08:00 2022-12-08 15:06:48.035 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1047, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:06:48.040 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:48.040 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:48.043 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:48.049 INFO 42 --- [pool-ocp-schedules-15,,eef4e7e7c3d4] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:06:48.062 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221207 2022-12-08 15:06:48.066 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:48.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:48.075 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:06:48.127 INFO 42 --- [pool-ocp-schedules-1,,24f18134cc9f] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:06:48.132 INFO 42 --- [pool-ocp-schedules-18,,0d75aca7b5e3] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:06:48.253 INFO 42 --- [pool-ocp-schedules-2,,1cbf7e35f13b] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:06:48.254 INFO 42 --- [pool-ocp-schedules-2,,1cbf7e35f13b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:06:48.254 INFO 42 --- [pool-ocp-schedules-2,,1cbf7e35f13b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:06:48.730 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:48.730 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:48.734 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:48.748 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221208 2022-12-08 15:06:48.752 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:48.752 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:48.755 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:06:49.392 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:49.398 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:49.479 INFO 42 --- [pool-ocp-schedules-7,,45d45aff5000] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:06:49.480 INFO 42 --- [pool-ocp-schedules-7,,45d45aff5000] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:06:49.749 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:49.749 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:49.752 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:49.771 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221209 2022-12-08 15:06:49.775 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:49.775 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:49.778 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:06:49.856 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:06:49.863 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:06:50.034 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:06:50.545 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:50.587 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:50.759 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:50.759 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:50.763 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:50.776 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221210 2022-12-08 15:06:50.779 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:50.780 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:50.783 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:06:51.045 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:06:51.471 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:51.471 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:51.475 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:51.493 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221211 2022-12-08 15:06:51.497 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:51.497 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:51.500 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:06:52.398 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:52.418 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:52.433 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:52.497 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:06:52.576 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:06:52.694 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1194, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:06:52.702 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:52.703 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:52.708 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:52.731 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221212 2022-12-08 15:06:52.734 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:52.735 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:52.740 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:06:53.600 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:53.600 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:53.648 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:53.649 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:53.670 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:53.671 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:53.674 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:53.690 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221213 2022-12-08 15:06:53.694 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:53.694 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:53.699 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:06:53.747 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:06:55.078 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1379, sql=alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:06:55.082 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:55.083 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:55.086 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:55.097 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221214 2022-12-08 15:06:55.101 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:55.102 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:55.105 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:06:55.419 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:55.423 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:55.810 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:55.810 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:55.813 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:55.824 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221215 2022-12-08 15:06:55.827 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:55.828 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:55.831 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:06:56.289 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:06:56.295 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:06:56.689 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:56.690 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:56.693 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:56.712 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20221216 2022-12-08 15:06:56.716 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:56.716 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:56.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:06:56.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:56.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:06:57.008 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:06:57.081 INFO 42 --- [pool-ocp-schedules-20,,68d7f3b40fd5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:06:57.395 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:06:57.502 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:57.503 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:57.506 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2022-12-08 15:06:57.525 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:57.525 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:57.528 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:06:57.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:06:57.540 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:57.540 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:57.543 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2022-12-08 15:06:57.576 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221130 2022-12-08 15:06:57.582 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:57.582 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:57.586 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:06:57.605 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:06:57.600827+08:00, lastProcessTime=2022-12-08T15:06:47.595762+08:00 2022-12-08 15:06:57.728 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:06:57.600827+08:00, resultsCount=0 2022-12-08 15:06:57.728 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:06:57.600827+08:00, resultsCount=0 2022-12-08 15:06:57.729 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:06:57.600827+08:00 2022-12-08 15:06:58.102 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:58.102 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:58.106 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:06:58.124 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221201 2022-12-08 15:06:58.128 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:58.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:58.132 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:06:58.424 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:06:58.428 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:06:58.910 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:58.911 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:58.914 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:06:58.928 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221202 2022-12-08 15:06:58.931 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:58.932 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:58.935 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:06:59.684 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:59.684 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:59.700 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:06:59.721 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221203 2022-12-08 15:06:59.725 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:06:59.725 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:06:59.730 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:06:59.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:59.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:06:59.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:06:59.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:00.127 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:07:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,e58482b5a5bf] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483280, interval=60 2022-12-08 15:07:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,e58482b5a5bf] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483220, count=0, elapsed=1668812736985 2022-12-08 15:07:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,a72c1df192b7] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483280, interval=60 2022-12-08 15:07:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,a72c1df192b7] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483220, count=0, elapsed=1668812736989 2022-12-08 15:07:00.983 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1253, sql=alter table `ob_hist_plan_cache_plan` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:07:00.987 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:00.988 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:01.000 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:01.012 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221204 2022-12-08 15:07:01.016 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:01.017 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:01.022 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:07:01.291 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:01.0, nextRun=2022-12-08 15:07:00.0, currentDate=Thu Dec 08 15:07:01 CST 2022 2022-12-08 15:07:01.292 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:06:01.0, nextRunTime=2022-12-08 15:07:00.0} 2022-12-08 15:07:01.314 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:07:01.314 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:07:01.315 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:07:01.407 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:01.0, nextRun=2022-12-08 15:07:00.0, currentDate=Thu Dec 08 15:07:01 CST 2022 2022-12-08 15:07:01.408 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:06:01.0, nextRunTime=2022-12-08 15:07:00.0} 2022-12-08 15:07:01.429 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:01.434 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:01.438 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:07:01.439 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:07:01.439 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:07:01.499 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:01.0, nextRun=2022-12-08 15:07:00.0, currentDate=Thu Dec 08 15:07:01 CST 2022 2022-12-08 15:07:01.499 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:06:01.0, nextRunTime=2022-12-08 15:07:00.0} 2022-12-08 15:07:01.521 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:07:01.522 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:07:01.522 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:07:01.590 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:31.0, nextRun=2022-12-08 15:07:00.0, currentDate=Thu Dec 08 15:07:01 CST 2022 2022-12-08 15:07:01.591 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:06:31.0, nextRunTime=2022-12-08 15:07:00.0} 2022-12-08 15:07:01.610 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:07:01.611 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:07:01.611 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:07:01.694 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:02.0, nextRun=2022-12-08 15:07:00.0, currentDate=Thu Dec 08 15:07:01 CST 2022 2022-12-08 15:07:01.695 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:06:02.0, nextRunTime=2022-12-08 15:07:00.0} 2022-12-08 15:07:01.714 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:01.714 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:01.717 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:01.720 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:07:01.721 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:07:01.721 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:07:01.732 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221205 2022-12-08 15:07:01.736 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:01.736 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:01.739 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:07:02.221 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 41, operation:EXECUTE, state: RUNNING 2022-12-08 15:07:02.297 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:02.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:02.301 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:02.316 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221206 2022-12-08 15:07:02.320 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:02.320 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:02.323 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:07:02.397 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=41, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:07:02.208+08:00, endTime=null} 2022-12-08 15:07:02.472 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:02.485 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 42, operation:EXECUTE, state: RUNNING 2022-12-08 15:07:02.541 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:07:02.541 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=42, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:07:02.470+08:00, endTime=null} 2022-12-08 15:07:02.582 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:07:02.590 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:07:02.629 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 43, operation:EXECUTE, state: RUNNING 2022-12-08 15:07:02.642 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:07:02.771 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=43, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:07:02.613+08:00, endTime=null} 2022-12-08 15:07:02.784 INFO 42 --- [pool-subtask-executor29,d267e73849fc4df0,acbe74c0e9bc] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=42, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=42, task_operation=execute, latest_execution_start_time=2022-12-08T15:07:02.469+08:00, sub_task_instance_id=42}, listMap={}}, executor=192.168.28.62 2022-12-08 15:07:02.857 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 44, operation:EXECUTE, state: RUNNING 2022-12-08 15:07:03.040 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:03.040 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:03.061 INFO 42 --- [pool-subtask-executor29,d267e73849fc4df0,acbe74c0e9bc] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 42, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:07:03.083 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=44, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:07:02.841+08:00, endTime=null} 2022-12-08 15:07:03.222 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,06e56d76d5d7] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=43, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=43, task_operation=execute, latest_execution_start_time=2022-12-08T15:07:02.611+08:00, sub_task_instance_id=43}, listMap={}}, executor=192.168.28.62 2022-12-08 15:07:03.226 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 45, operation:EXECUTE, state: RUNNING 2022-12-08 15:07:03.299 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:07:03.348 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1025, sql=alter table `ob_hist_plan_cache_plan` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:07:03.351 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:03.351 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:03.354 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:03.366 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221207 2022-12-08 15:07:03.370 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:03.370 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:03.373 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:07:03.510 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=45, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:07:03.210+08:00, endTime=null} 2022-12-08 15:07:03.546 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,06e56d76d5d7] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 43, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:07:03.562 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:41, status:SUCCESS 2022-12-08 15:07:03.572 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:41, status:SUCCESS 2022-12-08 15:07:03.692 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:42, status:SUCCESS 2022-12-08 15:07:03.698 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:42, status:SUCCESS 2022-12-08 15:07:03.783 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:43, status:SUCCESS 2022-12-08 15:07:03.809 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:43, status:SUCCESS 2022-12-08 15:07:03.919 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:44, status:SUCCESS 2022-12-08 15:07:03.927 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:44, status:SUCCESS 2022-12-08 15:07:04.385 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1012, sql=alter table `ob_hist_plan_cache_plan` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:07:04.388 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:04.389 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:04.392 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:04.407 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221208 2022-12-08 15:07:04.412 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:04.412 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:04.415 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:07:04.435 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:04.442 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:05.691 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:45, status:SUCCESS 2022-12-08 15:07:05.703 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:45, status:SUCCESS 2022-12-08 15:07:05.976 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1561, sql=alter table `ob_hist_plan_cache_plan` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:07:05.983 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:05.983 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:05.986 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:06.003 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221209 2022-12-08 15:07:06.007 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:06.008 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:06.010 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:07:06.243 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:06.243 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:06.243 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:06.243 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:06.656 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:06.0, nextRun=2022-12-08 15:07:05.0, currentDate=Thu Dec 08 15:07:06 CST 2022 2022-12-08 15:07:06.657 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:06:06.0, nextRunTime=2022-12-08 15:07:05.0} 2022-12-08 15:07:06.676 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:07:06.677 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:07:06.677 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:07:07.045 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:07.083 INFO 42 --- [pool-ocp-schedules-9,,df29d99ac84d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:07:07.443 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:07.448 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:07.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:07:07.619 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:07:07.612596+08:00, lastProcessTime=2022-12-08T15:06:57.600827+08:00 2022-12-08 15:07:07.647 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 46, operation:EXECUTE, state: RUNNING 2022-12-08 15:07:07.669 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1659, sql=alter table `ob_hist_plan_cache_plan` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:07:07.673 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:07.673 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:07.677 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:07.693 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221210 2022-12-08 15:07:07.698 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:07.698 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:07.703 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:07:07.767 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:07:07.612596+08:00, resultsCount=0 2022-12-08 15:07:07.768 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:07:07.612596+08:00, resultsCount=0 2022-12-08 15:07:07.768 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:07:07.612596+08:00 2022-12-08 15:07:07.840 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=46, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:07:07.632+08:00, endTime=null} 2022-12-08 15:07:08.253 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:07:08.582 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:08.582 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:08.586 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:08.602 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221211 2022-12-08 15:07:08.606 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:08.607 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:08.612 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:07:08.790 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:46, status:SUCCESS 2022-12-08 15:07:08.799 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:46, status:SUCCESS 2022-12-08 15:07:08.812 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:07:08.821 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:07:08.828 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:07:08.921 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:07:09.012 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:07:09.115 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:04:08+08:00, updateTime=2022-12-08T15:06:38+08:00, expireTime=null, isLeader=false} 2022-12-08 15:07:09.124 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:07:09.585 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:09.585 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:09.592 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:09.612 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221212 2022-12-08 15:07:09.616 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:09.617 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:09.623 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:07:09.671 INFO 42 --- [pool-ocp-schedules-4,,85e67768f145] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:07:09.672 INFO 42 --- [pool-ocp-schedules-4,,85e67768f145] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:07:09.718 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:09.718 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:10.026 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:07:10.233 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:07:10.449 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:10.460 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:10.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1371, sql=alter table `ob_hist_plan_cache_plan` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:07:10.998 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:10.998 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:11.001 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:11.017 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221213 2022-12-08 15:07:11.021 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:11.022 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:11.025 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:07:12.067 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1042, sql=alter table `ob_hist_plan_cache_plan` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:07:12.072 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:12.073 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:12.077 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:12.091 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221214 2022-12-08 15:07:12.095 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:12.095 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:12.098 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:07:12.514 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:12.613 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:07:12.838 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:12.839 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:12.935 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:07:12.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:12.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:13.354 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1256, sql=alter table `ob_hist_plan_cache_plan` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:07:13.357 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:13.357 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:13.360 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:13.378 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221215 2022-12-08 15:07:13.384 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:13.385 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:13.389 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:07:13.461 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:13.467 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:14.228 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:14.229 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:14.234 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:14.249 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20221216 2022-12-08 15:07:14.253 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:14.253 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:14.258 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:07:14.962 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:14.962 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:14.966 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2022-12-08 15:07:14.984 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:14.984 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:14.988 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:07:14.996 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:14.996 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:14.999 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2022-12-08 15:07:15.033 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221130 2022-12-08 15:07:15.037 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:15.037 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:15.041 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:07:15.213 INFO 42 --- [pool-prometheus-cache-monitor1,,59e9834cb65e] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:07:15.214 INFO 42 --- [pool-prometheus-cache-monitor1,,59e9834cb65e] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:07:15.345 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:07:15.352 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:07:15.831 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:15.831 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:15.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:15.849 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221201 2022-12-08 15:07:15.853 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:15.853 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:15.857 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:07:16.015 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:16.111 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:16.446 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:07:16.468 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:16.473 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:16.926 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1069, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:07:16.929 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:16.930 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:16.933 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:16.951 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221202 2022-12-08 15:07:16.961 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:16.961 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:16.965 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:07:17.084 INFO 42 --- [pool-ocp-schedules-19,,7166d5d00391] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:07:17.346 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:17.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:07:17.603 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:07:17.599237+08:00, lastProcessTime=2022-12-08T15:07:07.612596+08:00 2022-12-08 15:07:17.755 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:07:17.599237+08:00, resultsCount=0 2022-12-08 15:07:17.755 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:07:17.599237+08:00, resultsCount=0 2022-12-08 15:07:17.756 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:07:17.599237+08:00 2022-12-08 15:07:17.860 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:17.860 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:17.867 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:17.886 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221203 2022-12-08 15:07:17.890 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:17.890 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:17.898 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:07:18.896 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:18.897 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:18.900 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:18.913 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221204 2022-12-08 15:07:18.921 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:18.921 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:18.924 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:07:19.095 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:19.095 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:19.194 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:19.194 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:19.474 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:19.481 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:19.918 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:19.918 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:19.922 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:19.943 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221205 2022-12-08 15:07:19.948 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:19.949 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:19.951 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:07:20.415 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:07:21.226 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1275, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:07:21.231 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:21.232 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:21.236 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:21.255 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221206 2022-12-08 15:07:21.259 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:21.260 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:21.263 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:07:21.369 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:20.0, nextRun=2022-12-08 15:07:20.0, currentDate=Thu Dec 08 15:07:21 CST 2022 2022-12-08 15:07:21.370 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:06:20.0, nextRunTime=2022-12-08 15:07:20.0} 2022-12-08 15:07:21.388 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:07:21.389 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:07:21.389 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:07:21.670 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:07:21.676 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:07:22.106 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 47, operation:EXECUTE, state: RUNNING 2022-12-08 15:07:22.159 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=47, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:07:22.090+08:00, endTime=null} 2022-12-08 15:07:22.181 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:22.182 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:22.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:22.196 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221207 2022-12-08 15:07:22.201 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:22.202 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:22.205 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:07:22.223 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:22.305 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:22.482 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:22.487 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:22.778 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:22.781 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:07:22.798 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:07:23.060 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:07:23.083 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:23.084 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:23.087 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:23.099 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221208 2022-12-08 15:07:23.104 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:23.104 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:23.108 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:07:23.425 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:47, status:SUCCESS 2022-12-08 15:07:23.433 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:47, status:SUCCESS 2022-12-08 15:07:24.012 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:07:24.186 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1078, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:07:24.195 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:24.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:24.198 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:24.215 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221209 2022-12-08 15:07:24.218 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:24.219 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:24.222 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:07:25.169 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:25.169 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:25.177 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:25.196 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221210 2022-12-08 15:07:25.200 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:25.201 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:25.204 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:07:25.294 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:25.294 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:25.382 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:25.383 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:25.488 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:25.498 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:25.905 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:25.0, nextRun=2022-12-08 15:07:25.0, currentDate=Thu Dec 08 15:07:25 CST 2022 2022-12-08 15:07:25.906 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:06:25.0, nextRunTime=2022-12-08 15:07:25.0} 2022-12-08 15:07:25.963 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:07:25.964 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:07:25.964 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:07:26.274 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 48, operation:EXECUTE, state: RUNNING 2022-12-08 15:07:26.278 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1074, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:07:26.283 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:26.283 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:26.287 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:26.301 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221211 2022-12-08 15:07:26.304 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:26.305 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:26.308 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:07:26.355 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=48, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:07:26.260+08:00, endTime=null} 2022-12-08 15:07:27.085 INFO 42 --- [pool-ocp-schedules-1,,fb853a91ed37] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:07:27.227 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:48, status:SUCCESS 2022-12-08 15:07:27.236 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:48, status:SUCCESS 2022-12-08 15:07:27.303 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:27.303 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:27.307 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:27.323 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221212 2022-12-08 15:07:27.327 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:27.327 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:27.331 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:07:27.423 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:27.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:07:27.602 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:07:27.599290+08:00, lastProcessTime=2022-12-08T15:07:17.599237+08:00 2022-12-08 15:07:27.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:07:27.599290+08:00, resultsCount=0 2022-12-08 15:07:27.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:07:27.599290+08:00, resultsCount=0 2022-12-08 15:07:27.740 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:07:27.599290+08:00 2022-12-08 15:07:28.000 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:07:28.007 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:07:28.361 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:28.446 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:28.499 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:28.510 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:28.526 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1195, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:07:28.531 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:28.532 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:28.536 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:28.552 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221213 2022-12-08 15:07:28.556 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:28.557 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:28.562 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:07:28.620 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:07:29.319 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:29.320 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:29.323 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:29.336 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221214 2022-12-08 15:07:29.340 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:29.340 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:29.344 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:07:29.743 INFO 42 --- [pool-ocp-schedules-13,,f35a3c6637aa] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:07:29.744 INFO 42 --- [pool-ocp-schedules-13,,f35a3c6637aa] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:07:30.281 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:30.0, nextRun=2022-12-08 15:07:30.0, currentDate=Thu Dec 08 15:07:30 CST 2022 2022-12-08 15:07:30.282 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:06:30.0, nextRunTime=2022-12-08 15:07:30.0} 2022-12-08 15:07:30.307 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:07:30.345 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1001, sql=alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:07:30.348 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:30.349 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:30.359 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:30.377 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221215 2022-12-08 15:07:30.381 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:30.381 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:30.392 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:07:30.440 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:07:02.0, nextRun=2022-12-08 15:07:30.0, currentDate=Thu Dec 08 15:07:30 CST 2022 2022-12-08 15:07:30.440 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:07:02.0, nextRunTime=2022-12-08 15:07:30.0} 2022-12-08 15:07:30.458 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:07:30.463 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:07:30.464 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:07:30.464 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:07:31.210 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:31.210 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:31.213 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:31.234 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20221216 2022-12-08 15:07:31.238 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:31.238 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:31.243 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:07:31.482 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:31.482 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:31.509 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 49, operation:EXECUTE, state: RUNNING 2022-12-08 15:07:31.511 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:31.515 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:31.533 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:31.534 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:31.611 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=49, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:07:31.495+08:00, endTime=null} 2022-12-08 15:07:32.211 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:32.212 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:32.215 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2022-12-08 15:07:32.237 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:32.238 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:32.242 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:07:32.271 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:32.271 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:32.275 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2022-12-08 15:07:32.320 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221130 2022-12-08 15:07:32.325 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:32.325 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:32.333 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:07:32.896 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:32.905 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:07:33.356 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:07:33.860 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:49, status:SUCCESS 2022-12-08 15:07:33.867 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:49, status:SUCCESS 2022-12-08 15:07:34.017 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:07:34.023 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:07:34.516 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:34.521 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:34.602 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:34.617 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:34.756 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:07:34.865 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2532, sql=alter table `ob_hist_sql_audit_sample` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:07:34.876 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:34.877 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:34.883 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:34.908 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221201 2022-12-08 15:07:34.915 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:34.916 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:34.920 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:07:37.071 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2151, sql=alter table `ob_hist_sql_audit_sample` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:07:37.077 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:37.078 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:37.083 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:37.087 INFO 42 --- [pool-ocp-schedules-10,,73ddb97e458f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:07:37.397 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221202 2022-12-08 15:07:37.403 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:37.403 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:37.407 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:07:37.522 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:37.532 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:37.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:07:37.549 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:37.600 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:07:37.588745+08:00, lastProcessTime=2022-12-08T15:07:27.599290+08:00 2022-12-08 15:07:37.707 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:37.707 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:37.749 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:07:37.588745+08:00, resultsCount=0 2022-12-08 15:07:37.750 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:37.750 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:07:37.588745+08:00, resultsCount=0 2022-12-08 15:07:37.750 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:37.752 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:07:37.588745+08:00 2022-12-08 15:07:38.307 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:07:38.718 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1311, sql=alter table `ob_hist_sql_audit_sample` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:07:38.722 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:38.722 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:38.725 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:38.739 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221203 2022-12-08 15:07:38.743 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:38.743 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:38.747 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:07:38.921 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:07:39.088 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:07:39.286 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:07:39.771 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1024, sql=alter table `ob_hist_sql_audit_sample` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:07:39.781 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:39.782 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:39.785 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:39.801 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221204 2022-12-08 15:07:39.808 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:07:39.823 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:39.824 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:39.828 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:07:39.836 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=28ms, period=120000ms 2022-12-08 15:07:39.978 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:07:39.986 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:07:40.534 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:40.544 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:40.561 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:07:40.674 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:40.674 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:40.678 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:40.690 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221205 2022-12-08 15:07:40.693 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:40.693 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:40.697 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:07:40.821 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:41.002 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:41.143 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:07:41.950 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1252, sql=alter table `ob_hist_sql_audit_sample` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:07:41.953 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:41.954 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:41.957 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:41.976 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221206 2022-12-08 15:07:41.980 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:41.981 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:41.984 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:07:42.791 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:42.792 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:42.796 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:42.811 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221207 2022-12-08 15:07:42.814 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:42.815 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:42.818 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:07:43.357 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:43.369 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:07:43.545 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:43.552 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:43.815 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:07:43.891 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1073, sql=alter table `ob_hist_sql_audit_sample` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:07:43.894 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:43.895 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:43.898 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:43.914 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221208 2022-12-08 15:07:43.919 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:43.919 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:43.922 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:07:44.010 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:44.011 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:44.092 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:44.092 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:44.807 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:44.808 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:44.812 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:44.824 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221209 2022-12-08 15:07:44.828 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:44.828 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:44.832 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:07:45.918 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1086, sql=alter table `ob_hist_sql_audit_sample` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:07:45.924 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:45.925 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:45.928 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:45.942 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221210 2022-12-08 15:07:45.946 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:45.947 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:45.950 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:07:46.350 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:07:46.357 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:07:46.553 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:46.558 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:46.668 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:46.668 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:46.671 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:46.685 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221211 2022-12-08 15:07:46.689 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:46.689 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:46.692 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:07:47.004 INFO 42 --- [pool-ocp-schedules-9,,47ad55672f0a] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:07:47.040 INFO 42 --- [pool-ocp-schedules-5,,6c75c0aa2bcd] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:07:47.040 INFO 42 --- [pool-ocp-schedules-5,,6c75c0aa2bcd] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:07:47.044 INFO 42 --- [pool-ocp-schedules-9,,47ad55672f0a] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:07:47.051 INFO 42 --- [pool-ocp-schedules-10,,2c495c8c2871] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:07:47.088 INFO 42 --- [pool-ocp-schedules-20,,26596de1d53c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:07:47.100 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:47.156 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:47.241 INFO 42 --- [pool-ocp-schedules-6,,c1b8db8ac154] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:07:47.443 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:07:47.518 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:47.518 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:47.523 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:47.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:07:47.543 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221212 2022-12-08 15:07:47.550 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:47.551 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:47.554 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:07:47.601 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:07:47.597805+08:00, lastProcessTime=2022-12-08T15:07:37.588745+08:00 2022-12-08 15:07:47.626 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:47.778 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:07:47.597805+08:00, resultsCount=0 2022-12-08 15:07:47.779 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:07:47.597805+08:00, resultsCount=0 2022-12-08 15:07:47.779 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:07:47.597805+08:00 2022-12-08 15:07:48.167 INFO 42 --- [pool-ocp-schedules-3,,51c191f095ae] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:07:48.296 INFO 42 --- [pool-ocp-schedules-20,,fa83155349cf] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:07:48.297 INFO 42 --- [pool-ocp-schedules-10,,408dc11c89a6] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:07:48.413 INFO 42 --- [pool-ocp-schedules-4,,3923c1a23f75] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:07:48.414 INFO 42 --- [pool-ocp-schedules-4,,3923c1a23f75] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:07:48.414 INFO 42 --- [pool-ocp-schedules-4,,3923c1a23f75] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:07:48.578 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1024, sql=alter table `ob_hist_sql_audit_sample` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:07:48.581 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:48.582 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:48.585 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:48.597 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221213 2022-12-08 15:07:48.601 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:48.601 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:48.605 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:07:49.559 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:49.570 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:49.594 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:49.595 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:49.598 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:49.617 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221214 2022-12-08 15:07:49.620 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:49.621 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:49.629 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:07:49.809 INFO 42 --- [pool-ocp-schedules-14,,bb78014cc387] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:07:49.810 INFO 42 --- [pool-ocp-schedules-14,,bb78014cc387] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:07:50.188 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:50.189 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:50.222 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:50.222 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:50.603 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:50.604 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:50.607 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:50.624 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221215 2022-12-08 15:07:50.628 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:50.629 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:50.634 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:07:50.944 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:07:51.501 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:51.502 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:51.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:51.522 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20221216 2022-12-08 15:07:51.526 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:51.527 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:51.530 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:07:52.336 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:52.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:52.340 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2022-12-08 15:07:52.357 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:52.357 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:52.361 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:07:52.367 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:52.367 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:52.371 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2022-12-08 15:07:52.410 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221108 2022-12-08 15:07:52.414 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:52.415 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:52.418 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221108 values less than (1667952000000000)) 2022-12-08 15:07:52.571 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:52.578 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:52.651 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:07:52.658 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:07:53.194 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:53.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:53.197 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:07:53.214 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221109 2022-12-08 15:07:53.217 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:53.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:53.221 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221109 values less than (1668038400000000)) 2022-12-08 15:07:53.271 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:53.346 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:53.529 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:53.576 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:07:53.760 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:07:53.837 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:53.838 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:53.842 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:07:53.859 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221110 2022-12-08 15:07:53.866 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:53.866 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:53.868 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:07:53.870 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221110 values less than (1668124800000000)) 2022-12-08 15:07:54.253 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:07:54.479 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:54.479 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:54.483 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:07:54.502 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221111 2022-12-08 15:07:54.506 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:54.506 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:54.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221111 values less than (1668211200000000)) 2022-12-08 15:07:55.108 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:55.109 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:55.113 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:07:55.154 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221112 2022-12-08 15:07:55.157 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:55.158 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:55.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221112 values less than (1668297600000000)) 2022-12-08 15:07:55.579 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:55.584 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:55.832 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:55.832 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:55.836 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:07:55.851 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221113 2022-12-08 15:07:55.857 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:55.857 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:55.861 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221113 values less than (1668384000000000)) 2022-12-08 15:07:56.345 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:56.345 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:56.435 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:07:56.435 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:07:56.705 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:56.705 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:56.708 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:07:56.721 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221114 2022-12-08 15:07:56.724 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:56.725 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:56.728 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221114 values less than (1668470400000000)) 2022-12-08 15:07:57.089 INFO 42 --- [pool-ocp-schedules-5,,a4bd45ab639c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:07:57.372 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:57.373 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:57.377 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:07:57.393 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221115 2022-12-08 15:07:57.399 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:57.399 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:57.404 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221115 values less than (1668556800000000)) 2022-12-08 15:07:57.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:07:57.618 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:07:57.613829+08:00, lastProcessTime=2022-12-08T15:07:47.597805+08:00 2022-12-08 15:07:57.681 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:07:57.785 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:07:57.613829+08:00, resultsCount=0 2022-12-08 15:07:57.786 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:07:57.613829+08:00, resultsCount=0 2022-12-08 15:07:57.786 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:07:57.613829+08:00 2022-12-08 15:07:58.225 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:58.225 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:58.228 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:07:58.245 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221116 2022-12-08 15:07:58.251 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:58.251 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:58.254 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221116 values less than (1668643200000000)) 2022-12-08 15:07:58.584 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:07:58.589 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:07:58.919 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:07:58.926 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:07:59.166 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:59.167 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:59.173 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:07:59.191 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221117 2022-12-08 15:07:59.195 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:07:59.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:07:59.200 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221117 values less than (1668729600000000)) 2022-12-08 15:07:59.489 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:59.509 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:07:59.693 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:08:00.175 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:00.176 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:00.183 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:00.202 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221118 2022-12-08 15:08:00.204 INFO 42 --- [pool-prometheus-minute-schedule-2,,8b272821a977] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483340, interval=60 2022-12-08 15:08:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,8b272821a977] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483280, count=0, elapsed=1668812796925 2022-12-08 15:08:00.206 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:00.206 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:00.208 INFO 42 --- [pool-prometheus-minute-schedule-1,,5f3d15ddb27f] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483340, interval=60 2022-12-08 15:08:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,5f3d15ddb27f] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483280, count=0, elapsed=1668812796929 2022-12-08 15:08:00.210 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221118 values less than (1668816000000000)) 2022-12-08 15:08:00.825 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:00.825 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:00.829 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:00.849 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221119 2022-12-08 15:08:00.856 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:00.857 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:00.860 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221119 values less than (1668902400000000)) 2022-12-08 15:08:00.876 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:06:01.0, nextRun=2022-12-08 15:08:00.0, currentDate=Thu Dec 08 15:08:00 CST 2022 2022-12-08 15:08:00.877 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:06:01.0, nextRunTime=2022-12-08 15:08:00.0} 2022-12-08 15:08:00.914 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:08:01.010 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:07:01.0, nextRun=2022-12-08 15:08:00.0, currentDate=Thu Dec 08 15:08:01 CST 2022 2022-12-08 15:08:01.015 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:07:01.0, nextRunTime=2022-12-08 15:08:00.0} 2022-12-08 15:08:01.031 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:08:01.037 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:08:01.038 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:08:01.038 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:08:01.132 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:07:01.0, nextRun=2022-12-08 15:08:00.0, currentDate=Thu Dec 08 15:08:01 CST 2022 2022-12-08 15:08:01.133 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:07:01.0, nextRunTime=2022-12-08 15:08:00.0} 2022-12-08 15:08:01.157 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:08:01.158 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:08:01.159 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:08:01.230 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:07:01.0, nextRun=2022-12-08 15:08:00.0, currentDate=Thu Dec 08 15:08:01 CST 2022 2022-12-08 15:08:01.231 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:07:01.0, nextRunTime=2022-12-08 15:08:00.0} 2022-12-08 15:08:01.255 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:08:01.256 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:08:01.256 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:08:01.343 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:07:30.0, nextRun=2022-12-08 15:08:00.0, currentDate=Thu Dec 08 15:08:01 CST 2022 2022-12-08 15:08:01.344 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:07:30.0, nextRunTime=2022-12-08 15:08:00.0} 2022-12-08 15:08:01.364 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:08:01.364 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:08:01.364 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:08:01.455 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:07:02.0, nextRun=2022-12-08 15:08:00.0, currentDate=Thu Dec 08 15:08:01 CST 2022 2022-12-08 15:08:01.456 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:07:02.0, nextRunTime=2022-12-08 15:08:00.0} 2022-12-08 15:08:01.484 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:08:01.485 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:08:01.485 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:08:01.591 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:01.597 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:01.652 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:01.652 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:01.655 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:01.670 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221120 2022-12-08 15:08:01.674 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:01.675 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:01.677 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221120 values less than (1668988800000000)) 2022-12-08 15:08:02.126 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 50, operation:EXECUTE, state: RUNNING 2022-12-08 15:08:02.212 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=50, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:08:02.113+08:00, endTime=null} 2022-12-08 15:08:02.288 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 51, operation:EXECUTE, state: RUNNING 2022-12-08 15:08:02.374 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=51, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:08:02.272+08:00, endTime=null} 2022-12-08 15:08:02.459 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:02.460 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:02.464 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:02.483 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221121 2022-12-08 15:08:02.486 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 52, operation:EXECUTE, state: RUNNING 2022-12-08 15:08:02.489 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:02.489 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:02.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221121 values less than (1669075200000000)) 2022-12-08 15:08:02.575 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=52, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:08:02.470+08:00, endTime=null} 2022-12-08 15:08:02.686 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:02.687 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:02.691 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:02.692 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:02.704 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 53, operation:EXECUTE, state: RUNNING 2022-12-08 15:08:02.798 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=53, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:08:02.675+08:00, endTime=null} 2022-12-08 15:08:02.877 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,a995b56bf872] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=52, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=52, task_operation=execute, latest_execution_start_time=2022-12-08T15:08:02.469+08:00, sub_task_instance_id=52}, listMap={}}, executor=192.168.28.62 2022-12-08 15:08:02.901 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 54, operation:EXECUTE, state: RUNNING 2022-12-08 15:08:03.162 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,a995b56bf872] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 52, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:08:03.168 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=54, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:08:02.874+08:00, endTime=null} 2022-12-08 15:08:03.570 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:50, status:SUCCESS 2022-12-08 15:08:03.576 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:50, status:SUCCESS 2022-12-08 15:08:03.595 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:03.617 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:08:03.647 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1153, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221121 values less than (1669075200000000)) 2022-12-08 15:08:03.650 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:03.650 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:03.671 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:03.684 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221122 2022-12-08 15:08:03.688 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:03.688 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:03.691 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221122 values less than (1669161600000000)) 2022-12-08 15:08:03.744 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:51, status:SUCCESS 2022-12-08 15:08:03.761 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:51, status:SUCCESS 2022-12-08 15:08:03.876 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:52, status:SUCCESS 2022-12-08 15:08:03.885 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:52, status:SUCCESS 2022-12-08 15:08:03.909 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:08:03.984 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:53, status:SUCCESS 2022-12-08 15:08:03.990 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:53, status:SUCCESS 2022-12-08 15:08:04.128 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:54, status:SUCCESS 2022-12-08 15:08:04.136 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:54, status:SUCCESS 2022-12-08 15:08:04.381 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:04.382 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:04.384 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:04.410 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221123 2022-12-08 15:08:04.414 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:04.414 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:04.417 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 15:08:04.598 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:04.603 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:04.849 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:08:04.855 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:08:05.000 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:05.001 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:05.004 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:05.030 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221124 2022-12-08 15:08:05.033 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:05.034 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:05.038 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 15:08:05.793 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:05.794 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:05.875 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:07:07.0, nextRun=2022-12-08 15:08:05.0, currentDate=Thu Dec 08 15:08:05 CST 2022 2022-12-08 15:08:05.876 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:07:07.0, nextRunTime=2022-12-08 15:08:05.0} 2022-12-08 15:08:05.918 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:08:05.919 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:08:05.919 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:08:05.966 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:08:06.407 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 55, operation:EXECUTE, state: RUNNING 2022-12-08 15:08:06.780 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=55, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:08:06.392+08:00, endTime=null} 2022-12-08 15:08:07.047 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2009, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 15:08:07.051 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:07.052 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:07.055 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:07.075 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221125 2022-12-08 15:08:07.084 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:07.084 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:07.088 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 15:08:07.091 INFO 42 --- [pool-ocp-schedules-2,,d5a0b4624d66] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:08:07.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:08:07.601 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:08:07.597496+08:00, lastProcessTime=2022-12-08T15:07:57.613829+08:00 2022-12-08 15:08:07.604 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:07.609 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:07.722 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:07.737 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:08:07.597496+08:00, resultsCount=0 2022-12-08 15:08:07.737 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:08:07.597496+08:00, resultsCount=0 2022-12-08 15:08:07.737 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:08:07.597496+08:00 2022-12-08 15:08:07.786 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:07.787 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:07.791 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:07.804 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221126 2022-12-08 15:08:07.808 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:07.809 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:07.813 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 15:08:08.197 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:55, status:SUCCESS 2022-12-08 15:08:08.204 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:55, status:SUCCESS 2022-12-08 15:08:08.491 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:08:08.828 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1015, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 15:08:08.831 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:08.832 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:08.836 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:08.861 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221127 2022-12-08 15:08:08.865 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:08.866 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:08.869 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 15:08:08.900 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:08.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:08.910 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:08.910 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:08.972 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:08:09.288 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:08:09.397 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:08:09.531 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:09.531 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:09.534 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:09.552 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221128 2022-12-08 15:08:09.556 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:09.556 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:09.562 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 15:08:09.906 INFO 42 --- [pool-ocp-schedules-4,,ae234d8231c8] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:08:09.907 INFO 42 --- [pool-ocp-schedules-4,,ae234d8231c8] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:08:10.269 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:10.269 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:10.273 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:10.291 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221129 2022-12-08 15:08:10.295 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:10.295 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:10.298 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 15:08:10.610 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:10.614 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:11.087 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:08:11.384 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1086, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 15:08:11.388 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:11.388 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:11.392 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:11.408 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221130 2022-12-08 15:08:11.412 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:11.413 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:11.416 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:08:11.615 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:08:11.621 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:08:11.992 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:11.995 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:12.320 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:08:12.529 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1113, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:08:12.533 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:12.533 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:12.537 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:12.550 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221201 2022-12-08 15:08:12.554 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:12.554 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:12.558 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:08:13.204 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:13.204 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:13.208 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:13.224 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221202 2022-12-08 15:08:13.227 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:13.227 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:13.233 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:08:13.616 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:13.620 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:13.646 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:13.690 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:08:13.939 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:13.939 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:13.941 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:08:13.942 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:13.954 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221203 2022-12-08 15:08:13.964 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:13.964 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:13.967 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:08:14.969 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:14.970 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:14.973 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:14.995 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221204 2022-12-08 15:08:14.998 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:14.998 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:15.002 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:08:15.089 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:15.090 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:15.090 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:15.090 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,46711f75dbfa] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:08:15.213 INFO 42 --- [pool-prometheus-cache-monitor1,,46711f75dbfa] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:08:15.694 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:15.695 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:15.698 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:15.714 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221205 2022-12-08 15:08:15.718 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:15.718 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:15.723 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:08:16.412 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:16.413 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:16.417 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:16.433 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221206 2022-12-08 15:08:16.439 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:16.440 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:16.443 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:08:16.620 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:16.625 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:17.092 INFO 42 --- [pool-ocp-schedules-16,,c96d6c1b4d8b] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:08:17.428 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:17.429 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:17.432 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:17.448 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221207 2022-12-08 15:08:17.452 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:17.452 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:17.455 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:08:17.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:08:17.554 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:08:17.560 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:08:17.619 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:08:17.615362+08:00, lastProcessTime=2022-12-08T15:08:07.597496+08:00 2022-12-08 15:08:17.650 ERROR 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing PLAN_CHANGE_DETECTOR org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=334) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=334) Table has no partition for value ; (conn=334) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=334) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.insert(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy412.save(Unknown Source) ~[na:na] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:49) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$ad3ec26.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=334) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_312] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_312] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 26 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 40 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 41 common frames omitted 2022-12-08 15:08:17.822 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:08:17.615362+08:00, resultsCount=0 2022-12-08 15:08:17.822 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:08:17.615362+08:00, resultsCount=0 2022-12-08 15:08:17.824 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:08:17.615362+08:00 2022-12-08 15:08:18.125 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:18.168 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:18.168 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:18.360 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:18.360 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:18.363 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:18.381 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221208 2022-12-08 15:08:18.385 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:18.386 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:18.388 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:08:18.696 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:08:19.175 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:19.175 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:19.178 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:19.189 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221209 2022-12-08 15:08:19.192 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:19.192 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:19.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:08:19.626 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:19.629 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:19.868 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:19.869 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:19.873 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:19.889 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221210 2022-12-08 15:08:19.892 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:19.893 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:19.896 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:08:20.518 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:20.519 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:20.522 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:20.538 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221211 2022-12-08 15:08:20.542 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:20.542 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:20.553 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:08:21.005 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:07:21.0, nextRun=2022-12-08 15:08:20.0, currentDate=Thu Dec 08 15:08:21 CST 2022 2022-12-08 15:08:21.006 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:07:21.0, nextRunTime=2022-12-08 15:08:20.0} 2022-12-08 15:08:21.024 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:08:21.024 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:08:21.025 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:08:21.126 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:21.126 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:21.129 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:21.146 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221212 2022-12-08 15:08:21.149 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:21.150 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:21.153 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:08:21.235 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 56, operation:EXECUTE, state: RUNNING 2022-12-08 15:08:21.260 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:08:21.280 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:21.281 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:21.284 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:21.285 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:21.288 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=56, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:08:21.223+08:00, endTime=null} 2022-12-08 15:08:21.949 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:56, status:SUCCESS 2022-12-08 15:08:21.960 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:56, status:SUCCESS 2022-12-08 15:08:22.142 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:22.143 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:22.146 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:22.162 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221213 2022-12-08 15:08:22.168 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:22.168 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:22.172 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:08:22.630 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:22.637 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:23.014 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:23.015 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:23.018 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:23.037 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221214 2022-12-08 15:08:23.042 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:23.042 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:23.045 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:08:23.713 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:23.772 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:08:23.991 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:23.992 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:23.996 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:24.013 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:08:24.014 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221215 2022-12-08 15:08:24.021 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:08:24.021 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:24.022 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:24.026 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:08:24.089 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:08:24.350 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:08:24.596 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:24.596 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:24.727 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:24.728 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:24.731 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:24.746 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20221216 2022-12-08 15:08:24.750 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:24.750 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:24.756 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:08:25.131 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:08:25.468 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:07:26.0, nextRun=2022-12-08 15:08:25.0, currentDate=Thu Dec 08 15:08:25 CST 2022 2022-12-08 15:08:25.469 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:07:26.0, nextRunTime=2022-12-08 15:08:25.0} 2022-12-08 15:08:25.521 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:08:25.521 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:08:25.522 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:08:25.586 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:25.587 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:25.590 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2022-12-08 15:08:25.605 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:25.605 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:25.608 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:08:25.624 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:25.624 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:25.627 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2022-12-08 15:08:25.638 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:25.643 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:25.656 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221108 2022-12-08 15:08:25.659 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:25.660 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:25.666 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221108 values less than (1667952000000000)) 2022-12-08 15:08:26.450 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 57, operation:EXECUTE, state: RUNNING 2022-12-08 15:08:26.705 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=57, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:08:26.434+08:00, endTime=null} 2022-12-08 15:08:27.093 INFO 42 --- [pool-ocp-schedules-18,,f155ac6fb3c8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:08:27.156 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1490, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221108 values less than (1667952000000000)) 2022-12-08 15:08:27.160 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:27.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:27.167 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:27.182 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221109 2022-12-08 15:08:27.185 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:27.185 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:27.189 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221109 values less than (1668038400000000)) 2022-12-08 15:08:27.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:08:27.607 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:08:27.603099+08:00, lastProcessTime=2022-12-08T15:08:17.615362+08:00 2022-12-08 15:08:27.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:27.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:27.694 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:27.695 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:27.726 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:08:27.603099+08:00, resultsCount=0 2022-12-08 15:08:27.726 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:08:27.603099+08:00, resultsCount=0 2022-12-08 15:08:27.726 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:08:27.603099+08:00 2022-12-08 15:08:28.139 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:57, status:SUCCESS 2022-12-08 15:08:28.145 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:57, status:SUCCESS 2022-12-08 15:08:28.223 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:28.448 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1259, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221109 values less than (1668038400000000)) 2022-12-08 15:08:28.454 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:28.454 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:28.472 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:28.484 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221110 2022-12-08 15:08:28.488 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:28.488 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:28.491 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221110 values less than (1668124800000000)) 2022-12-08 15:08:28.644 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:28.650 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:29.597 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1106, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221110 values less than (1668124800000000)) 2022-12-08 15:08:29.601 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:29.601 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:29.605 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:29.622 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221111 2022-12-08 15:08:29.626 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:29.627 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:29.631 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221111 values less than (1668211200000000)) 2022-12-08 15:08:29.983 INFO 42 --- [pool-ocp-schedules-4,,68a332e6b2a6] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:08:29.984 INFO 42 --- [pool-ocp-schedules-4,,68a332e6b2a6] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:08:30.376 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:08:30.383 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:08:30.571 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:30.571 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:30.576 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:30.595 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221112 2022-12-08 15:08:30.599 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:30.600 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:30.602 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221112 values less than (1668297600000000)) 2022-12-08 15:08:30.830 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:30.839 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:31.002 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:08:31.061 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:07:30.0, nextRun=2022-12-08 15:08:30.0, currentDate=Thu Dec 08 15:08:31 CST 2022 2022-12-08 15:08:31.062 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:07:30.0, nextRunTime=2022-12-08 15:08:30.0} 2022-12-08 15:08:31.083 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:08:31.318 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:08:31.351 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:01.0, nextRun=2022-12-08 15:08:30.0, currentDate=Thu Dec 08 15:08:31 CST 2022 2022-12-08 15:08:31.352 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:08:01.0, nextRunTime=2022-12-08 15:08:30.0} 2022-12-08 15:08:31.371 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:08:31.372 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:08:31.372 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:08:31.650 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:31.659 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:31.808 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1206, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221112 values less than (1668297600000000)) 2022-12-08 15:08:31.812 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:31.813 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:31.816 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:31.831 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221113 2022-12-08 15:08:31.834 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:31.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:31.837 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221113 values less than (1668384000000000)) 2022-12-08 15:08:31.849 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 58, operation:EXECUTE, state: RUNNING 2022-12-08 15:08:32.035 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=58, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:08:31.838+08:00, endTime=null} 2022-12-08 15:08:33.198 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1361, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221113 values less than (1668384000000000)) 2022-12-08 15:08:33.202 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:33.203 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:33.206 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:33.222 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221114 2022-12-08 15:08:33.226 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:33.227 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:33.230 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221114 values less than (1668470400000000)) 2022-12-08 15:08:33.343 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:58, status:SUCCESS 2022-12-08 15:08:33.353 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:58, status:SUCCESS 2022-12-08 15:08:33.794 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:33.870 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:08:33.931 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:33.931 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:33.932 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:33.933 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:34.165 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:08:34.647 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1417, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221114 values less than (1668470400000000)) 2022-12-08 15:08:34.652 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:34.652 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:34.655 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:34.660 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:34.664 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:34.667 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221115 2022-12-08 15:08:34.670 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:34.671 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:34.674 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221115 values less than (1668556800000000)) 2022-12-08 15:08:35.631 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:35.632 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:35.635 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:35.648 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221116 2022-12-08 15:08:35.652 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:35.653 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:35.656 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221116 values less than (1668643200000000)) 2022-12-08 15:08:36.508 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:08:36.513 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:08:36.832 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1176, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221116 values less than (1668643200000000)) 2022-12-08 15:08:36.835 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:36.836 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:36.839 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:36.854 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221117 2022-12-08 15:08:36.858 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:36.859 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:36.862 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221117 values less than (1668729600000000)) 2022-12-08 15:08:37.095 INFO 42 --- [pool-ocp-schedules-5,,e78c9a5d902d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:08:37.111 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:37.111 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:37.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:08:37.619 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:08:37.615462+08:00, lastProcessTime=2022-12-08T15:08:27.603099+08:00 2022-12-08 15:08:37.629 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:08:37.664 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:37.668 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:37.754 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:08:37.615462+08:00, resultsCount=0 2022-12-08 15:08:37.755 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:08:37.615462+08:00, resultsCount=0 2022-12-08 15:08:37.755 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:08:37.615462+08:00 2022-12-08 15:08:38.071 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1209, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221117 values less than (1668729600000000)) 2022-12-08 15:08:38.077 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:38.078 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:38.088 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:38.106 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221118 2022-12-08 15:08:38.110 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:38.110 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:38.115 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221118 values less than (1668816000000000)) 2022-12-08 15:08:38.288 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:38.559 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:08:39.000 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:08:39.052 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:04:38+08:00, updateTime=2022-12-08T15:08:08+08:00, expireTime=null, isLeader=false} 2022-12-08 15:08:39.059 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:08:39.297 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1182, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221118 values less than (1668816000000000)) 2022-12-08 15:08:39.305 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:39.305 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:39.309 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:39.324 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221119 2022-12-08 15:08:39.327 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:39.328 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:39.331 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221119 values less than (1668902400000000)) 2022-12-08 15:08:39.390 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:08:39.710 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:08:40.187 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:40.188 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:40.189 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:40.190 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:40.669 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:40.675 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:41.270 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1939, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221119 values less than (1668902400000000)) 2022-12-08 15:08:41.274 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:41.275 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:41.278 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:41.292 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221120 2022-12-08 15:08:41.295 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:41.296 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:41.299 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221120 values less than (1668988800000000)) 2022-12-08 15:08:41.377 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:08:42.209 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:42.210 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:42.213 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:42.229 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221121 2022-12-08 15:08:42.234 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:42.234 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:42.237 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221121 values less than (1669075200000000)) 2022-12-08 15:08:42.943 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:08:42.953 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:08:43.326 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:43.326 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:43.342 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1105, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221121 values less than (1669075200000000)) 2022-12-08 15:08:43.346 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:43.346 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:43.350 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:43.363 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221122 2022-12-08 15:08:43.367 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:43.367 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:43.370 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221122 values less than (1669161600000000)) 2022-12-08 15:08:43.590 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:08:43.676 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:43.681 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:43.840 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:44.083 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:08:44.183 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:44.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:44.188 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:44.202 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221123 2022-12-08 15:08:44.206 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:44.207 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:44.211 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 15:08:44.233 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:08:45.216 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1005, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 15:08:45.220 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:45.221 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:45.224 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:45.239 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221124 2022-12-08 15:08:45.243 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:45.243 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:45.247 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 15:08:46.397 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1150, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 15:08:46.402 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:46.403 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:46.406 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:46.407 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:46.408 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:46.409 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:46.409 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:46.420 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221125 2022-12-08 15:08:46.423 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:46.423 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:46.426 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 15:08:46.682 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:46.687 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:46.991 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 15:08:47.006 INFO 42 --- [pool-ocp-schedules-3,,b287d73940cb] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:08:47.050 INFO 42 --- [pool-ocp-schedules-3,,b287d73940cb] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:08:47.052 INFO 42 --- [pool-ocp-schedules-4,,d380bbfad007] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:08:47.096 INFO 42 --- [pool-ocp-schedules-17,,8c35bf729f98] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:08:47.247 INFO 42 --- [pool-ocp-schedules-6,,ed4bec5ffb6d] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:08:47.284 INFO 42 --- [pool-ocp-schedules-16,,73985bec1b48] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 15:08:47.440 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1014, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 15:08:47.444 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:47.444 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:47.447 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:47.459 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221126 2022-12-08 15:08:47.462 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:47.463 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:47.466 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 15:08:47.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:08:47.600 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:08:47.597639+08:00, lastProcessTime=2022-12-08T15:08:37.615462+08:00 2022-12-08 15:08:47.724 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:08:47.597639+08:00, resultsCount=0 2022-12-08 15:08:47.725 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:08:47.597639+08:00, resultsCount=0 2022-12-08 15:08:47.725 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:08:47.597639+08:00 2022-12-08 15:08:48.254 INFO 42 --- [pool-ocp-schedules-19,,60bf04a2724d] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:08:48.360 INFO 42 --- [pool-ocp-schedules-16,,b8f6d0c5cb17] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:08:48.360 INFO 42 --- [pool-ocp-schedules-14,,b5dfdd2fd271] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:08:48.371 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:48.555 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1089, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 15:08:48.558 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:48.558 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:48.562 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:48.571 INFO 42 --- [pool-ocp-schedules-20,,827ec88f4fa6] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:08:48.572 INFO 42 --- [pool-ocp-schedules-20,,827ec88f4fa6] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:08:48.572 INFO 42 --- [pool-ocp-schedules-20,,827ec88f4fa6] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:08:48.575 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221127 2022-12-08 15:08:48.579 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:48.579 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:48.582 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 15:08:48.735 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:08:48.741 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:08:49.516 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:49.516 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:49.688 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:49.693 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:49.966 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:08:50.058 INFO 42 --- [pool-ocp-schedules-7,,1afd37860fc5] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:08:50.060 INFO 42 --- [pool-ocp-schedules-7,,1afd37860fc5] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:08:50.091 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1509, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 15:08:50.098 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:50.099 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:50.102 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:50.120 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221128 2022-12-08 15:08:50.124 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:50.124 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:50.128 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 15:08:51.043 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:51.044 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:51.047 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:51.060 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221129 2022-12-08 15:08:51.064 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:51.065 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:51.068 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 15:08:51.486 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:08:51.914 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:51.915 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:51.918 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:51.935 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221130 2022-12-08 15:08:51.940 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:51.940 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:51.943 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:08:52.694 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:52.698 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:52.762 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:52.764 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:52.764 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:52.764 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:52.820 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:52.820 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:52.824 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:52.847 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221201 2022-12-08 15:08:52.854 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:52.855 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:52.859 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:08:53.891 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:53.977 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1119, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:08:53.981 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:53.981 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:53.985 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:54.017 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221202 2022-12-08 15:08:54.021 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:54.022 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:54.025 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:08:54.221 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:08:54.280 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:08:54.710 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:08:54.990 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:54.990 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:54.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:55.008 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221203 2022-12-08 15:08:55.012 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:55.012 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:55.016 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:08:55.152 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:08:55.159 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:08:55.699 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:55.704 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:55.880 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:55.880 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:08:55.975 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:55.976 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:55.979 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:55.996 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221204 2022-12-08 15:08:56.000 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:56.000 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:56.004 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:08:56.242 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:08:56.933 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:56.934 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:56.937 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:56.956 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221205 2022-12-08 15:08:56.962 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:56.963 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:56.967 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:08:57.097 INFO 42 --- [pool-ocp-schedules-19,,341202e42d0a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:08:57.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:08:57.601 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:08:57.597826+08:00, lastProcessTime=2022-12-08T15:08:47.597639+08:00 2022-12-08 15:08:57.736 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:08:57.597826+08:00, resultsCount=0 2022-12-08 15:08:57.736 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:08:57.597826+08:00, resultsCount=0 2022-12-08 15:08:57.736 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:08:57.597826+08:00 2022-12-08 15:08:58.440 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:08:58.705 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:08:58.710 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:08:58.943 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1976, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:08:58.947 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:58.948 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:58.950 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:58.950 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:58.950 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:08:58.951 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:58.951 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:08:58.969 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221206 2022-12-08 15:08:58.974 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:58.974 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:58.977 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:08:59.917 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:59.917 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:59.922 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:08:59.943 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221207 2022-12-08 15:08:59.947 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:08:59.947 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:08:59.951 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:09:00.001 INFO 42 --- [pool-ocp-schedules-19,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:09:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,8f6ab28facb3] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483400, interval=60 2022-12-08 15:09:00.206 INFO 42 --- [pool-prometheus-minute-schedule-2,,8f6ab28facb3] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483340, count=0, elapsed=1668812856866 2022-12-08 15:09:00.208 INFO 42 --- [pool-prometheus-minute-schedule-1,,4badfd67c170] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483400, interval=60 2022-12-08 15:09:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,4badfd67c170] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483340, count=0, elapsed=1668812856869 2022-12-08 15:09:00.995 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1044, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:09:01.003 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:01.003 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:01.007 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:09:01.021 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221208 2022-12-08 15:09:01.024 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:01.025 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:01.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:09:01.525 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:09:01.617 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:09:01.622 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:09:01.649 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:01.0, nextRun=2022-12-08 15:09:00.0, currentDate=Thu Dec 08 15:09:01 CST 2022 2022-12-08 15:09:01.650 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:08:01.0, nextRunTime=2022-12-08 15:09:00.0} 2022-12-08 15:09:01.673 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:09:01.674 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:09:01.674 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:09:01.711 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:01.728 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:01.766 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:01.0, nextRun=2022-12-08 15:09:00.0, currentDate=Thu Dec 08 15:09:01 CST 2022 2022-12-08 15:09:01.767 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:08:01.0, nextRunTime=2022-12-08 15:09:00.0} 2022-12-08 15:09:01.791 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:09:01.792 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:09:01.792 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:09:01.872 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:01.0, nextRun=2022-12-08 15:09:00.0, currentDate=Thu Dec 08 15:09:01 CST 2022 2022-12-08 15:09:01.873 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:08:01.0, nextRunTime=2022-12-08 15:09:00.0} 2022-12-08 15:09:01.889 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:01.889 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:01.894 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:09:01.899 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:09:01.900 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:09:01.900 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:09:01.915 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221209 2022-12-08 15:09:01.920 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:01.920 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:01.925 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:09:02.037 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:02.037 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:02.131 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:31.0, nextRun=2022-12-08 15:09:00.0, currentDate=Thu Dec 08 15:09:02 CST 2022 2022-12-08 15:09:02.132 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:08:31.0, nextRunTime=2022-12-08 15:09:00.0} 2022-12-08 15:09:02.150 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:09:02.151 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:09:02.151 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:09:02.290 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:09:02.463 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:01.0, nextRun=2022-12-08 15:09:00.0, currentDate=Thu Dec 08 15:09:02 CST 2022 2022-12-08 15:09:02.463 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:08:01.0, nextRunTime=2022-12-08 15:09:00.0} 2022-12-08 15:09:02.491 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:09:02.492 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:09:02.492 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:09:02.581 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 59, operation:EXECUTE, state: RUNNING 2022-12-08 15:09:02.691 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=59, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:09:02.566+08:00, endTime=null} 2022-12-08 15:09:02.778 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 60, operation:EXECUTE, state: RUNNING 2022-12-08 15:09:03.041 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=60, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:09:02.762+08:00, endTime=null} 2022-12-08 15:09:03.146 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 61, operation:EXECUTE, state: RUNNING 2022-12-08 15:09:03.227 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=61, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:09:03.127+08:00, endTime=null} 2022-12-08 15:09:03.307 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 62, operation:EXECUTE, state: RUNNING 2022-12-08 15:09:03.436 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,189c6d2248d9] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=61, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=61, task_operation=execute, latest_execution_start_time=2022-12-08T15:09:03.126+08:00, sub_task_instance_id=61}, listMap={}}, executor=192.168.28.62 2022-12-08 15:09:03.442 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=62, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:09:03.289+08:00, endTime=null} 2022-12-08 15:09:03.544 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,189c6d2248d9] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 61, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:09:03.798 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1873, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:09:03.803 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:03.803 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:03.806 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:09:03.824 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221210 2022-12-08 15:09:03.828 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:03.829 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:03.832 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:09:03.948 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:04.184 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:59, status:SUCCESS 2022-12-08 15:09:04.189 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:59, status:SUCCESS 2022-12-08 15:09:04.265 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:09:04.492 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:09:04.520 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:60, status:SUCCESS 2022-12-08 15:09:04.537 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:60, status:SUCCESS 2022-12-08 15:09:04.598 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 63, operation:EXECUTE, state: RUNNING 2022-12-08 15:09:04.675 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=63, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:09:04.554+08:00, endTime=null} 2022-12-08 15:09:04.684 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:61, status:SUCCESS 2022-12-08 15:09:04.689 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:61, status:SUCCESS 2022-12-08 15:09:04.698 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:04.698 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:04.701 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:09:04.713 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221211 2022-12-08 15:09:04.716 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:04.716 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:04.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:09:04.729 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:04.733 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:04.768 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:62, status:SUCCESS 2022-12-08 15:09:04.779 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:62, status:SUCCESS 2022-12-08 15:09:05.218 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:05.218 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:05.218 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:05.218 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:05.279 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:06.0, nextRun=2022-12-08 15:09:05.0, currentDate=Thu Dec 08 15:09:05 CST 2022 2022-12-08 15:09:05.280 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:08:06.0, nextRunTime=2022-12-08 15:09:05.0} 2022-12-08 15:09:05.297 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:09:05.297 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:09:05.297 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:09:05.570 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:05.571 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:05.573 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:09:05.587 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221212 2022-12-08 15:09:05.590 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:05.590 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:05.593 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:09:05.738 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 64, operation:EXECUTE, state: RUNNING 2022-12-08 15:09:05.799 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=64, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:09:05.727+08:00, endTime=null} 2022-12-08 15:09:06.005 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:63, status:SUCCESS 2022-12-08 15:09:06.010 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:63, status:SUCCESS 2022-12-08 15:09:06.409 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:06.409 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:06.412 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:09:06.428 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221213 2022-12-08 15:09:06.430 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:06.430 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:06.438 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:09:06.542 INFO 42 --- [pool-ocp-schedules-19,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:09:06.882 INFO 42 --- [pool-ocp-schedules-19,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:09:06.993 INFO 42 --- [pool-ocp-schedules-19,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:09:07.098 INFO 42 --- [pool-ocp-schedules-18,,0df6722241f3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:09:07.168 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:07.168 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:07.171 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:09:07.184 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221214 2022-12-08 15:09:07.187 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:07.187 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:07.189 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:09:07.230 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:64, status:SUCCESS 2022-12-08 15:09:07.248 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:64, status:SUCCESS 2022-12-08 15:09:07.278 INFO 42 --- [pool-ocp-schedules-19,,] o.s.boot.SpringApplication : Started application in 7.19 seconds (JVM running for 708.578) 2022-12-08 15:09:07.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:09:07.605 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:09:07.601628+08:00, lastProcessTime=2022-12-08T15:08:57.597826+08:00 2022-12-08 15:09:07.714 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:09:07.723 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:09:07.734 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:07.739 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:07.757 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:09:07.601628+08:00, resultsCount=0 2022-12-08 15:09:07.757 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:09:07.601628+08:00, resultsCount=0 2022-12-08 15:09:07.759 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:09:07.601628+08:00 2022-12-08 15:09:08.099 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:08.099 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:08.102 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:09:08.113 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221215 2022-12-08 15:09:08.116 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:08.116 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:08.118 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:09:08.308 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:08.310 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:08.551 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:08.680 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:09:08.844 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:09:08.896 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:08.896 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:08.900 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:09:08.909 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20221216 2022-12-08 15:09:08.912 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:08.912 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:08.913 INFO 42 --- [pool-ocp-schedules-19,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:09:08.913+08:00 2022-12-08 15:09:08.915 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:09:09.225 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:09:09.742 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:09:10.137 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:09:10.206 INFO 42 --- [pool-ocp-schedules-1,,98aa160d634b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:09:10.206 INFO 42 --- [pool-ocp-schedules-1,,98aa160d634b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:09:10.268 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:07:09+08:00, updateTime=2022-12-08T15:08:39+08:00, expireTime=null, isLeader=false} 2022-12-08 15:09:10.275 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:09:10.740 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:10.745 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:11.082 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2167, sql=alter table `ocp_perf_sql_diagnosis` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:09:11.086 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:11.087 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:11.091 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2022-12-08 15:09:11.109 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:11.109 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:11.113 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:11.119 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:11.120 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:11.122 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2022-12-08 15:09:11.151 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221130 2022-12-08 15:09:11.154 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:11.154 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:11.163 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:09:11.384 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:11.385 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:11.385 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:11.385 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:11.593 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:09:11.824 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:11.825 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:11.831 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:11.849 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221201 2022-12-08 15:09:11.853 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:11.853 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:11.857 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:09:12.554 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:12.554 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:12.558 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:12.573 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221202 2022-12-08 15:09:12.577 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:12.577 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:12.582 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:09:13.493 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:13.493 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:13.496 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:13.511 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221203 2022-12-08 15:09:13.514 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:13.515 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:13.518 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:09:13.746 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:13.754 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:13.987 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:14.072 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:09:14.078 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:09:14.218 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:14.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:14.225 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:14.244 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221204 2022-12-08 15:09:14.247 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:14.248 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:14.250 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:09:14.493 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:09:14.566 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:14.566 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:14.575 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:09:14.757 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:09:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,b82fe6507e89] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:09:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,b82fe6507e89] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:09:15.289 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1039, sql=alter table `ob_hist_active_session_stat_0` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:09:15.293 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:15.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:15.296 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:15.310 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221205 2022-12-08 15:09:15.314 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:15.315 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:15.318 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:09:16.123 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:16.124 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:16.127 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:16.143 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221206 2022-12-08 15:09:16.146 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:16.146 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:16.149 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:09:16.755 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:16.760 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:17.108 INFO 42 --- [pool-ocp-schedules-1,,196119e85fa6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:09:17.195 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1046, sql=alter table `ob_hist_active_session_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:09:17.199 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:17.199 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:17.202 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:17.221 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221207 2022-12-08 15:09:17.224 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:17.224 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:17.227 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:09:17.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:09:17.603 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:09:17.597620+08:00, lastProcessTime=2022-12-08T15:09:07.601628+08:00 2022-12-08 15:09:17.752 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:17.753 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:17.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:17.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:17.776 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:09:17.597620+08:00, resultsCount=0 2022-12-08 15:09:17.776 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:09:17.597620+08:00, resultsCount=0 2022-12-08 15:09:17.777 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:09:17.597620+08:00 2022-12-08 15:09:18.017 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T15:03:17.47, end=2022-12-08T15:08:17.47} 2022-12-08 15:09:18.020 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T15:03:17.446, end=2022-12-08T15:08:17.446} 2022-12-08 15:09:18.090 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:09:18.093 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:09:18.249 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1022, sql=alter table `ob_hist_active_session_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:09:18.253 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:18.253 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:18.259 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:18.273 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221208 2022-12-08 15:09:18.281 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:18.281 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:18.284 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:09:18.589 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:18.678 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:18.679 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:18.682 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:18.693 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221209 2022-12-08 15:09:18.697 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:18.697 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:18.700 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:09:19.168 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:19.168 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:19.172 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:19.187 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221210 2022-12-08 15:09:19.190 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:19.191 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:19.194 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:09:19.761 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:19.766 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:19.834 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:19.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:19.837 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:19.854 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221211 2022-12-08 15:09:19.861 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:19.862 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:19.868 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:09:20.024 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:09:20.035 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:09:20.417 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:20.418 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:20.421 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:20.438 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221212 2022-12-08 15:09:20.441 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:20.441 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:20.444 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:09:20.917 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:20.918 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:20.987 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:20.987 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:20.990 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:21.004 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:21.0, nextRun=2022-12-08 15:09:20.0, currentDate=Thu Dec 08 15:09:21 CST 2022 2022-12-08 15:09:21.005 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:08:21.0, nextRunTime=2022-12-08 15:09:20.0} 2022-12-08 15:09:21.007 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221213 2022-12-08 15:09:21.010 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:21.011 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:21.014 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:09:21.027 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:09:21.027 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:09:21.027 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:09:21.192 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:09:21.651 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:09:21.835 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:21.836 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:21.839 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:21.857 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221214 2022-12-08 15:09:21.861 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:21.861 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:21.865 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:09:22.108 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 65, operation:EXECUTE, state: RUNNING 2022-12-08 15:09:22.186 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=65, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:09:22.081+08:00, endTime=null} 2022-12-08 15:09:22.426 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:22.426 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:22.429 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:22.443 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221215 2022-12-08 15:09:22.447 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:22.447 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:22.449 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:09:22.767 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:22.772 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:23.189 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:23.190 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:23.193 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:23.209 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20221216 2022-12-08 15:09:23.212 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:23.213 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:23.216 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:09:23.323 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:65, status:SUCCESS 2022-12-08 15:09:23.330 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:65, status:SUCCESS 2022-12-08 15:09:24.000 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:24.000 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:24.001 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:24.001 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:24.067 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:24.395 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1179, sql=alter table `ob_hist_active_session_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:09:24.399 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:24.399 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:24.405 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2022-12-08 15:09:24.425 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:24.426 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:24.432 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:24.439 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:24.439 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:24.444 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2022-12-08 15:09:24.469 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202209 2022-12-08 15:09:24.472 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:24.472 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:24.475 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:24.742 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:09:24.743 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:09:24.885 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:24.886 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:24.889 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2022-12-08 15:09:24.906 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202210 2022-12-08 15:09:24.909 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:24.910 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:24.913 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:25.137 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:09:25.478 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:25.478 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:25.482 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2022-12-08 15:09:25.490 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:25.0, nextRun=2022-12-08 15:09:25.0, currentDate=Thu Dec 08 15:09:25 CST 2022 2022-12-08 15:09:25.490 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:08:25.0, nextRunTime=2022-12-08 15:09:25.0} 2022-12-08 15:09:25.495 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202211 2022-12-08 15:09:25.498 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:25.498 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:25.501 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:25.546 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:09:25.547 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:09:25.547 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:09:25.773 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:25.778 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:25.974 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:25.975 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:25.978 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2022-12-08 15:09:25.994 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202212 2022-12-08 15:09:25.997 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:25.997 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:26.001 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:26.320 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 66, operation:EXECUTE, state: RUNNING 2022-12-08 15:09:26.595 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:09:26.600 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:09:26.675 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=66, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:09:26.305+08:00, endTime=null} 2022-12-08 15:09:26.995 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:26.996 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:26.999 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2022-12-08 15:09:27.016 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:27.017 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:27.020 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:27.025 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:27.026 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:27.028 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2022-12-08 15:09:27.043 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202209 2022-12-08 15:09:27.046 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:27.047 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:27.050 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:27.109 INFO 42 --- [pool-ocp-schedules-8,,73eb71303990] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:09:27.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:27.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:27.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:09:27.603 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:09:27.600289+08:00, lastProcessTime=2022-12-08T15:09:17.597620+08:00 2022-12-08 15:09:27.745 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:09:27.600289+08:00, resultsCount=0 2022-12-08 15:09:27.746 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:09:27.600289+08:00, resultsCount=0 2022-12-08 15:09:27.746 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:09:27.600289+08:00 2022-12-08 15:09:27.749 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:09:27.968 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:27.969 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:27.972 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2022-12-08 15:09:27.986 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202210 2022-12-08 15:09:27.990 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:27.990 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:27.993 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:28.105 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:66, status:SUCCESS 2022-12-08 15:09:28.113 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:66, status:SUCCESS 2022-12-08 15:09:28.631 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:28.682 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:28.682 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:28.686 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2022-12-08 15:09:28.713 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202211 2022-12-08 15:09:28.717 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:28.717 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:28.720 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:28.778 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:28.783 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:29.481 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:29.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:29.485 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2022-12-08 15:09:29.504 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202212 2022-12-08 15:09:29.509 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:29.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:29.512 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:30.230 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:31.0, nextRun=2022-12-08 15:09:30.0, currentDate=Thu Dec 08 15:09:30 CST 2022 2022-12-08 15:09:30.231 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:08:31.0, nextRunTime=2022-12-08 15:09:30.0} 2022-12-08 15:09:30.261 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:09:30.400 INFO 42 --- [pool-ocp-schedules-19,,8820abc1d07f] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:09:30.400 INFO 42 --- [pool-ocp-schedules-19,,8820abc1d07f] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:09:30.465 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:30.466 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:30.472 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:09:02.0, nextRun=2022-12-08 15:09:30.0, currentDate=Thu Dec 08 15:09:30 CST 2022 2022-12-08 15:09:30.473 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:09:02.0, nextRunTime=2022-12-08 15:09:30.0} 2022-12-08 15:09:30.488 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:30.488 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:30.493 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:09:30.493 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:09:30.493 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:09:30.802 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 67, operation:EXECUTE, state: RUNNING 2022-12-08 15:09:30.827 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1315, sql=alter table `ob_hist_cluster` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:30.831 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:30.831 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:30.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2022-12-08 15:09:30.850 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:30.850 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:30.854 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:30.859 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:30.859 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:30.862 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2022-12-08 15:09:30.883 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202209 2022-12-08 15:09:30.888 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:30.888 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:30.889 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=67, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:09:30.789+08:00, endTime=null} 2022-12-08 15:09:30.892 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:31.537 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:31.537 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:31.540 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2022-12-08 15:09:31.555 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202210 2022-12-08 15:09:31.558 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:31.559 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:31.563 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:31.776 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:09:31.784 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:31.788 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:31.857 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:67, status:SUCCESS 2022-12-08 15:09:31.866 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:67, status:SUCCESS 2022-12-08 15:09:32.079 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:32.079 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:32.082 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2022-12-08 15:09:32.094 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202211 2022-12-08 15:09:32.100 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:32.100 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:32.104 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:32.673 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:32.674 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:32.678 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2022-12-08 15:09:32.696 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202212 2022-12-08 15:09:32.700 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:32.700 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:32.704 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:33.034 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:09:33.046 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:09:33.533 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:33.533 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:33.538 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2022-12-08 15:09:33.553 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:33.554 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:33.556 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:33.560 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:33.561 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:33.565 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2022-12-08 15:09:33.586 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202209 2022-12-08 15:09:33.590 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:33.590 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:33.593 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:33.593 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:33.599 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:33.721 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:09:34.184 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:34.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:34.187 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2022-12-08 15:09:34.197 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202210 2022-12-08 15:09:34.201 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:34.201 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:34.204 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:34.264 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:34.705 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:34.705 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:34.710 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2022-12-08 15:09:34.727 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202211 2022-12-08 15:09:34.730 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:34.731 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:34.733 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:34.789 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:34.791 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:09:34.798 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:34.821 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:09:35.822 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1089, sql=alter table `ob_hist_server` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:35.825 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:35.826 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:35.828 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2022-12-08 15:09:35.842 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202212 2022-12-08 15:09:35.845 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:35.845 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:35.849 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:36.499 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:36.499 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:36.502 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2022-12-08 15:09:36.522 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:36.522 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:36.526 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:36.540 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:36.540 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:36.544 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2022-12-08 15:09:36.560 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202209 2022-12-08 15:09:36.563 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:36.563 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:36.566 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:36.718 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:36.719 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:36.720 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:36.720 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:37.089 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:37.089 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:37.092 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2022-12-08 15:09:37.107 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202210 2022-12-08 15:09:37.110 INFO 42 --- [pool-ocp-schedules-8,,d6ba316e7456] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:09:37.110 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:37.111 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:37.115 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:37.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:09:37.592 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:37.593 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:37.596 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2022-12-08 15:09:37.607 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:09:37.604347+08:00, lastProcessTime=2022-12-08T15:09:27.600289+08:00 2022-12-08 15:09:37.615 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202211 2022-12-08 15:09:37.618 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:37.618 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:37.621 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:37.737 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:09:37.604347+08:00, resultsCount=0 2022-12-08 15:09:37.737 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:09:37.604347+08:00, resultsCount=0 2022-12-08 15:09:37.738 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:09:37.604347+08:00 2022-12-08 15:09:37.799 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:37.810 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:38.220 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:38.220 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:38.224 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2022-12-08 15:09:38.236 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202212 2022-12-08 15:09:38.240 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:38.240 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:38.243 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:38.714 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:09:38.783 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:38.813 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:38.813 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:38.826 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2022-12-08 15:09:38.847 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:38.848 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:38.852 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:38.862 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:38.862 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:38.865 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2022-12-08 15:09:38.889 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202209 2022-12-08 15:09:38.894 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:38.894 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:38.898 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:38.941 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:09:38.948 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:09:39.407 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:39.407 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:39.416 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2022-12-08 15:09:39.434 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202210 2022-12-08 15:09:39.440 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:39.440 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:39.446 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:39.573 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:09:39.754 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:09:39.769 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=15ms, period=120000ms 2022-12-08 15:09:39.779 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:39.779 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:40.046 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:40.047 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:40.050 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2022-12-08 15:09:40.069 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202211 2022-12-08 15:09:40.076 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:40.076 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:40.080 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:40.120 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:09:40.171 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:09:40.375 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:09:40.749 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:40.750 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:40.753 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2022-12-08 15:09:40.766 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202212 2022-12-08 15:09:40.769 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:40.769 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:40.772 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:40.811 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:40.816 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:41.454 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:41.455 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:41.458 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2022-12-08 15:09:41.477 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:41.477 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:41.488 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:41.494 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:41.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:41.497 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2022-12-08 15:09:41.516 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202209 2022-12-08 15:09:41.520 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:41.520 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:41.524 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:41.839 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:09:42.063 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:42.064 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:42.067 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2022-12-08 15:09:42.080 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202210 2022-12-08 15:09:42.093 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:42.094 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:42.097 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:42.722 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:42.722 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:42.726 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2022-12-08 15:09:42.747 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202211 2022-12-08 15:09:42.752 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:42.752 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:42.755 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:42.833 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:42.834 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:42.838 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:42.839 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:43.817 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:43.821 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:43.851 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1096, sql=alter table `ob_hist_row_lock` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:43.855 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:43.855 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:43.858 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2022-12-08 15:09:43.873 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202212 2022-12-08 15:09:43.877 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:43.877 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:43.880 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:44.319 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:44.464 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:44.464 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:44.467 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2022-12-08 15:09:44.480 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:44.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:44.484 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:44.488 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:44.489 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:44.491 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2022-12-08 15:09:44.509 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202209 2022-12-08 15:09:44.517 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:44.518 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:44.522 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:45.058 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:09:45.083 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:45.084 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:45.088 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2022-12-08 15:09:45.088 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:09:45.101 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202210 2022-12-08 15:09:45.104 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:45.104 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:45.107 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:45.436 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:09:45.442 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:09:45.738 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:45.738 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:45.741 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2022-12-08 15:09:45.755 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202211 2022-12-08 15:09:45.760 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:45.761 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:45.766 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:46.139 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:46.139 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:46.248 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:46.249 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:46.252 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2022-12-08 15:09:46.270 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202212 2022-12-08 15:09:46.273 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:46.273 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:46.278 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:46.541 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:09:46.701 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:46.702 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:46.711 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2022-12-08 15:09:46.730 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:46.731 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:46.734 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:46.739 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:46.740 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:46.744 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2022-12-08 15:09:46.763 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202209 2022-12-08 15:09:46.766 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:46.766 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:46.769 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:46.822 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:46.827 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:47.003 INFO 42 --- [pool-ocp-schedules-11,,4ce4e9c639d2] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:09:47.041 INFO 42 --- [pool-ocp-schedules-11,,4ce4e9c639d2] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:09:47.042 INFO 42 --- [pool-ocp-schedules-20,,62b5e0ce7755] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:09:47.042 INFO 42 --- [pool-ocp-schedules-20,,62b5e0ce7755] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:09:47.053 INFO 42 --- [pool-ocp-schedules-10,,463a306a9cd8] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:09:47.111 INFO 42 --- [pool-ocp-schedules-5,,05c98939c1fe] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:09:47.252 INFO 42 --- [pool-ocp-schedules-2,,22912547c652] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:09:47.444 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:47.444 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:47.447 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2022-12-08 15:09:47.462 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202210 2022-12-08 15:09:47.466 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:47.466 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:47.469 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:47.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:09:47.595 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:09:47.592266+08:00, lastProcessTime=2022-12-08T15:09:37.604347+08:00 2022-12-08 15:09:47.705 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:09:47.592266+08:00, resultsCount=0 2022-12-08 15:09:47.705 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:09:47.592266+08:00, resultsCount=0 2022-12-08 15:09:47.705 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:09:47.592266+08:00 2022-12-08 15:09:48.517 INFO 42 --- [pool-ocp-schedules-15,,7df3ffe2a4b0] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:09:48.617 INFO 42 --- [pool-ocp-schedules-18,,95b486d84ebe] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:09:48.617 INFO 42 --- [pool-ocp-schedules-6,,2a1c6df0a4b9] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:09:48.693 INFO 42 --- [pool-ocp-schedules-7,,efbbfafe7dfb] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:09:48.694 INFO 42 --- [pool-ocp-schedules-7,,efbbfafe7dfb] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:09:48.695 INFO 42 --- [pool-ocp-schedules-7,,efbbfafe7dfb] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:09:48.803 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1333, sql=alter table `ob_hist_cache` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:48.807 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:48.808 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:48.810 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2022-12-08 15:09:48.825 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202211 2022-12-08 15:09:48.829 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:48.829 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:48.832 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:48.836 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:49.256 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:49.256 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:49.257 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:49.257 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:49.446 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:49.446 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:49.450 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2022-12-08 15:09:49.467 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202212 2022-12-08 15:09:49.471 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:49.471 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:49.474 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:49.828 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:49.833 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:50.012 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:50.012 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:50.015 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2022-12-08 15:09:50.041 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:50.041 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:50.044 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:50.050 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:50.050 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:50.053 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2022-12-08 15:09:50.071 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202209 2022-12-08 15:09:50.075 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:50.075 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:50.079 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:50.510 INFO 42 --- [pool-ocp-schedules-12,,f98b7d5ab445] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:09:50.511 INFO 42 --- [pool-ocp-schedules-12,,f98b7d5ab445] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:09:50.607 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:50.607 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:50.611 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2022-12-08 15:09:50.623 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202210 2022-12-08 15:09:50.626 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:50.627 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:50.630 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:51.239 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:51.239 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:51.242 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2022-12-08 15:09:51.257 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202211 2022-12-08 15:09:51.261 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:51.262 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:51.264 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:51.698 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:09:51.704 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:09:51.880 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:09:51.887 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:51.887 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:51.890 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2022-12-08 15:09:51.902 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202212 2022-12-08 15:09:51.906 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:51.906 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:51.909 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:52.480 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:52.481 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:52.821 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:09:52.834 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:52.840 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:52.905 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:52.906 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:52.910 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2022-12-08 15:09:52.932 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:52.933 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:52.936 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:52.943 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:52.944 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:52.947 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2022-12-08 15:09:52.976 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202209 2022-12-08 15:09:52.983 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:52.984 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:52.987 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:53.509 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:53.509 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:53.519 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2022-12-08 15:09:53.544 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202210 2022-12-08 15:09:53.548 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:53.548 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:53.552 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:54.362 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:54.440 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:54.441 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:54.445 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2022-12-08 15:09:54.469 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202211 2022-12-08 15:09:54.475 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:54.475 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:54.479 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:55.103 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:55.104 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:55.108 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2022-12-08 15:09:55.120 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202212 2022-12-08 15:09:55.125 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:55.125 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:55.128 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:55.240 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:09:55.288 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:09:55.367 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:09:55.731 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:55.732 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:55.731 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:09:55.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:09:55.814 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:55.815 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:55.818 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2022-12-08 15:09:55.837 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:55.838 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:55.841 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:55.842 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:55.845 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:55.849 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:55.849 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:55.856 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2022-12-08 15:09:55.874 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202209 2022-12-08 15:09:55.878 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:55.878 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:55.882 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:56.382 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:56.382 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:56.385 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2022-12-08 15:09:56.402 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202210 2022-12-08 15:09:56.405 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:56.405 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:56.408 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:56.968 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:56.968 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:56.971 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2022-12-08 15:09:56.982 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202211 2022-12-08 15:09:56.985 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:56.986 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:56.988 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:09:57.113 INFO 42 --- [pool-ocp-schedules-3,,b27fa1c3471a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:09:57.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:09:57.606 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:09:57.603303+08:00, lastProcessTime=2022-12-08T15:09:47.592266+08:00 2022-12-08 15:09:57.755 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:57.755 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:57.761 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2022-12-08 15:09:57.775 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:09:57.603303+08:00, resultsCount=0 2022-12-08 15:09:57.775 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:09:57.603303+08:00, resultsCount=0 2022-12-08 15:09:57.775 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202212 2022-12-08 15:09:57.775 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:09:57.603303+08:00 2022-12-08 15:09:57.778 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:57.778 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:57.781 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:09:58.059 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:09:58.065 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:09:58.337 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:58.337 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:58.341 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2022-12-08 15:09:58.365 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:58.366 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:58.369 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:09:58.377 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:58.377 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:58.390 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2022-12-08 15:09:58.408 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202209 2022-12-08 15:09:58.412 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:58.413 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:58.416 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:09:58.821 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:58.821 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:09:58.846 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:09:58.850 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:09:58.913 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:09:59.085 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:59.086 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:59.098 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2022-12-08 15:09:59.117 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202210 2022-12-08 15:09:59.120 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:59.121 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:59.124 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:09:59.157 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:09:59.609 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:59.610 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:59.614 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2022-12-08 15:09:59.631 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202211 2022-12-08 15:09:59.634 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:09:59.635 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:09:59.647 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:10:00.130 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:00 CST 2022 2022-12-08 15:10:00.131 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=12, name=Refresh agent config, templateName=RefreshAgentConfigSchedule, scheduleRule=0 */10 * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:00.157 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Refresh agent config, nodeCount=1, taskCount=1 2022-12-08 15:10:00.158 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:00.158 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Refresh agent config, taskDefinitionId=12, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,6ab5e09a9b73] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483460, interval=60 2022-12-08 15:10:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,6ab5e09a9b73] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483400, count=0, elapsed=1668812916805 2022-12-08 15:10:00.208 INFO 42 --- [pool-prometheus-minute-schedule-1,,bc3f384397df] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483460, interval=60 2022-12-08 15:10:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,bc3f384397df] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483400, count=0, elapsed=1668812916809 2022-12-08 15:10:00.302 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:08:01.0, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:00 CST 2022 2022-12-08 15:10:00.303 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:08:01.0, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:00.329 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:10:00.367 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:00 CST 2022 2022-12-08 15:10:00.368 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=15, name=Sync system event, templateName=SyncSystemEventSchedule, scheduleRule=0 */10 * * * *, lastRunTime=null, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:00.398 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 68, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:00.408 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync system event 2022-12-08 15:10:00.480 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:00.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:00.485 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2022-12-08 15:10:00.498 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202212 2022-12-08 15:10:00.504 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:00.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:00.511 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:10:00.921 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=68, name=Refresh all agent config, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.RefreshAllAgentConfigTask, seriesId=0, startTime=2022-12-08T15:10:00.376+08:00, endTime=null} 2022-12-08 15:10:00.927 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:01.0, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:00 CST 2022 2022-12-08 15:10:00.928 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 15:05:01.0, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:00.950 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 15:10:00.950 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:00.951 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:01.197 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:01.0, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:01 CST 2022 2022-12-08 15:10:01.198 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:05:01.0, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:01.235 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 15:10:01.235 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 15:10:01.670 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:09:02.0, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:01 CST 2022 2022-12-08 15:10:01.671 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:09:02.0, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:01.693 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:10:01.694 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:01.694 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:01.794 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:09:02.0, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:01 CST 2022 2022-12-08 15:10:01.794 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:09:02.0, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:01.819 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:10:01.820 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:01.820 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:01.851 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:01.870 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:01.891 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:68, status:SUCCESS 2022-12-08 15:10:01.899 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:68, status:SUCCESS 2022-12-08 15:10:01.908 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:09:02.0, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:01 CST 2022 2022-12-08 15:10:01.909 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:09:02.0, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:01.936 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:10:01.937 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:01.937 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:01.979 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1468, sql=alter table `ob_hist_clog` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:10:01.979 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:10:01.983 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:01.983 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:01.986 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:01.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:01.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:01.987 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2022-12-08 15:10:01.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:02.003 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:02.004 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:02.008 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 69, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:02.009 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:10:02.022 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:02.022 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:02.034 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2022-12-08 15:10:02.039 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:09:30.0, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:02 CST 2022 2022-12-08 15:10:02.040 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:09:30.0, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:02.052 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202209 2022-12-08 15:10:02.055 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:02.056 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:02.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:10:02.070 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:10:02.071 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:02.071 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:02.123 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=69, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T15:10:01.994+08:00, endTime=null} 2022-12-08 15:10:02.153 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:05:02.0, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:02 CST 2022 2022-12-08 15:10:02.153 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:05:02.0, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:02.172 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 15:10:02.173 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:02.173 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:02.209 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 70, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:02.292 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:09:02.0, nextRun=2022-12-08 15:10:00.0, currentDate=Thu Dec 08 15:10:02 CST 2022 2022-12-08 15:10:02.293 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:09:02.0, nextRunTime=2022-12-08 15:10:00.0} 2022-12-08 15:10:02.310 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:10:02.311 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:02.311 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:02.320 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=70, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:10:02.191+08:00, endTime=null} 2022-12-08 15:10:02.415 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 71, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:02.554 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=71, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:10:02.395+08:00, endTime=null} 2022-12-08 15:10:02.558 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,866ef6842836] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=70, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=70, task_operation=execute, latest_execution_start_time=2022-12-08T15:10:02.190+08:00, sub_task_instance_id=70}, listMap={}}, executor=192.168.28.62 2022-12-08 15:10:02.637 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:02.637 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:02.640 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2022-12-08 15:10:02.656 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202210 2022-12-08 15:10:02.659 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:02.660 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:02.663 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:10:02.728 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,866ef6842836] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 70, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:10:03.561 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:03.561 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:03.564 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2022-12-08 15:10:03.582 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202211 2022-12-08 15:10:03.586 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:03.586 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:03.589 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:10:03.679 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:69, status:SUCCESS 2022-12-08 15:10:03.688 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:69, status:SUCCESS 2022-12-08 15:10:03.694 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 72, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:04.175 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=72, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:10:03.677+08:00, endTime=null} 2022-12-08 15:10:04.186 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:70, status:SUCCESS 2022-12-08 15:10:04.195 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:70, status:SUCCESS 2022-12-08 15:10:04.250 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 73, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:04.339 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:71, status:SUCCESS 2022-12-08 15:10:04.351 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:71, status:SUCCESS 2022-12-08 15:10:04.360 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=73, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:10:04.237+08:00, endTime=null} 2022-12-08 15:10:04.367 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:10:04.373 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:10:04.404 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:04.452 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 74, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:04.510 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=74, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T15:10:04.439+08:00, endTime=null} 2022-12-08 15:10:04.543 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,c76e4328615b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=73, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=73, task_operation=execute, latest_execution_start_time=2022-12-08T15:10:04.236+08:00, sub_task_instance_id=73}, listMap={}}, executor=192.168.28.62 2022-12-08 15:10:04.543 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,c76e4328615b] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:10:04.558 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,c76e4328615b] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:10:04.588 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 75, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:04.641 INFO 42 --- [pool-subtask-executor30,d267e73849fc4df0,c76e4328615b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 73, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:10:04.647 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=75, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:10:04.572+08:00, endTime=null} 2022-12-08 15:10:04.655 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1066, sql=alter table `ob_hist_location_cache` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:10:04.659 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:04.660 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:04.662 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2022-12-08 15:10:04.677 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202212 2022-12-08 15:10:04.680 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:04.681 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:04.685 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:10:04.871 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:04.886 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:05.057 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:05.093 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:05.213 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:05.214 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:05.217 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2022-12-08 15:10:05.240 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:05.240 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:05.244 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:10:05.257 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:05.258 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:05.265 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2022-12-08 15:10:05.287 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202209 2022-12-08 15:10:05.291 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:05.291 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:05.295 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:10:05.368 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:10:05.371 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:10:05.491 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:09:05.0, nextRun=2022-12-08 15:10:05.0, currentDate=Thu Dec 08 15:10:05 CST 2022 2022-12-08 15:10:05.492 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:09:05.0, nextRunTime=2022-12-08 15:10:05.0} 2022-12-08 15:10:05.497 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:10:05.510 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:10:05.511 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:05.511 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:05.723 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 76, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:05.785 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=76, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:10:05.711+08:00, endTime=null} 2022-12-08 15:10:05.834 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:72, status:SUCCESS 2022-12-08 15:10:05.840 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:72, status:SUCCESS 2022-12-08 15:10:05.950 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:73, status:SUCCESS 2022-12-08 15:10:05.972 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:73, status:SUCCESS 2022-12-08 15:10:06.028 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:06.029 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:06.031 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2022-12-08 15:10:06.041 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202210 2022-12-08 15:10:06.044 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:06.045 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:06.048 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:10:06.417 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:74, status:SUCCESS 2022-12-08 15:10:06.425 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:74, status:SUCCESS 2022-12-08 15:10:06.543 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:75, status:SUCCESS 2022-12-08 15:10:06.552 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:75, status:SUCCESS 2022-12-08 15:10:06.671 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:76, status:SUCCESS 2022-12-08 15:10:06.681 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:76, status:SUCCESS 2022-12-08 15:10:06.812 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:06.813 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:06.818 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2022-12-08 15:10:06.831 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202211 2022-12-08 15:10:06.834 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:06.834 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:06.837 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:10:07.114 INFO 42 --- [pool-ocp-schedules-8,,edc7aae0eefd] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:10:07.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:10:07.600 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:10:07.596583+08:00, lastProcessTime=2022-12-08T15:09:57.603303+08:00 2022-12-08 15:10:07.603 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:07.603 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:07.607 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2022-12-08 15:10:07.622 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202212 2022-12-08 15:10:07.625 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:07.626 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:07.629 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:10:07.752 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:10:07.596583+08:00, resultsCount=0 2022-12-08 15:10:07.753 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:10:07.596583+08:00, resultsCount=0 2022-12-08 15:10:07.753 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:10:07.596583+08:00 2022-12-08 15:10:07.887 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:07.892 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:08.126 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:08.127 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:08.190 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:08.191 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:08.432 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:08.432 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:08.435 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2022-12-08 15:10:08.455 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:08.456 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:08.464 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:10:08.469 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:08.469 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:08.472 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2022-12-08 15:10:08.489 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202209 2022-12-08 15:10:08.492 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:08.492 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:08.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202209 values less than (1664582400000000)) 2022-12-08 15:10:08.783 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:10:08.974 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:08.979 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:08.979 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:08.982 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2022-12-08 15:10:08.997 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202210 2022-12-08 15:10:09.001 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:09.001 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:09.004 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202210 values less than (1667260800000000)) 2022-12-08 15:10:09.463 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:09.463 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:09.467 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2022-12-08 15:10:09.483 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202211 2022-12-08 15:10:09.487 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:09.487 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:09.490 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202211 values less than (1669852800000000)) 2022-12-08 15:10:09.661 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:10:09.974 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:09.975 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:09.978 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2022-12-08 15:10:09.992 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202212 2022-12-08 15:10:09.995 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:09.996 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:09.999 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202212 values less than (1672531200000000)) 2022-12-08 15:10:10.428 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:10:10.456 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:10.456 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:10.460 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2022-12-08 15:10:10.481 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:10.481 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:10.484 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:10:10.491 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:10.491 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:10.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2022-12-08 15:10:10.532 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221123 2022-12-08 15:10:10.532 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:10:10.537 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:10.537 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:10.543 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221123 values less than (1669248000000000)) 2022-12-08 15:10:10.576 INFO 42 --- [pool-ocp-schedules-13,,aad59cc6b169] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:10:10.576 INFO 42 --- [pool-ocp-schedules-13,,aad59cc6b169] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:10:10.747 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:10:10.755 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:10:10.893 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:10.899 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:11.231 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:11.231 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:11.235 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:11.242 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:11.256 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221124 2022-12-08 15:10:11.265 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:11.265 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:11.268 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221124 values less than (1669334400000000)) 2022-12-08 15:10:11.282 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:11.349 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:10:11.939 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:11.940 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:11.943 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:11.957 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221125 2022-12-08 15:10:11.960 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:11.961 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:11.963 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221125 values less than (1669420800000000)) 2022-12-08 15:10:12.035 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:10:12.620 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:12.620 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:12.629 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:12.647 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221126 2022-12-08 15:10:12.651 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:12.651 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:12.654 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221126 values less than (1669507200000000)) 2022-12-08 15:10:13.409 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:13.409 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:13.415 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:13.431 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221127 2022-12-08 15:10:13.435 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:13.435 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:13.441 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221127 values less than (1669593600000000)) 2022-12-08 15:10:13.900 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:13.905 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:14.300 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:14.300 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:14.345 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:14.346 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:14.402 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:14.403 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:14.407 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:14.421 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221128 2022-12-08 15:10:14.425 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:14.425 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:14.427 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221128 values less than (1669680000000000)) 2022-12-08 15:10:14.484 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:15.042 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:15.042 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:15.045 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:15.060 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221129 2022-12-08 15:10:15.063 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:15.063 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:15.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221129 values less than (1669766400000000)) 2022-12-08 15:10:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,4708826bde8b] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:10:15.213 INFO 42 --- [pool-prometheus-cache-monitor1,,4708826bde8b] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:10:15.455 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:10:15.458 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:10:15.814 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:15.815 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:15.819 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:15.836 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221130 2022-12-08 15:10:15.840 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:15.841 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:15.844 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221130 values less than (1669852800000000)) 2022-12-08 15:10:16.429 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:16.430 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:16.433 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:16.474 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221201 2022-12-08 15:10:16.480 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:16.480 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:16.483 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:10:16.626 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:10:16.631 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:10:16.905 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:16.910 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:17.115 INFO 42 --- [pool-ocp-schedules-13,,899995f7cb70] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:10:17.131 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:17.131 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:17.138 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:17.151 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221202 2022-12-08 15:10:17.154 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:17.154 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:17.157 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:10:17.463 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:17.469 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:17.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:10:17.599 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:10:17.595850+08:00, lastProcessTime=2022-12-08T15:10:07.596583+08:00 2022-12-08 15:10:17.726 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:10:17.595850+08:00, resultsCount=0 2022-12-08 15:10:17.726 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:10:17.595850+08:00, resultsCount=0 2022-12-08 15:10:17.727 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:10:17.595850+08:00 2022-12-08 15:10:17.755 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:10:17.811 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:06:17.679, end=2022-12-08T15:08:17.679} 2022-12-08 15:10:17.833 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:10:18.095 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:18.096 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:18.099 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:18.114 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221203 2022-12-08 15:10:18.118 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:18.118 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:18.130 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:10:19.086 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:19.168 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1038, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:10:19.171 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:19.171 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:19.178 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:19.191 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221204 2022-12-08 15:10:19.194 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:19.194 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:19.197 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:10:19.910 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:19.919 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:20.130 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:20.130 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:20.135 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:20.154 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221205 2022-12-08 15:10:20.157 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:20.157 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:20.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:10:20.562 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:20.563 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:20.562 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:20.564 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:20.821 INFO 42 --- [pool-task-coordinator2,,] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:09:21.0, nextRun=2022-12-08 15:10:20.0, currentDate=Thu Dec 08 15:10:20 CST 2022 2022-12-08 15:10:20.823 INFO 42 --- [pool-task-coordinator2,,] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:09:21.0, nextRunTime=2022-12-08 15:10:20.0} 2022-12-08 15:10:20.842 INFO 42 --- [pool-task-coordinator2,,] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:10:20.843 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:20.843 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:20.904 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:20.905 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:20.908 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:20.919 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221206 2022-12-08 15:10:20.923 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:20.923 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:20.926 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:10:21.104 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 77, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:21.128 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=77, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:10:21.089+08:00, endTime=null} 2022-12-08 15:10:21.472 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:21.472 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:21.476 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:21.492 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221207 2022-12-08 15:10:21.496 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:21.496 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:21.501 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:10:22.044 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:77, status:SUCCESS 2022-12-08 15:10:22.054 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:77, status:SUCCESS 2022-12-08 15:10:22.068 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:10:22.185 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:22.185 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:22.188 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:22.205 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221208 2022-12-08 15:10:22.208 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:22.209 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:22.212 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:10:22.805 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:22.806 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:22.809 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:22.822 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221209 2022-12-08 15:10:22.825 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:22.825 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:22.828 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:10:22.920 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:22.924 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:23.104 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:10:23.110 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:10:23.644 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:23.644 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:23.650 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:23.669 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221210 2022-12-08 15:10:23.673 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:23.674 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:23.678 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:10:23.698 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:23.699 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:24.236 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:10:24.400 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:24.401 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:24.412 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:24.429 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221211 2022-12-08 15:10:24.434 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:24.435 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:24.438 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:10:24.535 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:25.007 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:09:25.0, nextRun=2022-12-08 15:10:25.0, currentDate=Thu Dec 08 15:10:25 CST 2022 2022-12-08 15:10:25.008 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:09:25.0, nextRunTime=2022-12-08 15:10:25.0} 2022-12-08 15:10:25.059 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:10:25.060 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:25.060 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:25.102 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:25.103 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:25.105 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:25.117 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221212 2022-12-08 15:10:25.121 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:25.121 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:25.124 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:10:25.256 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 78, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:25.304 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=78, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:10:25.241+08:00, endTime=null} 2022-12-08 15:10:25.501 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:10:25.534 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:10:25.577 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:10:25.925 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:25.930 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:25.955 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:25.955 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:25.959 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:25.972 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221213 2022-12-08 15:10:25.977 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:25.977 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:25.981 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:10:26.770 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:26.770 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:26.771 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:26.771 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:26.977 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:78, status:SUCCESS 2022-12-08 15:10:26.997 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:78, status:SUCCESS 2022-12-08 15:10:27.116 INFO 42 --- [pool-ocp-schedules-13,,06fe53081dc7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:10:27.158 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1177, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:10:27.162 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:27.162 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:27.165 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:27.182 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221214 2022-12-08 15:10:27.185 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:27.186 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:27.189 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:10:27.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:10:27.599 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:10:27.595401+08:00, lastProcessTime=2022-12-08T15:10:17.595850+08:00 2022-12-08 15:10:27.722 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:10:27.595401+08:00, resultsCount=0 2022-12-08 15:10:27.722 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:10:27.595401+08:00, resultsCount=0 2022-12-08 15:10:27.722 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:10:27.595401+08:00 2022-12-08 15:10:27.780 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:27.780 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:27.784 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:27.799 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20221215 2022-12-08 15:10:27.804 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:27.804 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:27.808 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:10:28.931 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:28.950 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:29.152 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:29.193 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1385, sql=alter table `ob_hist_sql_plan_monitor` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:10:29.198 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:29.198 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:29.201 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2022-12-08 15:10:29.218 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:29.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:29.221 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:10:29.227 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:29.228 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:29.231 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_0 2022-12-08 15:10:29.271 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221201 2022-12-08 15:10:29.275 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:29.275 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:29.282 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221201 values less than (1669939200000000)) 2022-12-08 15:10:29.441 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:10:29.447 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:10:29.867 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:29.869 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:29.993 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:29.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:29.998 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:30.014 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221202 2022-12-08 15:10:30.020 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:30.020 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:30.024 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:10:30.032 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:10:30.630 INFO 42 --- [pool-ocp-schedules-10,,c6bfcd4f34ce] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:10:30.630 INFO 42 --- [pool-ocp-schedules-10,,c6bfcd4f34ce] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:10:30.996 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:09:30.0, nextRun=2022-12-08 15:10:30.0, currentDate=Thu Dec 08 15:10:30 CST 2022 2022-12-08 15:10:30.997 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:09:30.0, nextRunTime=2022-12-08 15:10:30.0} 2022-12-08 15:10:31.024 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:10:31.163 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:02.0, nextRun=2022-12-08 15:10:30.0, currentDate=Thu Dec 08 15:10:31 CST 2022 2022-12-08 15:10:31.163 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:10:02.0, nextRunTime=2022-12-08 15:10:30.0} 2022-12-08 15:10:31.180 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:10:31.180 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:10:31.181 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:10:31.455 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 79, operation:EXECUTE, state: RUNNING 2022-12-08 15:10:31.469 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1445, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221202 values less than (1670025600000000)) 2022-12-08 15:10:31.472 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:31.473 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:31.476 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:31.496 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221203 2022-12-08 15:10:31.500 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:31.500 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:31.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:10:31.536 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=79, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:10:31.438+08:00, endTime=null} 2022-12-08 15:10:31.951 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:31.956 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:32.138 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:10:32.179 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:79, status:SUCCESS 2022-12-08 15:10:32.186 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:79, status:SUCCESS 2022-12-08 15:10:32.936 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:32.936 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:32.940 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:32.940 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:33.489 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1985, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221203 values less than (1670112000000000)) 2022-12-08 15:10:33.493 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:33.493 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:33.497 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:33.511 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221204 2022-12-08 15:10:33.515 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:33.515 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:33.518 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221204 values less than (1670198400000000)) 2022-12-08 15:10:34.350 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:34.350 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:34.354 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:34.370 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221205 2022-12-08 15:10:34.373 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:34.374 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:34.377 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221205 values less than (1670284800000000)) 2022-12-08 15:10:34.626 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:34.956 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:34.961 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:35.273 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:35.274 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:35.277 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:35.293 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221206 2022-12-08 15:10:35.303 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:35.304 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:35.308 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221206 values less than (1670371200000000)) 2022-12-08 15:10:35.572 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:10:35.671 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:10:35.740 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:10:35.749 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:10:36.108 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:36.108 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:36.250 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:36.251 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:36.253 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:36.266 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221207 2022-12-08 15:10:36.269 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:36.270 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:36.272 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221207 values less than (1670457600000000)) 2022-12-08 15:10:36.382 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:10:37.079 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:37.079 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:37.082 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:37.097 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221208 2022-12-08 15:10:37.100 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:37.100 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:37.113 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221208 values less than (1670544000000000)) 2022-12-08 15:10:37.117 INFO 42 --- [pool-ocp-schedules-18,,53fc16bfa964] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:10:37.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:10:37.604 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:10:37.600381+08:00, lastProcessTime=2022-12-08T15:10:27.595401+08:00 2022-12-08 15:10:37.709 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:10:37.600381+08:00, resultsCount=0 2022-12-08 15:10:37.709 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:10:37.600381+08:00, resultsCount=0 2022-12-08 15:10:37.710 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:10:37.600381+08:00 2022-12-08 15:10:37.890 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:37.891 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:37.894 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:37.905 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221209 2022-12-08 15:10:37.909 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:37.909 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:37.915 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:10:37.961 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:37.966 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:38.816 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:10:39.014 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1099, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221209 values less than (1670630400000000)) 2022-12-08 15:10:39.018 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:39.018 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:39.022 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:39.047 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221210 2022-12-08 15:10:39.051 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:39.051 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:39.054 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221210 values less than (1670716800000000)) 2022-12-08 15:10:39.207 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:39.340 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:39.340 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:39.376 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:39.376 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:39.731 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:10:39.986 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:39.987 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:39.990 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:40.006 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221211 2022-12-08 15:10:40.010 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:40.010 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:40.013 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221211 values less than (1670803200000000)) 2022-12-08 15:10:40.533 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:10:40.667 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:10:40.857 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:40.858 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:40.861 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:40.880 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221212 2022-12-08 15:10:40.886 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:40.886 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:40.890 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:10:40.967 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:40.971 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:41.725 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:10:41.746 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:10:42.088 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1198, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221212 values less than (1670889600000000)) 2022-12-08 15:10:42.091 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:42.091 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:42.094 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:42.109 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221213 2022-12-08 15:10:42.112 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:42.113 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:42.116 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:10:42.258 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:10:42.430 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:42.461 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:42.904 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:10:43.485 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1369, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221213 values less than (1670976000000000)) 2022-12-08 15:10:43.491 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:43.491 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:43.494 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:43.511 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221214 2022-12-08 15:10:43.515 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:43.515 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:43.518 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:10:43.972 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:43.976 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:44.677 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:44.962 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1444, sql=alter table `ob_hist_trans_stat_0` add partition(partition P20221214 values less than (1671062400000000)) 2022-12-08 15:10:44.966 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:44.966 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:44.969 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:44.981 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221215 2022-12-08 15:10:44.985 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:44.985 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:44.988 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221215 values less than (1671148800000000)) 2022-12-08 15:10:45.502 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:45.502 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:45.537 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:45.538 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:45.700 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:10:45.760 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:10:45.866 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:45.866 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:45.872 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:45.906 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_0, partition=P20221216 2022-12-08 15:10:45.910 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:45.910 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:45.915 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_0` add partition(partition P20221216 values less than (1671235200000000)) 2022-12-08 15:10:46.808 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:10:46.808 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:10:46.811 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_0' and table_type='BASE TABLE' 2022-12-08 15:10:46.826 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2022-12-08 15:10:46.977 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:46.981 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:47.003 INFO 42 --- [pool-ocp-schedules-12,,faa400bef7b5] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:10:47.033 INFO 42 --- [pool-ocp-schedules-12,,faa400bef7b5] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:10:47.054 INFO 42 --- [pool-ocp-schedules-10,,beb170b35ad9] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:10:47.118 INFO 42 --- [pool-ocp-schedules-11,,29a29ec6b804] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:10:47.271 INFO 42 --- [pool-ocp-schedules-16,,48de78beb7f8] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:10:47.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:10:47.602 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:10:47.599060+08:00, lastProcessTime=2022-12-08T15:10:37.600381+08:00 2022-12-08 15:10:47.718 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:10:47.599060+08:00, resultsCount=0 2022-12-08 15:10:47.718 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:10:47.599060+08:00, resultsCount=0 2022-12-08 15:10:47.718 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:10:47.599060+08:00 2022-12-08 15:10:48.186 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:10:48.191 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:10:48.559 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:48.602 INFO 42 --- [pool-ocp-schedules-16,,08d294d6dc46] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:10:48.604 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:48.720 INFO 42 --- [pool-ocp-schedules-1,,27f050684cdb] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:10:48.724 INFO 42 --- [pool-ocp-schedules-20,,d0024a96eaf8] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:10:48.825 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:10:48.836 INFO 42 --- [pool-ocp-schedules-14,,a14cde1319a4] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:10:48.836 INFO 42 --- [pool-ocp-schedules-14,,a14cde1319a4] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:10:48.836 INFO 42 --- [pool-ocp-schedules-14,,a14cde1319a4] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:10:49.245 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:49.982 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:49.991 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:50.681 INFO 42 --- [pool-ocp-schedules-16,,f9ed8fcb8709] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:10:50.682 INFO 42 --- [pool-ocp-schedules-16,,f9ed8fcb8709] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:10:51.636 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:51.637 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:51.704 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:51.704 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:52.431 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:10:52.992 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:52.997 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:53.967 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:10:53.972 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:10:54.695 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:54.759 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:10:54.802 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:10:55.059 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:10:55.736 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:10:55.902 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:10:55.945 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:10:55.999 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:56.003 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:57.119 INFO 42 --- [pool-ocp-schedules-6,,8388479913f4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:10:57.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:10:57.602 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:10:57.599951+08:00, lastProcessTime=2022-12-08T15:10:47.599060+08:00 2022-12-08 15:10:57.718 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:10:57.599951+08:00, resultsCount=0 2022-12-08 15:10:57.719 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:10:57.599951+08:00, resultsCount=0 2022-12-08 15:10:57.721 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:10:57.599951+08:00 2022-12-08 15:10:57.746 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:57.746 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:58.000 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:10:58.000 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:10:59.004 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:10:59.010 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:10:59.279 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:00.205 INFO 42 --- [pool-prometheus-minute-schedule-1,,0b2c2e451072] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483520, interval=60 2022-12-08 15:11:00.206 INFO 42 --- [pool-prometheus-minute-schedule-1,,0b2c2e451072] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483460, count=0, elapsed=1668812976746 2022-12-08 15:11:00.208 INFO 42 --- [pool-prometheus-minute-schedule-2,,901207c7b8c3] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483520, interval=60 2022-12-08 15:11:00.209 INFO 42 --- [pool-prometheus-minute-schedule-2,,901207c7b8c3] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483460, count=0, elapsed=1668812976749 2022-12-08 15:11:00.848 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:11:00.853 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:11:00.949 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:02.0, nextRun=2022-12-08 15:11:00.0, currentDate=Thu Dec 08 15:11:00 CST 2022 2022-12-08 15:11:00.950 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:10:02.0, nextRunTime=2022-12-08 15:11:00.0} 2022-12-08 15:11:00.970 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:11:00.971 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:11:00.971 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:11:01.026 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:02.0, nextRun=2022-12-08 15:11:00.0, currentDate=Thu Dec 08 15:11:01 CST 2022 2022-12-08 15:11:01.027 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:10:02.0, nextRunTime=2022-12-08 15:11:00.0} 2022-12-08 15:11:01.053 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:11:01.054 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:11:01.054 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:11:01.133 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:02.0, nextRun=2022-12-08 15:11:00.0, currentDate=Thu Dec 08 15:11:01 CST 2022 2022-12-08 15:11:01.134 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:10:02.0, nextRunTime=2022-12-08 15:11:00.0} 2022-12-08 15:11:01.171 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:11:01.172 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:11:01.172 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:11:01.223 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:31.0, nextRun=2022-12-08 15:11:00.0, currentDate=Thu Dec 08 15:11:01 CST 2022 2022-12-08 15:11:01.224 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:10:31.0, nextRunTime=2022-12-08 15:11:00.0} 2022-12-08 15:11:01.240 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:11:01.240 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:11:01.241 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:11:01.250 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:01.324 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:02.0, nextRun=2022-12-08 15:11:00.0, currentDate=Thu Dec 08 15:11:01 CST 2022 2022-12-08 15:11:01.325 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:10:02.0, nextRunTime=2022-12-08 15:11:00.0} 2022-12-08 15:11:01.341 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:11:01.342 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:11:01.342 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:11:01.989 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 80, operation:EXECUTE, state: RUNNING 2022-12-08 15:11:02.011 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:02.016 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:02.253 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=80, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:11:01.976+08:00, endTime=null} 2022-12-08 15:11:02.335 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 81, operation:EXECUTE, state: RUNNING 2022-12-08 15:11:02.374 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=81, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:11:02.316+08:00, endTime=null} 2022-12-08 15:11:02.460 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 82, operation:EXECUTE, state: RUNNING 2022-12-08 15:11:02.512 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=82, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:11:02.445+08:00, endTime=null} 2022-12-08 15:11:02.579 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 83, operation:EXECUTE, state: RUNNING 2022-12-08 15:11:02.618 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=83, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:11:02.568+08:00, endTime=null} 2022-12-08 15:11:02.646 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:11:02.691 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 84, operation:EXECUTE, state: RUNNING 2022-12-08 15:11:02.714 INFO 42 --- [pool-subtask-executor30,f66f560e2d9d4b5c,fdab67b86559] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=82, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=82, task_operation=execute, latest_execution_start_time=2022-12-08T15:11:02.444+08:00, sub_task_instance_id=82}, listMap={}}, executor=192.168.28.62 2022-12-08 15:11:02.729 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=84, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:11:02.678+08:00, endTime=null} 2022-12-08 15:11:03.025 INFO 42 --- [pool-subtask-executor30,f66f560e2d9d4b5c,fdab67b86559] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 82, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:11:03.635 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:80, status:SUCCESS 2022-12-08 15:11:03.642 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:80, status:SUCCESS 2022-12-08 15:11:03.732 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:81, status:SUCCESS 2022-12-08 15:11:03.738 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:81, status:SUCCESS 2022-12-08 15:11:03.830 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:82, status:SUCCESS 2022-12-08 15:11:03.837 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:82, status:SUCCESS 2022-12-08 15:11:03.940 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:83, status:SUCCESS 2022-12-08 15:11:03.949 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:83, status:SUCCESS 2022-12-08 15:11:04.034 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:84, status:SUCCESS 2022-12-08 15:11:04.039 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:84, status:SUCCESS 2022-12-08 15:11:04.988 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:05.017 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:05.024 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:05.437 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:05.0, nextRun=2022-12-08 15:11:05.0, currentDate=Thu Dec 08 15:11:05 CST 2022 2022-12-08 15:11:05.438 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:10:05.0, nextRunTime=2022-12-08 15:11:05.0} 2022-12-08 15:11:05.459 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:11:05.462 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:11:05.462 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:11:05.843 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 85, operation:EXECUTE, state: RUNNING 2022-12-08 15:11:05.935 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:11:05.980 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=85, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:11:05.830+08:00, endTime=null} 2022-12-08 15:11:05.983 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:11:06.504 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:85, status:SUCCESS 2022-12-08 15:11:06.511 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:85, status:SUCCESS 2022-12-08 15:11:07.121 INFO 42 --- [pool-ocp-schedules-3,,1d00ca33c2ba] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:11:07.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:11:07.600 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:11:07.595538+08:00, lastProcessTime=2022-12-08T15:10:57.599951+08:00 2022-12-08 15:11:07.918 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:11:07.595538+08:00, resultsCount=0 2022-12-08 15:11:07.919 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:11:07.595538+08:00, resultsCount=0 2022-12-08 15:11:07.919 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:11:07.595538+08:00 2022-12-08 15:11:08.025 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:08.029 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:08.855 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:11:09.451 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:09.808 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:11:10.565 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:11:10.741 INFO 42 --- [pool-ocp-schedules-15,,60f3fd548380] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:11:10.742 INFO 42 --- [pool-ocp-schedules-15,,60f3fd548380] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:11:10.797 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:11:11.030 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:11.035 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:11.065 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:11:12.684 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:11:14.036 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:14.041 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:15.049 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,061f0ce2fd59] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:11:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,061f0ce2fd59] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:11:16.023 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:11:16.042 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:11:16.204 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:11:16.209 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:11:16.277 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:16.683 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:16.802 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:11:17.042 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:17.047 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:17.122 INFO 42 --- [pool-ocp-schedules-3,,e765da5bcd0a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:11:17.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:11:17.597 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:11:17.593061+08:00, lastProcessTime=2022-12-08T15:11:07.595538+08:00 2022-12-08 15:11:17.725 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:11:17.593061+08:00, resultsCount=0 2022-12-08 15:11:17.726 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:11:17.593061+08:00, resultsCount=0 2022-12-08 15:11:17.726 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:11:17.593061+08:00 2022-12-08 15:11:19.337 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:19.338 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:19.516 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:19.796 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:19.796 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:20.048 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:20.052 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:20.828 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:21.0, nextRun=2022-12-08 15:11:20.0, currentDate=Thu Dec 08 15:11:20 CST 2022 2022-12-08 15:11:20.829 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:10:21.0, nextRunTime=2022-12-08 15:11:20.0} 2022-12-08 15:11:20.848 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:11:20.849 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:11:20.849 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:11:21.219 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 86, operation:EXECUTE, state: RUNNING 2022-12-08 15:11:21.308 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=86, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:11:21.204+08:00, endTime=null} 2022-12-08 15:11:22.058 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:11:22.065 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:11:22.198 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:86, status:SUCCESS 2022-12-08 15:11:22.205 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:86, status:SUCCESS 2022-12-08 15:11:22.427 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:22.824 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:11:22.904 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:23.053 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:23.058 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:23.159 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:11:25.282 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:25.488 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:25.489 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:25.848 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:11:25.972 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:25.972 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:26.059 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:26.065 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:26.076 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:25.0, nextRun=2022-12-08 15:11:25.0, currentDate=Thu Dec 08 15:11:26 CST 2022 2022-12-08 15:11:26.077 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:10:25.0, nextRunTime=2022-12-08 15:11:25.0} 2022-12-08 15:11:26.092 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:11:26.126 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:11:26.127 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:11:26.128 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:11:26.128 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:11:26.487 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 87, operation:EXECUTE, state: RUNNING 2022-12-08 15:11:26.522 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=87, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:11:26.453+08:00, endTime=null} 2022-12-08 15:11:27.123 INFO 42 --- [pool-ocp-schedules-19,,b26ae05ef956] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:11:27.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:11:27.592 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:11:27.590298+08:00, lastProcessTime=2022-12-08T15:11:17.593061+08:00 2022-12-08 15:11:27.691 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:11:27.590298+08:00, resultsCount=0 2022-12-08 15:11:27.692 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:11:27.590298+08:00, resultsCount=0 2022-12-08 15:11:27.692 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:11:27.590298+08:00 2022-12-08 15:11:27.867 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:87, status:SUCCESS 2022-12-08 15:11:27.873 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:87, status:SUCCESS 2022-12-08 15:11:28.332 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:11:28.338 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:11:28.545 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:29.030 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:29.065 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:29.070 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:29.420 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:11:29.573 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:30.069 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:31.0, nextRun=2022-12-08 15:11:30.0, currentDate=Thu Dec 08 15:11:30 CST 2022 2022-12-08 15:11:30.070 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:10:31.0, nextRunTime=2022-12-08 15:11:30.0} 2022-12-08 15:11:30.099 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:11:30.174 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:11:01.0, nextRun=2022-12-08 15:11:30.0, currentDate=Thu Dec 08 15:11:30 CST 2022 2022-12-08 15:11:30.175 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:11:01.0, nextRunTime=2022-12-08 15:11:30.0} 2022-12-08 15:11:30.192 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:11:30.192 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:11:30.192 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:11:30.632 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 88, operation:EXECUTE, state: RUNNING 2022-12-08 15:11:30.687 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=88, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:11:30.619+08:00, endTime=null} 2022-12-08 15:11:30.855 INFO 42 --- [pool-ocp-schedules-6,,4cb6792202e0] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:11:30.856 INFO 42 --- [pool-ocp-schedules-6,,4cb6792202e0] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:11:31.557 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:88, status:SUCCESS 2022-12-08 15:11:31.564 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:88, status:SUCCESS 2022-12-08 15:11:31.633 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:31.633 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:32.070 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:32.076 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:32.110 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:32.110 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:32.860 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:11:34.599 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:11:34.604 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:11:34.719 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:35.077 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:35.082 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:35.203 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:35.316 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:35.692 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:11:36.215 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:11:36.219 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:11:37.125 INFO 42 --- [pool-ocp-schedules-14,,c943925a17af] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:11:37.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:11:37.604 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:11:37.601738+08:00, lastProcessTime=2022-12-08T15:11:27.590298+08:00 2022-12-08 15:11:37.713 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:11:37.601738+08:00, resultsCount=0 2022-12-08 15:11:37.714 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:11:37.601738+08:00, resultsCount=0 2022-12-08 15:11:37.714 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:11:37.601738+08:00 2022-12-08 15:11:37.767 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:37.768 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:38.083 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:38.087 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:38.293 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:38.293 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:38.922 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:11:39.612 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:11:39.619 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:39.631 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=19ms, period=120000ms 2022-12-08 15:11:39.837 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:11:40.630 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:11:40.883 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:11:40.893 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:11:40.895 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:11:41.088 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:41.093 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:41.349 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:42.941 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:11:43.905 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:44.094 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:44.099 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:44.180 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:11:44.404 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:44.404 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:45.405 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:46.241 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:11:46.259 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:11:46.991 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:46.991 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:47.004 INFO 42 --- [pool-ocp-schedules-13,,756f23b587fb] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:11:47.040 INFO 42 --- [pool-ocp-schedules-13,,756f23b587fb] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:11:47.043 INFO 42 --- [pool-ocp-schedules-1,,fa5f1d260ef6] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:11:47.044 INFO 42 --- [pool-ocp-schedules-1,,fa5f1d260ef6] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:11:47.055 INFO 42 --- [pool-ocp-schedules-20,,3c93a8ffe12e] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:11:47.100 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:47.104 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:47.126 INFO 42 --- [pool-ocp-schedules-12,,012381724080] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:11:47.276 INFO 42 --- [pool-ocp-schedules-8,,19f41a50fffa] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:11:47.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:11:47.621 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:11:47.616739+08:00, lastProcessTime=2022-12-08T15:11:37.601738+08:00 2022-12-08 15:11:47.798 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:11:47.616739+08:00, resultsCount=0 2022-12-08 15:11:47.799 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:11:47.616739+08:00, resultsCount=0 2022-12-08 15:11:47.799 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:11:47.616739+08:00 2022-12-08 15:11:48.647 INFO 42 --- [pool-ocp-schedules-17,,c9a32d39f6c0] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:11:48.790 INFO 42 --- [pool-ocp-schedules-14,,3d4b291764ee] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:11:48.830 INFO 42 --- [pool-ocp-schedules-18,,130b61e48802] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:11:48.932 INFO 42 --- [pool-ocp-schedules-18,,1b3eb252b30a] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:11:48.933 INFO 42 --- [pool-ocp-schedules-18,,1b3eb252b30a] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:11:48.933 INFO 42 --- [pool-ocp-schedules-18,,1b3eb252b30a] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:11:49.344 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:11:49.350 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:11:49.658 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:50.058 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:50.105 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:50.110 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:50.729 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:51.132 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:11:51.155 INFO 42 --- [pool-ocp-schedules-14,,a13e8af5c413] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:11:51.156 INFO 42 --- [pool-ocp-schedules-14,,a13e8af5c413] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:11:52.982 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:11:53.111 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:53.115 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:53.123 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:53.123 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:54.133 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:11:54.134 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:11:55.434 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:11:56.111 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:11:56.116 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:56.119 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:56.298 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:11:56.325 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:11:56.360 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:11:56.366 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:11:57.127 INFO 42 --- [pool-ocp-schedules-2,,7cbb3d1a2bd1] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:11:57.182 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:57.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:11:57.602 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:11:57.598120+08:00, lastProcessTime=2022-12-08T15:11:47.616739+08:00 2022-12-08 15:11:57.742 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:11:57.598120+08:00, resultsCount=0 2022-12-08 15:11:57.742 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:11:57.598120+08:00, resultsCount=0 2022-12-08 15:11:57.743 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:11:57.598120+08:00 2022-12-08 15:11:59.120 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:11:59.125 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:11:59.280 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:11:59.512 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:11:59.682 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:00.001 INFO 42 --- [pool-ocp-schedules-11,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:12:00.010 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:11:01.0, nextRun=2022-12-08 15:12:00.0, currentDate=Thu Dec 08 15:12:00 CST 2022 2022-12-08 15:12:00.011 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:11:01.0, nextRunTime=2022-12-08 15:12:00.0} 2022-12-08 15:12:00.038 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:12:00.039 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:12:00.039 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:12:00.110 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:11:01.0, nextRun=2022-12-08 15:12:00.0, currentDate=Thu Dec 08 15:12:00 CST 2022 2022-12-08 15:12:00.111 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:11:01.0, nextRunTime=2022-12-08 15:12:00.0} 2022-12-08 15:12:00.140 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:12:00.141 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:12:00.141 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:12:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,0226526cbb58] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483580, interval=60 2022-12-08 15:12:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,0226526cbb58] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483520, count=0, elapsed=1668813036685 2022-12-08 15:12:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,0e93a85125ff] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483580, interval=60 2022-12-08 15:12:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,0e93a85125ff] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483520, count=0, elapsed=1668813036689 2022-12-08 15:12:00.214 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:11:01.0, nextRun=2022-12-08 15:12:00.0, currentDate=Thu Dec 08 15:12:00 CST 2022 2022-12-08 15:12:00.215 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:11:01.0, nextRunTime=2022-12-08 15:12:00.0} 2022-12-08 15:12:00.243 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:00.244 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:00.255 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:12:00.256 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:12:00.256 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:12:00.341 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:11:30.0, nextRun=2022-12-08 15:12:00.0, currentDate=Thu Dec 08 15:12:00 CST 2022 2022-12-08 15:12:00.342 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:11:30.0, nextRunTime=2022-12-08 15:12:00.0} 2022-12-08 15:12:00.357 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:12:00.358 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:12:00.358 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:12:00.447 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:11:01.0, nextRun=2022-12-08 15:12:00.0, currentDate=Thu Dec 08 15:12:00 CST 2022 2022-12-08 15:12:00.448 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:11:01.0, nextRunTime=2022-12-08 15:12:00.0} 2022-12-08 15:12:00.471 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:12:00.473 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:12:00.473 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:12:01.093 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 89, operation:EXECUTE, state: RUNNING 2022-12-08 15:12:01.127 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=89, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:12:01.071+08:00, endTime=null} 2022-12-08 15:12:01.204 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 90, operation:EXECUTE, state: RUNNING 2022-12-08 15:12:01.274 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=90, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:12:01.192+08:00, endTime=null} 2022-12-08 15:12:01.352 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 91, operation:EXECUTE, state: RUNNING 2022-12-08 15:12:01.422 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=91, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:12:01.329+08:00, endTime=null} 2022-12-08 15:12:01.462 INFO 42 --- [pool-subtask-executor30,f66f560e2d9d4b5c,f10cb93bc1ee] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=90, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=90, task_operation=execute, latest_execution_start_time=2022-12-08T15:12:01.190+08:00, sub_task_instance_id=90}, listMap={}}, executor=192.168.28.62 2022-12-08 15:12:01.487 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 92, operation:EXECUTE, state: RUNNING 2022-12-08 15:12:01.511 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=92, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:12:01.475+08:00, endTime=null} 2022-12-08 15:12:01.521 INFO 42 --- [pool-subtask-executor30,f66f560e2d9d4b5c,f10cb93bc1ee] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 90, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:12:01.581 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 93, operation:EXECUTE, state: RUNNING 2022-12-08 15:12:01.633 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=93, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:12:01.566+08:00, endTime=null} 2022-12-08 15:12:01.753 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:00.0, nextRun=2022-12-08 15:12:00.0, currentDate=Thu Dec 08 15:12:01 CST 2022 2022-12-08 15:12:01.753 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:10:00.0, nextRunTime=2022-12-08 15:12:00.0} 2022-12-08 15:12:01.785 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:12:02.126 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:02.131 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:02.457 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:02.458 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:02.483 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:89, status:SUCCESS 2022-12-08 15:12:02.491 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:89, status:SUCCESS 2022-12-08 15:12:02.680 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:90, status:SUCCESS 2022-12-08 15:12:02.687 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:90, status:SUCCESS 2022-12-08 15:12:02.849 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:91, status:SUCCESS 2022-12-08 15:12:02.859 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:91, status:SUCCESS 2022-12-08 15:12:03.109 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:12:03.134 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:92, status:SUCCESS 2022-12-08 15:12:03.140 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:92, status:SUCCESS 2022-12-08 15:12:03.453 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:93, status:SUCCESS 2022-12-08 15:12:03.459 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:93, status:SUCCESS 2022-12-08 15:12:04.690 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:12:04.698 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:12:04.868 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 15:12:04.0, currentDate=Thu Dec 08 15:12:04 CST 2022 2022-12-08 15:12:04.869 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1, name=Partitioning daemon, templateName=PartitioningDaemonSchedule, scheduleRule=4 12 */1 * * *, lastRunTime=null, nextRunTime=2022-12-08 15:12:04.0} 2022-12-08 15:12:04.886 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Partition rollover daemon, nodeCount=1, taskCount=1 2022-12-08 15:12:04.887 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:12:04.887 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Partition rollover daemon, taskDefinitionId=1, state=RUNNING, operation=EXECUTE} 2022-12-08 15:12:05.132 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:05.137 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:05.502 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:05.588 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:05.776 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 94, operation:EXECUTE, state: RUNNING 2022-12-08 15:12:05.869 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=94, name=Partition rollover daemon, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.partitioning.PartitioningDaemonSchedule$Task, seriesId=0, startTime=2022-12-08T15:12:05.742+08:00, endTime=null} 2022-12-08 15:12:06.262 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:11:05.0, nextRun=2022-12-08 15:12:05.0, currentDate=Thu Dec 08 15:12:06 CST 2022 2022-12-08 15:12:06.262 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:11:05.0, nextRunTime=2022-12-08 15:12:05.0} 2022-12-08 15:12:06.280 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:12:06.280 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:12:06.280 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:12:06.341 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:12:06.416 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:12:06.493 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:06.791 INFO 42 --- [pool-ocp-schedules-11,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:12:06.850 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:12:06.955 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 95, operation:EXECUTE, state: RUNNING 2022-12-08 15:12:07.128 INFO 42 --- [pool-ocp-schedules-4,,a2835d807948] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:12:07.128 INFO 42 --- [pool-ocp-schedules-11,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:12:07.145 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=95, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:12:06.936+08:00, endTime=null} 2022-12-08 15:12:07.247 INFO 42 --- [pool-ocp-schedules-11,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:12:07.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:12:07.610 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:12:07.607902+08:00, lastProcessTime=2022-12-08T15:11:57.598120+08:00 2022-12-08 15:12:07.619 INFO 42 --- [pool-ocp-schedules-11,,] o.s.boot.SpringApplication : Started application in 7.552 seconds (JVM running for 888.919) 2022-12-08 15:12:07.753 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:12:07.607902+08:00, resultsCount=0 2022-12-08 15:12:07.754 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:12:07.607902+08:00, resultsCount=0 2022-12-08 15:12:07.754 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:12:07.607902+08:00 2022-12-08 15:12:08.137 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:08.142 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:08.606 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:94, status:SUCCESS 2022-12-08 15:12:08.613 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:94, status:SUCCESS 2022-12-08 15:12:08.637 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:08.638 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:08.711 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:95, status:SUCCESS 2022-12-08 15:12:08.717 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:95, status:SUCCESS 2022-12-08 15:12:08.968 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:12:09.545 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:09.545 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:09.783 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:09.897 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:12:10.030 INFO 42 --- [pool-ocp-schedules-11,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:12:10.030+08:00 2022-12-08 15:12:10.702 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:12:11.142 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:11.147 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:11.196 INFO 42 --- [pool-ocp-schedules-19,,21726858a417] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:12:11.197 INFO 42 --- [pool-ocp-schedules-19,,21726858a417] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:12:11.253 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:12:12.220 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:12:12.226 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:12:12.625 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:13.185 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:12:14.148 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:14.153 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:14.760 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:14.853 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:12:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,298b28cce7ca] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:12:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,298b28cce7ca] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:12:15.609 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:15.686 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:15.686 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:16.378 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:12:16.441 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:12:17.129 INFO 42 --- [pool-ocp-schedules-14,,25ff0d744a0f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:12:17.154 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:17.159 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:17.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:12:17.604 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:12:17.601237+08:00, lastProcessTime=2022-12-08T15:12:07.607902+08:00 2022-12-08 15:12:17.729 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:12:17.601237+08:00, resultsCount=0 2022-12-08 15:12:17.729 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:12:17.601237+08:00, resultsCount=0 2022-12-08 15:12:17.730 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:12:17.601237+08:00 2022-12-08 15:12:17.836 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:17.837 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:18.091 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:08:17.679, end=2022-12-08T15:10:17.995} 2022-12-08 15:12:18.131 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:12:19.810 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:20.160 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:20.167 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:20.200 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:12:20.206 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:12:20.917 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:21.372 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:11:21.0, nextRun=2022-12-08 15:12:20.0, currentDate=Thu Dec 08 15:12:21 CST 2022 2022-12-08 15:12:21.376 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:11:21.0, nextRunTime=2022-12-08 15:12:20.0} 2022-12-08 15:12:21.397 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:12:21.398 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:12:21.398 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:12:21.851 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:22.322 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:12:22.426 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 96, operation:EXECUTE, state: RUNNING 2022-12-08 15:12:22.729 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=96, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:12:22.403+08:00, endTime=null} 2022-12-08 15:12:23.168 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:23.173 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:23.255 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:12:24.148 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:24.148 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:24.408 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:96, status:SUCCESS 2022-12-08 15:12:24.415 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:96, status:SUCCESS 2022-12-08 15:12:24.910 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:24.911 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:25.777 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:25.856 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:11:26.0, nextRun=2022-12-08 15:12:25.0, currentDate=Thu Dec 08 15:12:25 CST 2022 2022-12-08 15:12:25.857 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:11:26.0, nextRunTime=2022-12-08 15:12:25.0} 2022-12-08 15:12:25.900 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:12:25.901 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:12:25.901 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:12:26.174 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:26.179 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:26.280 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:12:26.471 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:12:26.488 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:12:26.864 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 97, operation:EXECUTE, state: RUNNING 2022-12-08 15:12:26.931 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=97, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:12:26.852+08:00, endTime=null} 2022-12-08 15:12:27.130 INFO 42 --- [pool-ocp-schedules-18,,cb59fc976214] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:12:27.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:12:27.610 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:12:27.605443+08:00, lastProcessTime=2022-12-08T15:12:17.601237+08:00 2022-12-08 15:12:27.731 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:12:27.605443+08:00, resultsCount=0 2022-12-08 15:12:27.732 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:12:27.605443+08:00, resultsCount=0 2022-12-08 15:12:27.732 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:12:27.605443+08:00 2022-12-08 15:12:28.189 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:12:28.195 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:12:28.679 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:97, status:SUCCESS 2022-12-08 15:12:28.686 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:97, status:SUCCESS 2022-12-08 15:12:29.180 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:29.188 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:29.855 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:30.016 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:11:30.0, nextRun=2022-12-08 15:12:30.0, currentDate=Thu Dec 08 15:12:30 CST 2022 2022-12-08 15:12:30.017 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:11:30.0, nextRunTime=2022-12-08 15:12:30.0} 2022-12-08 15:12:30.038 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:12:30.127 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:00.0, nextRun=2022-12-08 15:12:30.0, currentDate=Thu Dec 08 15:12:30 CST 2022 2022-12-08 15:12:30.128 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:12:00.0, nextRunTime=2022-12-08 15:12:30.0} 2022-12-08 15:12:30.152 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:12:30.152 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:12:30.153 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:12:30.312 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:31.239 INFO 42 --- [pool-ocp-schedules-15,,ecf511aadb4c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:12:31.240 INFO 42 --- [pool-ocp-schedules-15,,ecf511aadb4c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:12:31.269 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 98, operation:EXECUTE, state: RUNNING 2022-12-08 15:12:31.310 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=98, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:12:31.242+08:00, endTime=null} 2022-12-08 15:12:31.585 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:31.718 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:12:32.189 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:32.193 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:32.455 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:98, status:SUCCESS 2022-12-08 15:12:32.463 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:98, status:SUCCESS 2022-12-08 15:12:33.309 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:12:33.391 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:33.392 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:34.642 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:34.643 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:35.194 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:35.203 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:35.816 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:36.495 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:12:36.701 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:12:37.055 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:12:37.060 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:12:37.132 INFO 42 --- [pool-ocp-schedules-9,,2feadd0e5a64] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:12:37.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:12:37.594 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:12:37.591370+08:00, lastProcessTime=2022-12-08T15:12:27.605443+08:00 2022-12-08 15:12:37.698 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:12:37.591370+08:00, resultsCount=0 2022-12-08 15:12:37.698 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:12:37.591370+08:00, resultsCount=0 2022-12-08 15:12:37.698 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:12:37.591370+08:00 2022-12-08 15:12:37.718 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:38.205 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:38.209 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:39.087 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:12:39.165 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:06:38+08:00, updateTime=2022-12-08T15:12:08+08:00, expireTime=null, isLeader=false} 2022-12-08 15:12:39.173 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:12:39.484 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:39.676 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:12:39.879 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:39.972 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:12:40.783 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:40.783 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:40.841 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:12:41.211 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:41.216 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:41.307 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:12:42.582 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:42.583 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:43.338 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:12:44.217 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:44.222 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:45.025 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:12:45.031 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:12:45.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:45.851 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:46.527 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:12:46.727 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:12:47.003 INFO 42 --- [pool-ocp-schedules-12,,5e22f63de52a] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:12:47.056 INFO 42 --- [pool-ocp-schedules-18,,397f2c971528] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:12:47.063 INFO 42 --- [pool-ocp-schedules-12,,5e22f63de52a] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:12:47.133 INFO 42 --- [pool-ocp-schedules-3,,5aaa0ce08940] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:12:47.156 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:47.223 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:47.228 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:47.285 INFO 42 --- [pool-ocp-schedules-14,,01c70a2323d9] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:12:47.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:12:47.609 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:12:47.604505+08:00, lastProcessTime=2022-12-08T15:12:37.591370+08:00 2022-12-08 15:12:47.703 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:12:47.733 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:12:47.604505+08:00, resultsCount=0 2022-12-08 15:12:47.734 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:12:47.604505+08:00, resultsCount=0 2022-12-08 15:12:47.734 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:12:47.604505+08:00 2022-12-08 15:12:48.703 INFO 42 --- [pool-ocp-schedules-4,,dce4e41cb6cc] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:12:48.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:48.756 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:49.030 INFO 42 --- [pool-ocp-schedules-8,,0ad75ef4fe61] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:12:49.030 INFO 42 --- [pool-ocp-schedules-13,,43c223a8e158] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:12:49.130 INFO 42 --- [pool-ocp-schedules-1,,e735036f8b86] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:12:49.131 INFO 42 --- [pool-ocp-schedules-1,,e735036f8b86] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:12:49.131 INFO 42 --- [pool-ocp-schedules-1,,e735036f8b86] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:12:49.972 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:50.204 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:50.205 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:50.229 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:50.235 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:51.300 INFO 42 --- [pool-ocp-schedules-18,,09f1028cfd82] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:12:51.300 INFO 42 --- [pool-ocp-schedules-18,,09f1028cfd82] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:12:52.884 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:12:52.889 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:12:53.236 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:53.240 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:53.295 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:53.369 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:12:55.058 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:12:55.494 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:12:56.051 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:12:56.241 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:56.248 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:12:56.339 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:12:56.347 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:56.348 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:56.553 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:12:56.900 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:12:57.134 INFO 42 --- [pool-ocp-schedules-15,,55672ee0c532] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:12:57.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:12:57.602 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:12:57.598737+08:00, lastProcessTime=2022-12-08T15:12:47.604505+08:00 2022-12-08 15:12:57.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:12:57.598737+08:00, resultsCount=0 2022-12-08 15:12:57.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:12:57.598737+08:00, resultsCount=0 2022-12-08 15:12:57.740 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:12:57.598737+08:00 2022-12-08 15:12:58.132 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:12:58.133 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:12:59.249 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:12:59.254 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:00.008 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,a79b3114f0e2] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483640, interval=60 2022-12-08 15:13:00.207 INFO 42 --- [pool-prometheus-minute-schedule-2,,a79b3114f0e2] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483580, count=0, elapsed=1668813096627 2022-12-08 15:13:00.208 INFO 42 --- [pool-prometheus-minute-schedule-1,,701ea644b328] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483640, interval=60 2022-12-08 15:13:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,701ea644b328] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483580, count=0, elapsed=1668813096629 2022-12-08 15:13:00.402 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:00.0, nextRun=2022-12-08 15:13:00.0, currentDate=Thu Dec 08 15:13:00 CST 2022 2022-12-08 15:13:00.403 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:12:00.0, nextRunTime=2022-12-08 15:13:00.0} 2022-12-08 15:13:00.442 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:13:00.443 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:13:00.443 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:13:00.732 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:00.0, nextRun=2022-12-08 15:13:00.0, currentDate=Thu Dec 08 15:13:00 CST 2022 2022-12-08 15:13:00.733 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:12:00.0, nextRunTime=2022-12-08 15:13:00.0} 2022-12-08 15:13:00.761 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:13:00.761 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:13:00.761 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:13:00.792 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 99, operation:EXECUTE, state: RUNNING 2022-12-08 15:13:00.793 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:13:00.803 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:13:00.850 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:00.0, nextRun=2022-12-08 15:13:00.0, currentDate=Thu Dec 08 15:13:00 CST 2022 2022-12-08 15:13:00.851 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:12:00.0, nextRunTime=2022-12-08 15:13:00.0} 2022-12-08 15:13:00.853 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=99, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:13:00.780+08:00, endTime=null} 2022-12-08 15:13:00.884 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:13:00.885 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:13:00.885 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:13:01.091 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:30.0, nextRun=2022-12-08 15:13:00.0, currentDate=Thu Dec 08 15:13:01 CST 2022 2022-12-08 15:13:01.092 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:12:30.0, nextRunTime=2022-12-08 15:13:00.0} 2022-12-08 15:13:01.110 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:13:01.111 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:13:01.111 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:13:01.200 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:01.247 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:00.0, nextRun=2022-12-08 15:13:00.0, currentDate=Thu Dec 08 15:13:01 CST 2022 2022-12-08 15:13:01.248 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:12:00.0, nextRunTime=2022-12-08 15:13:00.0} 2022-12-08 15:13:01.265 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:13:01.265 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:13:01.265 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:13:01.847 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:99, status:SUCCESS 2022-12-08 15:13:01.854 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:99, status:SUCCESS 2022-12-08 15:13:01.977 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 100, operation:EXECUTE, state: RUNNING 2022-12-08 15:13:02.166 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=100, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:13:01.966+08:00, endTime=null} 2022-12-08 15:13:02.255 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:02.264 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:02.282 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 101, operation:EXECUTE, state: RUNNING 2022-12-08 15:13:02.565 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=101, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:13:02.266+08:00, endTime=null} 2022-12-08 15:13:02.595 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:02.630 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 102, operation:EXECUTE, state: RUNNING 2022-12-08 15:13:02.772 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=102, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:13:02.616+08:00, endTime=null} 2022-12-08 15:13:02.855 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 103, operation:EXECUTE, state: RUNNING 2022-12-08 15:13:03.030 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:13:03.052 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=103, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:13:02.838+08:00, endTime=null} 2022-12-08 15:13:03.394 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:13:03.433 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:100, status:SUCCESS 2022-12-08 15:13:03.522 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:100, status:SUCCESS 2022-12-08 15:13:03.650 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:101, status:SUCCESS 2022-12-08 15:13:03.655 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:101, status:SUCCESS 2022-12-08 15:13:03.858 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:102, status:SUCCESS 2022-12-08 15:13:03.865 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:102, status:SUCCESS 2022-12-08 15:13:03.999 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:103, status:SUCCESS 2022-12-08 15:13:04.005 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:103, status:SUCCESS 2022-12-08 15:13:04.268 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:04.268 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:05.266 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:05.271 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:05.773 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:05.774 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:05.935 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:06.0, nextRun=2022-12-08 15:13:05.0, currentDate=Thu Dec 08 15:13:05 CST 2022 2022-12-08 15:13:05.936 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:12:06.0, nextRunTime=2022-12-08 15:13:05.0} 2022-12-08 15:13:05.954 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:13:05.954 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:13:05.955 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:13:06.179 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 104, operation:EXECUTE, state: RUNNING 2022-12-08 15:13:06.243 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=104, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:13:06.165+08:00, endTime=null} 2022-12-08 15:13:06.266 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:06.629 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:13:06.865 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:104, status:SUCCESS 2022-12-08 15:13:06.870 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:104, status:SUCCESS 2022-12-08 15:13:06.934 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:13:07.136 INFO 42 --- [pool-ocp-schedules-15,,bcb09e425fb9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:13:07.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:13:07.604 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:13:07.600986+08:00, lastProcessTime=2022-12-08T15:12:57.598737+08:00 2022-12-08 15:13:07.722 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:13:07.600986+08:00, resultsCount=0 2022-12-08 15:13:07.722 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:13:07.600986+08:00, resultsCount=0 2022-12-08 15:13:07.722 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:13:07.600986+08:00 2022-12-08 15:13:08.272 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:08.278 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:08.561 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:13:08.566 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:13:08.912 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:09.206 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:13:10.035 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:10.127 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:08:39+08:00, updateTime=2022-12-08T15:12:39+08:00, expireTime=null, isLeader=false} 2022-12-08 15:13:10.173 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:13:10.184 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:13:10.416 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:10.664 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:13:10.880 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:13:11.279 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:11.285 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:11.396 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:13:11.485 INFO 42 --- [pool-ocp-schedules-20,,87d34bf35bf6] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:13:11.486 INFO 42 --- [pool-ocp-schedules-20,,87d34bf35bf6] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:13:11.990 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:11.990 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:13.482 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:13:13.496 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:13.496 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:14.285 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:14.291 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,f389442f1945] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:13:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,f389442f1945] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:13:15.866 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:13:15.876 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:13:16.334 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:16.569 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:16.723 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:13:17.025 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:13:17.137 INFO 42 --- [pool-ocp-schedules-9,,f47c6ce67936] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:13:17.292 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:17.297 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:17.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:13:17.611 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:13:17.606982+08:00, lastProcessTime=2022-12-08T15:13:07.600986+08:00 2022-12-08 15:13:17.745 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:13:17.606982+08:00, resultsCount=0 2022-12-08 15:13:17.745 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:13:17.606982+08:00, resultsCount=0 2022-12-08 15:13:17.745 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:13:17.606982+08:00 2022-12-08 15:13:18.217 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:18.518 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:13:19.618 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:19.618 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:20.173 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:20.298 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:20.303 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:20.809 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:21.0, nextRun=2022-12-08 15:13:20.0, currentDate=Thu Dec 08 15:13:20 CST 2022 2022-12-08 15:13:20.809 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:12:21.0, nextRunTime=2022-12-08 15:13:20.0} 2022-12-08 15:13:20.827 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:13:20.827 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:13:20.828 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:13:21.282 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:21.283 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:21.546 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 105, operation:EXECUTE, state: RUNNING 2022-12-08 15:13:21.582 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=105, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:13:21.535+08:00, endTime=null} 2022-12-08 15:13:22.386 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:105, status:SUCCESS 2022-12-08 15:13:22.393 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:105, status:SUCCESS 2022-12-08 15:13:23.304 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:23.309 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:23.534 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:13:23.848 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:13:23.853 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:13:24.331 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:25.424 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:26.0, nextRun=2022-12-08 15:13:25.0, currentDate=Thu Dec 08 15:13:25 CST 2022 2022-12-08 15:13:25.425 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:12:26.0, nextRunTime=2022-12-08 15:13:25.0} 2022-12-08 15:13:25.467 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:13:25.467 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:13:25.467 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:13:25.687 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 106, operation:EXECUTE, state: RUNNING 2022-12-08 15:13:25.763 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:25.815 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=106, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:13:25.676+08:00, endTime=null} 2022-12-08 15:13:25.987 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:13:26.309 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:26.314 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:26.434 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:26.539 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:13:26.744 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:13:27.085 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:13:27.138 INFO 42 --- [pool-ocp-schedules-17,,4ae41be39d1c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:13:27.290 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:106, status:SUCCESS 2022-12-08 15:13:27.296 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:106, status:SUCCESS 2022-12-08 15:13:27.412 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:27.412 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:27.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:13:27.607 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:13:27.604520+08:00, lastProcessTime=2022-12-08T15:13:17.606982+08:00 2022-12-08 15:13:27.725 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:13:27.604520+08:00, resultsCount=0 2022-12-08 15:13:27.725 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:13:27.604520+08:00, resultsCount=0 2022-12-08 15:13:27.726 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:13:27.604520+08:00 2022-12-08 15:13:28.866 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:28.867 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:29.314 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:29.319 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:30.253 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:31.011 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:30.0, nextRun=2022-12-08 15:13:30.0, currentDate=Thu Dec 08 15:13:31 CST 2022 2022-12-08 15:13:31.012 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:12:30.0, nextRunTime=2022-12-08 15:13:30.0} 2022-12-08 15:13:31.037 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:13:31.155 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:13:01.0, nextRun=2022-12-08 15:13:30.0, currentDate=Thu Dec 08 15:13:31 CST 2022 2022-12-08 15:13:31.155 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:13:01.0, nextRunTime=2022-12-08 15:13:30.0} 2022-12-08 15:13:31.174 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:13:31.175 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:13:31.175 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:13:31.495 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:13:31.500 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:13:31.591 INFO 42 --- [pool-ocp-schedules-7,,b9280f39d7a0] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:13:31.592 INFO 42 --- [pool-ocp-schedules-7,,b9280f39d7a0] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:13:31.957 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 107, operation:EXECUTE, state: RUNNING 2022-12-08 15:13:32.033 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:32.140 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=107, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:13:31.944+08:00, endTime=null} 2022-12-08 15:13:32.320 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:32.324 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:33.548 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:107, status:SUCCESS 2022-12-08 15:13:33.557 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:107, status:SUCCESS 2022-12-08 15:13:33.613 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:13:33.633 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:34.148 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:13:35.321 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:35.321 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:35.325 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:35.328 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:36.469 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:36.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:36.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:36.779 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:13:37.131 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:13:37.139 INFO 42 --- [pool-ocp-schedules-1,,3dcebd15bf4d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:13:37.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:13:37.599 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:13:37.596758+08:00, lastProcessTime=2022-12-08T15:13:27.604520+08:00 2022-12-08 15:13:37.715 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:13:37.596758+08:00, resultsCount=0 2022-12-08 15:13:37.716 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:13:37.596758+08:00, resultsCount=0 2022-12-08 15:13:37.716 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:13:37.596758+08:00 2022-12-08 15:13:38.329 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:38.333 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:39.255 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:13:39.590 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:13:39.596 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:13:39.782 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:13:39.796 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=14ms, period=120000ms 2022-12-08 15:13:39.798 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:40.230 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:13:40.313 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:40.947 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:13:41.334 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:41.339 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:41.508 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:41.587 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:13:41.721 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:13:42.854 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:42.854 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:43.639 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:13:44.340 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:44.345 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:44.693 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:44.694 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:46.670 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:46.882 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:13:46.975 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:13:46.979 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:13:46.993 INFO 42 --- [pool-ocp-schedules-6,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 15:13:47.009 INFO 42 --- [pool-ocp-schedules-7,,b75e8f9a3a8d] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:13:47.038 INFO 42 --- [pool-ocp-schedules-7,,b75e8f9a3a8d] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:13:47.045 INFO 42 --- [pool-ocp-schedules-20,,9ccbbaa7c852] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:13:47.045 INFO 42 --- [pool-ocp-schedules-20,,9ccbbaa7c852] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:13:47.057 INFO 42 --- [pool-ocp-schedules-16,,0ac4dcff8de2] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:13:47.140 INFO 42 --- [pool-ocp-schedules-18,,5258117291bc] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:13:47.164 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:13:47.314 INFO 42 --- [pool-ocp-schedules-12,,dc927485bff1] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:13:47.324 INFO 42 --- [pool-ocp-schedules-8,,a8026246eb30] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 15:13:47.345 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:47.350 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:47.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:13:47.608 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:13:47.605588+08:00, lastProcessTime=2022-12-08T15:13:37.596758+08:00 2022-12-08 15:13:47.622 INFO 42 --- [pool-ocp-schedules-9,,fa6ce2f36568] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 15:13:47.737 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:13:47.605588+08:00, resultsCount=0 2022-12-08 15:13:47.737 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:13:47.605588+08:00, resultsCount=0 2022-12-08 15:13:47.737 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:13:47.605588+08:00 2022-12-08 15:13:47.751 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:48.774 INFO 42 --- [pool-ocp-schedules-10,,92dcb7805067] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:13:48.981 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:49.085 INFO 42 --- [pool-ocp-schedules-7,,287951da7c59] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:13:49.121 INFO 42 --- [pool-ocp-schedules-8,,ce4026b43f5f] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:13:49.203 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:13:49.228 INFO 42 --- [pool-ocp-schedules-6,,0b33819bec3d] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:13:49.229 INFO 42 --- [pool-ocp-schedules-6,,0b33819bec3d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:13:49.229 INFO 42 --- [pool-ocp-schedules-6,,0b33819bec3d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:13:50.339 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:50.350 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:50.355 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:50.807 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:50.808 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:51.720 INFO 42 --- [pool-ocp-schedules-3,,8eafb8e1b61f] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:13:51.720 INFO 42 --- [pool-ocp-schedules-3,,8eafb8e1b61f] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:13:52.031 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:52.031 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:53.355 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:53.360 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:53.701 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:13:54.402 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:13:54.407 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:13:55.100 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:56.361 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:56.366 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:13:56.680 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:13:56.848 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:13:56.949 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:13:56.976 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:13:57.141 INFO 42 --- [pool-ocp-schedules-8,,3f1d44654dd8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:13:57.212 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:13:57.523 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:13:57.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:13:57.594 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:13:57.591513+08:00, lastProcessTime=2022-12-08T15:13:47.605588+08:00 2022-12-08 15:13:57.729 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:13:57.591513+08:00, resultsCount=0 2022-12-08 15:13:57.729 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:13:57.591513+08:00, resultsCount=0 2022-12-08 15:13:57.730 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:13:57.591513+08:00 2022-12-08 15:13:58.319 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:13:58.319 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:13:59.366 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:13:59.374 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:00.020 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:00.020 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:00.204 INFO 42 --- [pool-prometheus-minute-schedule-2,,a1831c8f6252] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483700, interval=60 2022-12-08 15:14:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,a1831c8f6252] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483640, count=0, elapsed=1668813156565 2022-12-08 15:14:00.208 INFO 42 --- [pool-prometheus-minute-schedule-1,,668b433927c0] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483700, interval=60 2022-12-08 15:14:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,668b433927c0] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483640, count=0, elapsed=1668813156569 2022-12-08 15:14:00.571 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:01.237 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:02.0, nextRun=2022-12-08 15:14:00.0, currentDate=Thu Dec 08 15:14:01 CST 2022 2022-12-08 15:14:01.238 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:12:02.0, nextRunTime=2022-12-08 15:14:00.0} 2022-12-08 15:14:01.266 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:14:01.392 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:13:00.0, nextRun=2022-12-08 15:14:00.0, currentDate=Thu Dec 08 15:14:01 CST 2022 2022-12-08 15:14:01.393 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:13:00.0, nextRunTime=2022-12-08 15:14:00.0} 2022-12-08 15:14:01.411 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:14:01.412 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:14:01.412 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:14:01.466 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:13:01.0, nextRun=2022-12-08 15:14:00.0, currentDate=Thu Dec 08 15:14:01 CST 2022 2022-12-08 15:14:01.466 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:13:01.0, nextRunTime=2022-12-08 15:14:00.0} 2022-12-08 15:14:01.487 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:14:01.488 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:14:01.488 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:14:01.548 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:13:01.0, nextRun=2022-12-08 15:14:00.0, currentDate=Thu Dec 08 15:14:01 CST 2022 2022-12-08 15:14:01.549 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:13:01.0, nextRunTime=2022-12-08 15:14:00.0} 2022-12-08 15:14:01.566 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 108, operation:EXECUTE, state: RUNNING 2022-12-08 15:14:01.579 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:14:01.579 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:14:01.579 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:14:01.630 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=108, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:14:01.552+08:00, endTime=null} 2022-12-08 15:14:01.705 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:13:31.0, nextRun=2022-12-08 15:14:00.0, currentDate=Thu Dec 08 15:14:01 CST 2022 2022-12-08 15:14:01.706 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:13:31.0, nextRunTime=2022-12-08 15:14:00.0} 2022-12-08 15:14:01.723 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:14:01.723 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:14:01.724 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:14:01.816 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:13:01.0, nextRun=2022-12-08 15:14:00.0, currentDate=Thu Dec 08 15:14:01 CST 2022 2022-12-08 15:14:01.816 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:13:01.0, nextRunTime=2022-12-08 15:14:00.0} 2022-12-08 15:14:01.833 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:14:01.834 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:14:01.834 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:14:02.375 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:02.381 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:02.724 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 112, operation:EXECUTE, state: RUNNING 2022-12-08 15:14:02.867 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:108, status:SUCCESS 2022-12-08 15:14:02.870 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=112, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:14:02.710+08:00, endTime=null} 2022-12-08 15:14:02.874 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:108, status:SUCCESS 2022-12-08 15:14:02.934 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:14:02.943 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:14:02.973 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 109, operation:EXECUTE, state: RUNNING 2022-12-08 15:14:03.047 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=109, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:14:02.949+08:00, endTime=null} 2022-12-08 15:14:03.137 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 110, operation:EXECUTE, state: RUNNING 2022-12-08 15:14:03.204 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=110, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:14:03.124+08:00, endTime=null} 2022-12-08 15:14:03.225 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:03.282 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 111, operation:EXECUTE, state: RUNNING 2022-12-08 15:14:03.347 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=111, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:14:03.267+08:00, endTime=null} 2022-12-08 15:14:03.756 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:14:04.249 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:109, status:SUCCESS 2022-12-08 15:14:04.258 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:109, status:SUCCESS 2022-12-08 15:14:04.346 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:110, status:SUCCESS 2022-12-08 15:14:04.351 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:110, status:SUCCESS 2022-12-08 15:14:04.497 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:111, status:SUCCESS 2022-12-08 15:14:04.502 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:111, status:SUCCESS 2022-12-08 15:14:04.531 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:04.647 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:14:04.681 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:112, status:SUCCESS 2022-12-08 15:14:04.686 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:112, status:SUCCESS 2022-12-08 15:14:05.382 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:05.388 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:05.837 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:13:06.0, nextRun=2022-12-08 15:14:05.0, currentDate=Thu Dec 08 15:14:05 CST 2022 2022-12-08 15:14:05.838 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:13:06.0, nextRunTime=2022-12-08 15:14:05.0} 2022-12-08 15:14:05.886 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:14:05.887 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:14:05.887 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:14:06.315 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:06.316 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:06.459 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 113, operation:EXECUTE, state: RUNNING 2022-12-08 15:14:06.499 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=113, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:14:06.447+08:00, endTime=null} 2022-12-08 15:14:06.931 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:06.973 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:113, status:SUCCESS 2022-12-08 15:14:06.979 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:113, status:SUCCESS 2022-12-08 15:14:06.998 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:14:07.142 INFO 42 --- [pool-ocp-schedules-2,,4ebc7fd0fc67] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:14:07.242 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:14:07.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:14:07.659 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:07.659 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:07.668 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:14:07.664096+08:00, lastProcessTime=2022-12-08T15:13:57.591513+08:00 2022-12-08 15:14:07.787 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:14:07.664096+08:00, resultsCount=0 2022-12-08 15:14:07.787 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:14:07.664096+08:00, resultsCount=0 2022-12-08 15:14:07.788 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:14:07.664096+08:00 2022-12-08 15:14:08.389 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:08.393 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:09.352 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:14:10.004 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:14:10.010 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:14:10.255 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:14:10.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:10.999 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:14:11.119 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:11.394 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:11.399 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:11.737 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:14:11.899 INFO 42 --- [pool-ocp-schedules-13,,1df7cf27d20b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:14:11.900 INFO 42 --- [pool-ocp-schedules-13,,1df7cf27d20b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:14:12.500 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:12.818 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:14:13.810 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:14:13.817 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:13.817 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:14.400 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:14.405 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,70ec13dfe4cf] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:14:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,70ec13dfe4cf] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:14:15.626 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:15.627 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:16.956 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:17.079 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:14:17.143 INFO 42 --- [pool-ocp-schedules-6,,516fd76f5df6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:14:17.406 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:17.408 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:14:17.410 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:17.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:14:17.615 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:14:17.612050+08:00, lastProcessTime=2022-12-08T15:14:07.664096+08:00 2022-12-08 15:14:17.731 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:14:17.612050+08:00, resultsCount=0 2022-12-08 15:14:17.731 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:14:17.612050+08:00, resultsCount=0 2022-12-08 15:14:17.731 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:14:17.612050+08:00 2022-12-08 15:14:18.205 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:14:18.211 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:14:18.369 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:10:17.995, end=2022-12-08T15:12:18.227} 2022-12-08 15:14:18.370 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T15:08:17.446, end=2022-12-08T15:13:18.269} 2022-12-08 15:14:18.393 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T15:08:17.47, end=2022-12-08T15:13:18.329} 2022-12-08 15:14:18.394 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:14:18.395 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:14:18.415 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:14:18.719 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:20.269 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:13:21.0, nextRun=2022-12-08 15:14:20.0, currentDate=Thu Dec 08 15:14:20 CST 2022 2022-12-08 15:14:20.269 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:13:21.0, nextRunTime=2022-12-08 15:14:20.0} 2022-12-08 15:14:20.288 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:14:20.288 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:14:20.288 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:14:20.308 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:20.410 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:20.425 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:20.568 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:14:20.733 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 114, operation:EXECUTE, state: RUNNING 2022-12-08 15:14:20.763 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=114, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:14:20.718+08:00, endTime=null} 2022-12-08 15:14:21.173 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:21.767 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:21.768 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:22.158 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:114, status:SUCCESS 2022-12-08 15:14:22.173 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:114, status:SUCCESS 2022-12-08 15:14:23.426 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:23.430 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:23.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:23.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:24.060 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:14:25.783 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:14:25.788 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:14:25.789 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:13:25.0, nextRun=2022-12-08 15:14:25.0, currentDate=Thu Dec 08 15:14:25 CST 2022 2022-12-08 15:14:25.789 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:13:25.0, nextRunTime=2022-12-08 15:14:25.0} 2022-12-08 15:14:25.923 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:14:25.923 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:14:25.923 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:14:26.431 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:26.436 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:26.644 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:26.902 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:14:26.915 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 115, operation:EXECUTE, state: RUNNING 2022-12-08 15:14:26.955 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=115, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:14:26.902+08:00, endTime=null} 2022-12-08 15:14:27.079 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:27.144 INFO 42 --- [pool-ocp-schedules-18,,f40244bb586b] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:14:27.293 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:14:27.494 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:14:27.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:14:27.605 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:14:27.601458+08:00, lastProcessTime=2022-12-08T15:14:17.612050+08:00 2022-12-08 15:14:27.720 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:14:27.601458+08:00, resultsCount=0 2022-12-08 15:14:27.721 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:14:27.601458+08:00, resultsCount=0 2022-12-08 15:14:27.721 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:14:27.601458+08:00 2022-12-08 15:14:28.070 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:115, status:SUCCESS 2022-12-08 15:14:28.076 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:115, status:SUCCESS 2022-12-08 15:14:28.280 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:28.380 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:14:29.436 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:29.442 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:29.860 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:29.860 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:30.551 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:13:31.0, nextRun=2022-12-08 15:14:30.0, currentDate=Thu Dec 08 15:14:30 CST 2022 2022-12-08 15:14:30.552 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:13:31.0, nextRunTime=2022-12-08 15:14:30.0} 2022-12-08 15:14:30.584 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:14:30.712 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:02.0, nextRun=2022-12-08 15:14:30.0, currentDate=Thu Dec 08 15:14:30 CST 2022 2022-12-08 15:14:30.713 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:14:02.0, nextRunTime=2022-12-08 15:14:30.0} 2022-12-08 15:14:30.730 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:14:30.731 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:14:30.731 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:14:31.055 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 116, operation:EXECUTE, state: RUNNING 2022-12-08 15:14:31.232 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:31.285 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=116, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:14:31.043+08:00, endTime=null} 2022-12-08 15:14:31.338 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:31.338 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:32.033 INFO 42 --- [pool-ocp-schedules-13,,6aca1a7e063e] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:14:32.033 INFO 42 --- [pool-ocp-schedules-13,,6aca1a7e063e] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:14:32.088 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:116, status:SUCCESS 2022-12-08 15:14:32.095 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:116, status:SUCCESS 2022-12-08 15:14:32.442 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:32.447 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:33.592 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:14:33.598 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:14:34.161 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:14:34.483 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:35.448 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:35.454 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:36.170 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:36.259 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:14:37.128 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:37.145 INFO 42 --- [pool-ocp-schedules-5,,059d621f40ee] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:14:37.475 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:14:37.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:14:37.536 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:14:37.604 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:14:37.601603+08:00, lastProcessTime=2022-12-08T15:14:27.601458+08:00 2022-12-08 15:14:37.690 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:37.691 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:37.714 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:14:37.601603+08:00, resultsCount=0 2022-12-08 15:14:37.714 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:14:37.601603+08:00, resultsCount=0 2022-12-08 15:14:37.715 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:14:37.601603+08:00 2022-12-08 15:14:38.455 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:38.460 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:39.255 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:39.255 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:39.383 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:14:40.304 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:14:41.119 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:14:41.337 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:41.417 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:14:41.422 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:14:41.461 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:41.465 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:41.950 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:14:42.320 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:44.040 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:44.198 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:14:44.466 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:44.471 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:44.550 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:14:45.449 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:45.449 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:47.005 INFO 42 --- [pool-ocp-schedules-7,,bf002bd20f33] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:14:47.057 INFO 42 --- [pool-ocp-schedules-7,,bf002bd20f33] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:14:47.057 INFO 42 --- [pool-ocp-schedules-17,,3c79cbcbbcaf] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:14:47.146 INFO 42 --- [pool-ocp-schedules-13,,c2e23521e540] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:14:47.169 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:47.253 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:47.253 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:47.319 INFO 42 --- [pool-ocp-schedules-2,,a5ff70951c1f] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:14:47.472 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:47.477 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:47.508 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:14:47.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:14:47.596 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:14:47.592742+08:00, lastProcessTime=2022-12-08T15:14:37.601603+08:00 2022-12-08 15:14:47.615 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:14:47.717 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:14:47.592742+08:00, resultsCount=0 2022-12-08 15:14:47.717 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:14:47.592742+08:00, resultsCount=0 2022-12-08 15:14:47.718 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:14:47.592742+08:00 2022-12-08 15:14:48.835 INFO 42 --- [pool-ocp-schedules-9,,db04d5c7e776] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:14:49.132 INFO 42 --- [pool-ocp-schedules-14,,d3bdcafacc19] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:14:49.212 INFO 42 --- [pool-ocp-schedules-4,,a0e1d302492b] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:14:49.326 INFO 42 --- [pool-ocp-schedules-18,,2a262d317ec0] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:14:49.327 INFO 42 --- [pool-ocp-schedules-18,,2a262d317ec0] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:14:49.327 INFO 42 --- [pool-ocp-schedules-18,,2a262d317ec0] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:14:49.707 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:14:49.713 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:14:50.375 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:50.477 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:50.482 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:51.364 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:51.687 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:51.928 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:14:52.101 INFO 42 --- [pool-ocp-schedules-4,,394cdaf9f750] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:14:52.102 INFO 42 --- [pool-ocp-schedules-4,,394cdaf9f750] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:14:53.482 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:53.483 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:53.483 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:53.488 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:54.273 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:14:54.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:14:54.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:14:56.489 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:56.495 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:56.975 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:14:57.148 INFO 42 --- [pool-ocp-schedules-20,,ea17f9e00d92] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:14:57.197 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:14:57.202 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:14:57.327 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:14:57.531 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:14:57.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:14:57.612 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:14:57.606567+08:00, lastProcessTime=2022-12-08T15:14:47.592742+08:00 2022-12-08 15:14:57.661 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:14:57.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:14:57.606567+08:00, resultsCount=0 2022-12-08 15:14:57.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:14:57.606567+08:00, resultsCount=0 2022-12-08 15:14:57.740 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:14:57.606567+08:00 2022-12-08 15:14:57.953 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:14:59.496 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:14:59.501 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:14:59.790 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:00.000 INFO 42 --- [pool-ocp-schedules-7,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:15:00.205 INFO 42 --- [pool-prometheus-minute-schedule-1,,268488997a02] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483760, interval=60 2022-12-08 15:15:00.205 INFO 42 --- [pool-prometheus-minute-schedule-1,,268488997a02] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483700, count=0, elapsed=1668813216505 2022-12-08 15:15:00.208 INFO 42 --- [pool-prometheus-minute-schedule-2,,693f3318ab8d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483760, interval=60 2022-12-08 15:15:00.209 INFO 42 --- [pool-prometheus-minute-schedule-2,,693f3318ab8d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483700, count=0, elapsed=1668813216509 2022-12-08 15:15:00.310 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:15:01.018 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:01.019 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:01.023 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:01.0, nextRun=2022-12-08 15:15:00.0, currentDate=Thu Dec 08 15:15:01 CST 2022 2022-12-08 15:15:01.024 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 15:10:01.0, nextRunTime=2022-12-08 15:15:00.0} 2022-12-08 15:15:01.041 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 15:15:01.042 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:01.042 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:01.168 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:01.0, nextRun=2022-12-08 15:15:00.0, currentDate=Thu Dec 08 15:15:01 CST 2022 2022-12-08 15:15:01.169 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:10:01.0, nextRunTime=2022-12-08 15:15:00.0} 2022-12-08 15:15:01.219 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 15:15:01.220 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 15:15:01.304 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:01.0, nextRun=2022-12-08 15:15:00.0, currentDate=Thu Dec 08 15:15:01 CST 2022 2022-12-08 15:15:01.304 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:14:01.0, nextRunTime=2022-12-08 15:15:00.0} 2022-12-08 15:15:01.322 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:15:01.322 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:01.323 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:01.379 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:01.0, nextRun=2022-12-08 15:15:00.0, currentDate=Thu Dec 08 15:15:01 CST 2022 2022-12-08 15:15:01.380 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:14:01.0, nextRunTime=2022-12-08 15:15:00.0} 2022-12-08 15:15:01.403 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:15:01.404 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:01.404 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:01.434 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:01.462 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:02.0, nextRun=2022-12-08 15:15:00.0, currentDate=Thu Dec 08 15:15:01 CST 2022 2022-12-08 15:15:01.463 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:14:02.0, nextRunTime=2022-12-08 15:15:00.0} 2022-12-08 15:15:01.486 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:15:01.486 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:01.487 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:01.545 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:31.0, nextRun=2022-12-08 15:15:00.0, currentDate=Thu Dec 08 15:15:01 CST 2022 2022-12-08 15:15:01.546 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:14:31.0, nextRunTime=2022-12-08 15:15:00.0} 2022-12-08 15:15:01.565 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:15:01.566 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:01.566 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:01.627 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:02.0, nextRun=2022-12-08 15:15:00.0, currentDate=Thu Dec 08 15:15:01 CST 2022 2022-12-08 15:15:01.628 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:10:02.0, nextRunTime=2022-12-08 15:15:00.0} 2022-12-08 15:15:01.648 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 15:15:01.648 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:01.648 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:01.702 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:02.0, nextRun=2022-12-08 15:15:00.0, currentDate=Thu Dec 08 15:15:01 CST 2022 2022-12-08 15:15:01.703 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:14:02.0, nextRunTime=2022-12-08 15:15:00.0} 2022-12-08 15:15:01.720 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:15:01.721 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:01.721 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:01.731 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 117, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:01.776 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=117, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T15:15:01.707+08:00, endTime=null} 2022-12-08 15:15:01.857 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 118, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:01.896 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=118, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:15:01.843+08:00, endTime=null} 2022-12-08 15:15:02.001 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 119, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:02.036 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=119, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:15:01.984+08:00, endTime=null} 2022-12-08 15:15:02.105 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 120, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:02.191 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=120, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:15:02.091+08:00, endTime=null} 2022-12-08 15:15:02.265 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 121, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:02.323 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=121, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:15:02.251+08:00, endTime=null} 2022-12-08 15:15:02.502 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:02.508 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:03.061 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:117, status:SUCCESS 2022-12-08 15:15:03.071 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:117, status:SUCCESS 2022-12-08 15:15:03.119 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:03.119 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:03.294 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:118, status:SUCCESS 2022-12-08 15:15:03.301 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:118, status:SUCCESS 2022-12-08 15:15:03.401 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 122, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:03.549 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:119, status:SUCCESS 2022-12-08 15:15:03.556 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:119, status:SUCCESS 2022-12-08 15:15:03.632 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=122, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T15:15:03.382+08:00, endTime=null} 2022-12-08 15:15:03.693 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 123, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:03.736 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:120, status:SUCCESS 2022-12-08 15:15:03.741 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:120, status:SUCCESS 2022-12-08 15:15:03.774 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=123, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:15:03.682+08:00, endTime=null} 2022-12-08 15:15:03.824 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:121, status:SUCCESS 2022-12-08 15:15:03.830 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:121, status:SUCCESS 2022-12-08 15:15:04.312 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:15:05.220 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:122, status:SUCCESS 2022-12-08 15:15:05.226 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:122, status:SUCCESS 2022-12-08 15:15:05.406 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:123, status:SUCCESS 2022-12-08 15:15:05.419 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:123, status:SUCCESS 2022-12-08 15:15:05.509 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:05.513 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:05.625 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:06.0, nextRun=2022-12-08 15:15:05.0, currentDate=Thu Dec 08 15:15:05 CST 2022 2022-12-08 15:15:05.626 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:14:06.0, nextRunTime=2022-12-08 15:15:05.0} 2022-12-08 15:15:05.647 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:15:05.647 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:05.647 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:05.745 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:15:05.750 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:15:05.865 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 124, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:05.900 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=124, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:15:05.841+08:00, endTime=null} 2022-12-08 15:15:06.280 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:06.805 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:124, status:SUCCESS 2022-12-08 15:15:06.812 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:124, status:SUCCESS 2022-12-08 15:15:06.973 INFO 42 --- [pool-ocp-schedules-7,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:15:07.149 INFO 42 --- [pool-ocp-schedules-6,,19d448b5476d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:15:07.231 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:07.365 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:07.368 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:15:07.417 INFO 42 --- [pool-ocp-schedules-7,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:15:07.539 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:15:07.551 INFO 42 --- [pool-ocp-schedules-7,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:15:07.577 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:15:07.629 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:15:07.619338+08:00, lastProcessTime=2022-12-08T15:14:57.606567+08:00 2022-12-08 15:15:07.733 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:15:07.814 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:15:07.619338+08:00, resultsCount=0 2022-12-08 15:15:07.815 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:15:07.619338+08:00, resultsCount=0 2022-12-08 15:15:07.815 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:15:07.619338+08:00 2022-12-08 15:15:08.116 INFO 42 --- [pool-ocp-schedules-7,,] o.s.boot.SpringApplication : Started application in 8.053 seconds (JVM running for 1069.416) 2022-12-08 15:15:08.514 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:08.519 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:09.354 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:09.355 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:09.421 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:15:10.342 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:15:10.347 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:10.348 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:10.973 INFO 42 --- [pool-ocp-schedules-7,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:15:10.973+08:00 2022-12-08 15:15:11.162 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:15:11.506 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:11.520 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:11.524 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:12.112 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:15:12.242 INFO 42 --- [pool-ocp-schedules-15,,3f360aabe312] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:15:12.243 INFO 42 --- [pool-ocp-schedules-15,,3f360aabe312] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:15:12.608 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:15:12.614 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:15:13.723 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:14.415 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:15:14.525 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:14.530 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,23f8bd852268] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:15:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,23f8bd852268] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:15:15.555 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:16.056 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:15:16.837 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:16.838 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:17.150 INFO 42 --- [pool-ocp-schedules-19,,e92cb5e4610d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:15:17.403 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:17.531 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:17.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:15:17.538 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:17.596 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:15:17.593829+08:00, lastProcessTime=2022-12-08T15:15:07.619338+08:00 2022-12-08 15:15:17.700 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:15:17.593829+08:00, resultsCount=0 2022-12-08 15:15:17.700 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:15:17.593829+08:00, resultsCount=0 2022-12-08 15:15:17.700 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:15:17.593829+08:00 2022-12-08 15:15:17.726 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:15:17.872 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:15:19.040 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:19.041 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:20.538 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:20.546 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:20.864 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:20.0, nextRun=2022-12-08 15:15:20.0, currentDate=Thu Dec 08 15:15:20 CST 2022 2022-12-08 15:15:20.865 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:14:20.0, nextRunTime=2022-12-08 15:15:20.0} 2022-12-08 15:15:20.883 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:15:20.884 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:20.884 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:21.191 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:15:21.196 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:15:21.440 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 125, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:21.466 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=125, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:15:21.415+08:00, endTime=null} 2022-12-08 15:15:21.557 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:22.185 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:125, status:SUCCESS 2022-12-08 15:15:22.190 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:125, status:SUCCESS 2022-12-08 15:15:22.364 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:22.997 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:23.279 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:15:23.547 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:23.552 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:24.471 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:15:25.190 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:26.0, nextRun=2022-12-08 15:15:25.0, currentDate=Thu Dec 08 15:15:25 CST 2022 2022-12-08 15:15:25.191 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:14:26.0, nextRunTime=2022-12-08 15:15:25.0} 2022-12-08 15:15:25.242 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:15:25.242 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:25.242 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:25.483 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:25.483 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:25.600 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 126, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:25.642 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=126, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:15:25.575+08:00, endTime=null} 2022-12-08 15:15:26.121 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:26.121 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:26.552 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:26.558 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:27.049 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:126, status:SUCCESS 2022-12-08 15:15:27.058 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:126, status:SUCCESS 2022-12-08 15:15:27.152 INFO 42 --- [pool-ocp-schedules-16,,bc596824e3bf] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:15:27.241 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:15:27.469 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:27.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:15:27.608 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:15:27.605163+08:00, lastProcessTime=2022-12-08T15:15:17.593829+08:00 2022-12-08 15:15:27.755 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:15:27.605163+08:00, resultsCount=0 2022-12-08 15:15:27.755 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:15:27.605163+08:00, resultsCount=0 2022-12-08 15:15:27.756 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:15:27.605163+08:00 2022-12-08 15:15:27.823 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:15:27.978 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:15:28.528 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:15:28.534 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:15:29.210 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:29.559 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:29.566 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:30.988 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:31.0, nextRun=2022-12-08 15:15:30.0, currentDate=Thu Dec 08 15:15:30 CST 2022 2022-12-08 15:15:30.989 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:14:31.0, nextRunTime=2022-12-08 15:15:30.0} 2022-12-08 15:15:31.014 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:15:31.136 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:02.0, nextRun=2022-12-08 15:15:30.0, currentDate=Thu Dec 08 15:15:31 CST 2022 2022-12-08 15:15:31.137 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:15:02.0, nextRunTime=2022-12-08 15:15:30.0} 2022-12-08 15:15:31.157 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:15:31.157 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:15:31.158 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:15:31.600 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:31.608 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:31.715 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:15:31.841 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 127, operation:EXECUTE, state: RUNNING 2022-12-08 15:15:31.943 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=127, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:15:31.823+08:00, endTime=null} 2022-12-08 15:15:32.293 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:32.294 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:32.300 INFO 42 --- [pool-ocp-schedules-11,,9f6d560e9d47] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:15:32.301 INFO 42 --- [pool-ocp-schedules-11,,9f6d560e9d47] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:15:32.567 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:32.572 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:33.174 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:127, status:SUCCESS 2022-12-08 15:15:33.182 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:127, status:SUCCESS 2022-12-08 15:15:34.496 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:15:34.710 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:34.711 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:35.572 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:35.579 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:36.942 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:15:36.947 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:15:37.153 INFO 42 --- [pool-ocp-schedules-4,,ee0a91b0227d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:15:37.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:15:37.601 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:15:37.598712+08:00, lastProcessTime=2022-12-08T15:15:27.605163+08:00 2022-12-08 15:15:37.700 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:15:37.598712+08:00, resultsCount=0 2022-12-08 15:15:37.701 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:15:37.598712+08:00, resultsCount=0 2022-12-08 15:15:37.701 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:15:37.598712+08:00 2022-12-08 15:15:37.712 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:37.792 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:37.886 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:15:38.019 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:15:38.442 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:38.576 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:15:38.580 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:38.585 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:39.511 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:15:39.760 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:15:39.775 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=15ms, period=120000ms 2022-12-08 15:15:40.545 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:15:40.911 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:40.912 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:41.194 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:15:41.573 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:41.574 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:41.585 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:41.590 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:41.654 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:42.350 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:15:43.779 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:15:43.789 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:15:44.067 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:44.532 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:15:44.591 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:44.596 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:44.654 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:44.876 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:15:47.004 INFO 42 --- [pool-ocp-schedules-8,,f8023bbb5879] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:15:47.039 INFO 42 --- [pool-ocp-schedules-8,,f8023bbb5879] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:15:47.047 INFO 42 --- [pool-ocp-schedules-14,,182eec49033c] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:15:47.047 INFO 42 --- [pool-ocp-schedules-14,,182eec49033c] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:15:47.059 INFO 42 --- [pool-ocp-schedules-1,,0fdea1eaa104] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:15:47.133 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:47.134 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:47.154 INFO 42 --- [pool-ocp-schedules-10,,316ae9af3c8c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:15:47.324 INFO 42 --- [pool-ocp-schedules-7,,d96de539cc0d] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:15:47.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:15:47.597 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:47.601 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:47.611 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:15:47.608140+08:00, lastProcessTime=2022-12-08T15:15:37.598712+08:00 2022-12-08 15:15:47.698 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:47.699 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:47.736 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:47.736 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:15:47.608140+08:00, resultsCount=0 2022-12-08 15:15:47.736 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:15:47.608140+08:00, resultsCount=0 2022-12-08 15:15:47.736 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:15:47.608140+08:00 2022-12-08 15:15:47.930 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:15:48.060 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:15:48.888 INFO 42 --- [pool-ocp-schedules-20,,c06a68bd5bbe] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:15:49.189 INFO 42 --- [pool-ocp-schedules-16,,5c1ab67808c9] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:15:49.266 INFO 42 --- [pool-ocp-schedules-8,,2b0402759efa] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:15:49.418 INFO 42 --- [pool-ocp-schedules-10,,cf44fb0da6c1] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:15:49.419 INFO 42 --- [pool-ocp-schedules-10,,cf44fb0da6c1] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:15:49.419 INFO 42 --- [pool-ocp-schedules-10,,cf44fb0da6c1] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:15:50.015 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:15:50.038 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:15:50.185 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:50.602 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:50.606 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:50.769 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:51.115 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:15:51.678 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:52.349 INFO 42 --- [pool-ocp-schedules-8,,8a3f27624bf2] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:15:52.350 INFO 42 --- [pool-ocp-schedules-8,,8a3f27624bf2] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:15:53.239 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:53.239 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:53.607 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:53.611 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:53.807 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:15:53.807 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:15:54.565 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:15:56.252 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:15:56.258 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:15:56.612 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:56.617 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:15:56.871 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:15:57.155 INFO 42 --- [pool-ocp-schedules-16,,e201a6064576] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:15:57.384 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:15:57.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:15:57.610 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:15:57.607020+08:00, lastProcessTime=2022-12-08T15:15:47.608140+08:00 2022-12-08 15:15:57.767 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:15:57.607020+08:00, resultsCount=0 2022-12-08 15:15:57.769 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:15:57.607020+08:00, resultsCount=0 2022-12-08 15:15:57.772 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:15:57.607020+08:00 2022-12-08 15:15:57.782 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:15:58.041 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:15:58.128 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:15:59.618 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:15:59.623 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,46d619ee4e1f] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483820, interval=60 2022-12-08 15:16:00.206 INFO 42 --- [pool-prometheus-minute-schedule-2,,46d619ee4e1f] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483760, count=0, elapsed=1668813276446 2022-12-08 15:16:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,2dd821ecc6be] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483820, interval=60 2022-12-08 15:16:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,2dd821ecc6be] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483760, count=0, elapsed=1668813276449 2022-12-08 15:16:00.852 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:14:01.0, nextRun=2022-12-08 15:16:00.0, currentDate=Thu Dec 08 15:16:00 CST 2022 2022-12-08 15:16:00.853 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:14:01.0, nextRunTime=2022-12-08 15:16:00.0} 2022-12-08 15:16:00.874 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:16:00.934 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:01.0, nextRun=2022-12-08 15:16:00.0, currentDate=Thu Dec 08 15:16:00 CST 2022 2022-12-08 15:16:00.935 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:15:01.0, nextRunTime=2022-12-08 15:16:00.0} 2022-12-08 15:16:00.954 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:16:00.955 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:16:00.955 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:16:01.026 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:01.0, nextRun=2022-12-08 15:16:00.0, currentDate=Thu Dec 08 15:16:01 CST 2022 2022-12-08 15:16:01.027 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:15:01.0, nextRunTime=2022-12-08 15:16:00.0} 2022-12-08 15:16:01.049 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:16:01.050 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:16:01.050 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:16:01.092 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:01.0, nextRun=2022-12-08 15:16:00.0, currentDate=Thu Dec 08 15:16:01 CST 2022 2022-12-08 15:16:01.093 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:15:01.0, nextRunTime=2022-12-08 15:16:00.0} 2022-12-08 15:16:01.116 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:16:01.116 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:16:01.116 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:16:01.159 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:31.0, nextRun=2022-12-08 15:16:00.0, currentDate=Thu Dec 08 15:16:01 CST 2022 2022-12-08 15:16:01.159 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:15:31.0, nextRunTime=2022-12-08 15:16:00.0} 2022-12-08 15:16:01.179 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:16:01.179 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:16:01.179 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:16:01.279 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:02.0, nextRun=2022-12-08 15:16:00.0, currentDate=Thu Dec 08 15:16:01 CST 2022 2022-12-08 15:16:01.279 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:15:02.0, nextRunTime=2022-12-08 15:16:00.0} 2022-12-08 15:16:01.298 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:16:01.299 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:16:01.299 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:16:01.409 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 128, operation:EXECUTE, state: RUNNING 2022-12-08 15:16:01.445 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=128, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:16:01.398+08:00, endTime=null} 2022-12-08 15:16:01.509 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 129, operation:EXECUTE, state: RUNNING 2022-12-08 15:16:01.533 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=129, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:16:01.495+08:00, endTime=null} 2022-12-08 15:16:01.616 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 130, operation:EXECUTE, state: RUNNING 2022-12-08 15:16:01.665 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=130, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:16:01.602+08:00, endTime=null} 2022-12-08 15:16:01.708 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:01.750 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 131, operation:EXECUTE, state: RUNNING 2022-12-08 15:16:01.796 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=131, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:16:01.735+08:00, endTime=null} 2022-12-08 15:16:02.624 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:02.630 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:02.683 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:128, status:SUCCESS 2022-12-08 15:16:02.722 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:128, status:SUCCESS 2022-12-08 15:16:02.895 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 132, operation:EXECUTE, state: RUNNING 2022-12-08 15:16:02.966 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:129, status:SUCCESS 2022-12-08 15:16:02.974 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=132, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:16:02.873+08:00, endTime=null} 2022-12-08 15:16:02.974 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:129, status:SUCCESS 2022-12-08 15:16:03.181 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:130, status:SUCCESS 2022-12-08 15:16:03.187 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:130, status:SUCCESS 2022-12-08 15:16:03.317 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:131, status:SUCCESS 2022-12-08 15:16:03.322 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:131, status:SUCCESS 2022-12-08 15:16:04.552 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:132, status:SUCCESS 2022-12-08 15:16:04.558 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:132, status:SUCCESS 2022-12-08 15:16:04.602 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:16:05.108 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:06.0, nextRun=2022-12-08 15:16:05.0, currentDate=Thu Dec 08 15:16:05 CST 2022 2022-12-08 15:16:05.109 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:15:06.0, nextRunTime=2022-12-08 15:16:05.0} 2022-12-08 15:16:05.127 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:16:05.128 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:16:05.128 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:16:05.630 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:05.637 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:06.069 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 133, operation:EXECUTE, state: RUNNING 2022-12-08 15:16:06.096 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=133, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:16:06.058+08:00, endTime=null} 2022-12-08 15:16:06.430 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:16:06.894 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:133, status:SUCCESS 2022-12-08 15:16:06.900 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:133, status:SUCCESS 2022-12-08 15:16:07.157 INFO 42 --- [pool-ocp-schedules-13,,bd0c4529dfc7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:16:07.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:16:07.597 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:16:07.594437+08:00, lastProcessTime=2022-12-08T15:15:57.607020+08:00 2022-12-08 15:16:07.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:16:07.594437+08:00, resultsCount=0 2022-12-08 15:16:07.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:16:07.594437+08:00, resultsCount=0 2022-12-08 15:16:07.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:16:07.594437+08:00 2022-12-08 15:16:07.836 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:08.090 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:16:08.170 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:16:08.638 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:08.642 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:09.540 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:16:10.584 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:16:11.248 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:16:11.643 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:11.655 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:11.678 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:16:11.691 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:16:11.766 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:12.202 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:12.412 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:16:12.412 INFO 42 --- [pool-ocp-schedules-8,,e77010f857ff] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:16:12.413 INFO 42 --- [pool-ocp-schedules-8,,e77010f857ff] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:16:14.627 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:16:14.656 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:14.661 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:14.696 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:14.803 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:16:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,4d207800286e] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:16:15.213 INFO 42 --- [pool-prometheus-cache-monitor1,,4d207800286e] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:16:15.284 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:15.284 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:17.158 INFO 42 --- [pool-ocp-schedules-8,,7101bf1ead44] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:16:17.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:16:17.597 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:16:17.594060+08:00, lastProcessTime=2022-12-08T15:16:07.594437+08:00 2022-12-08 15:16:17.662 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:17.668 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:17.715 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:16:17.594060+08:00, resultsCount=0 2022-12-08 15:16:17.715 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:16:17.594060+08:00, resultsCount=0 2022-12-08 15:16:17.716 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:16:17.594060+08:00 2022-12-08 15:16:17.749 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:17.750 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:17.871 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:18.119 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:16:18.214 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:16:18.542 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:12:18.227, end=2022-12-08T15:14:18.504} 2022-12-08 15:16:18.572 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:16:19.949 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:16:19.954 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:16:20.669 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:20.674 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:20.819 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:20.872 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:21.0, nextRun=2022-12-08 15:16:20.0, currentDate=Thu Dec 08 15:16:20 CST 2022 2022-12-08 15:16:20.873 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:15:21.0, nextRunTime=2022-12-08 15:16:20.0} 2022-12-08 15:16:20.899 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:16:20.900 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:16:20.900 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:16:21.353 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 134, operation:EXECUTE, state: RUNNING 2022-12-08 15:16:21.399 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:21.411 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=134, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:16:21.335+08:00, endTime=null} 2022-12-08 15:16:21.559 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:16:21.793 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:22.719 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:134, status:SUCCESS 2022-12-08 15:16:22.726 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:134, status:SUCCESS 2022-12-08 15:16:23.674 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:23.679 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:23.897 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:23.897 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:24.452 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:24.452 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:24.686 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:16:26.303 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:25.0, nextRun=2022-12-08 15:16:25.0, currentDate=Thu Dec 08 15:16:26 CST 2022 2022-12-08 15:16:26.304 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:15:25.0, nextRunTime=2022-12-08 15:16:25.0} 2022-12-08 15:16:26.361 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:16:26.363 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:16:26.363 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:16:26.541 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 135, operation:EXECUTE, state: RUNNING 2022-12-08 15:16:26.643 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=135, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:16:26.525+08:00, endTime=null} 2022-12-08 15:16:26.680 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:26.685 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:26.699 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:16:26.706 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:16:26.944 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:27.160 INFO 42 --- [pool-ocp-schedules-18,,0ca3efc039c6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:16:27.481 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:16:27.521 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:135, status:SUCCESS 2022-12-08 15:16:27.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:16:27.541 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:135, status:SUCCESS 2022-12-08 15:16:27.558 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:27.609 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:16:27.605718+08:00, lastProcessTime=2022-12-08T15:16:17.594060+08:00 2022-12-08 15:16:27.713 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:16:27.605718+08:00, resultsCount=0 2022-12-08 15:16:27.713 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:16:27.605718+08:00, resultsCount=0 2022-12-08 15:16:27.713 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:16:27.605718+08:00 2022-12-08 15:16:27.800 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:16:27.909 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:28.239 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:16:28.268 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:16:29.685 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:29.690 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:30.036 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:30.036 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:30.337 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:31.0, nextRun=2022-12-08 15:16:30.0, currentDate=Thu Dec 08 15:16:30 CST 2022 2022-12-08 15:16:30.338 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:15:31.0, nextRunTime=2022-12-08 15:16:30.0} 2022-12-08 15:16:30.367 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:16:30.491 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:01.0, nextRun=2022-12-08 15:16:30.0, currentDate=Thu Dec 08 15:16:30 CST 2022 2022-12-08 15:16:30.492 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:16:01.0, nextRunTime=2022-12-08 15:16:30.0} 2022-12-08 15:16:30.512 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:16:30.513 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:16:30.513 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:16:30.615 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:30.616 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:30.759 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 136, operation:EXECUTE, state: RUNNING 2022-12-08 15:16:30.903 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=136, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:16:30.744+08:00, endTime=null} 2022-12-08 15:16:31.821 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:32.367 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:136, status:SUCCESS 2022-12-08 15:16:32.380 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:136, status:SUCCESS 2022-12-08 15:16:32.468 INFO 42 --- [pool-ocp-schedules-19,,2d662d2ccd96] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:16:32.468 INFO 42 --- [pool-ocp-schedules-19,,2d662d2ccd96] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:16:32.691 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:32.696 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:32.985 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:16:33.000 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:16:33.133 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:33.871 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:34.175 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:16:34.825 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:16:35.697 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:35.703 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:36.206 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:36.206 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:36.966 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:36.966 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:37.161 INFO 42 --- [pool-ocp-schedules-5,,c858c1b4a9e0] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:16:37.538 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:16:37.620 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:16:37.615543+08:00, lastProcessTime=2022-12-08T15:16:27.605718+08:00 2022-12-08 15:16:37.746 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:16:37.615543+08:00, resultsCount=0 2022-12-08 15:16:37.747 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:16:37.615543+08:00, resultsCount=0 2022-12-08 15:16:37.747 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:16:37.615543+08:00 2022-12-08 15:16:37.964 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:38.277 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:16:38.324 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:16:38.704 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:38.708 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:39.404 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:16:39.410 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:16:39.589 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:16:40.043 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:40.661 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:16:41.270 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:16:41.709 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:41.714 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:41.843 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:42.367 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:42.524 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:16:42.545 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:16:43.169 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:43.170 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:44.715 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:44.720 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:44.848 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:16:45.437 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:45.437 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:47.003 INFO 42 --- [pool-ocp-schedules-2,,94dbc9b9d385] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:16:47.038 INFO 42 --- [pool-ocp-schedules-2,,94dbc9b9d385] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:16:47.060 INFO 42 --- [pool-ocp-schedules-19,,97c05b77bd5b] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:16:47.162 INFO 42 --- [pool-ocp-schedules-3,,4ccf9b37e447] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:16:47.346 INFO 42 --- [pool-ocp-schedules-16,,ff31e5d3d389] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:16:47.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:16:47.605 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:16:47.602044+08:00, lastProcessTime=2022-12-08T15:16:37.615543+08:00 2022-12-08 15:16:47.720 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:47.727 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:47.779 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:16:47.602044+08:00, resultsCount=0 2022-12-08 15:16:47.780 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:16:47.602044+08:00, resultsCount=0 2022-12-08 15:16:47.780 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:16:47.602044+08:00 2022-12-08 15:16:47.799 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:16:47.820 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:16:47.988 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:48.321 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:16:48.382 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:16:48.515 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:48.942 INFO 42 --- [pool-ocp-schedules-8,,39abf6a63a99] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:16:49.286 INFO 42 --- [pool-ocp-schedules-9,,2817fbb01877] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:16:49.306 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:49.365 INFO 42 --- [pool-ocp-schedules-19,,8c01b09b49b1] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:16:49.503 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:16:49.503 INFO 42 --- [pool-ocp-schedules-7,,aa8bc6766a9d] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:16:49.504 INFO 42 --- [pool-ocp-schedules-7,,aa8bc6766a9d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:16:49.504 INFO 42 --- [pool-ocp-schedules-7,,aa8bc6766a9d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:16:50.727 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:50.731 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:51.703 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:51.703 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:51.961 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:52.375 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:52.376 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:52.524 INFO 42 --- [pool-ocp-schedules-10,,0fa0d29866bc] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:16:52.525 INFO 42 --- [pool-ocp-schedules-10,,0fa0d29866bc] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:16:53.732 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:53.739 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:54.665 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:16:54.671 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:16:54.754 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:54.911 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:16:55.461 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:16:55.742 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:16:56.740 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:56.745 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:16:57.163 INFO 42 --- [pool-ocp-schedules-5,,6d4fa04991b3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:16:57.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:16:57.604 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:16:57.601701+08:00, lastProcessTime=2022-12-08T15:16:47.602044+08:00 2022-12-08 15:16:57.651 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:16:57.727 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:16:57.601701+08:00, resultsCount=0 2022-12-08 15:16:57.728 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:16:57.601701+08:00, resultsCount=0 2022-12-08 15:16:57.728 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:16:57.601701+08:00 2022-12-08 15:16:57.862 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:57.862 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:58.064 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:16:58.393 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:16:58.483 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:16:58.527 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:16:58.527 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:16:59.746 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:16:59.751 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,61c696662429] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483880, interval=60 2022-12-08 15:17:00.205 INFO 42 --- [pool-prometheus-minute-schedule-2,,61c696662429] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483820, count=0, elapsed=1668813336385 2022-12-08 15:17:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,0517d70a880e] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670483880, interval=60 2022-12-08 15:17:00.209 INFO 42 --- [pool-prometheus-minute-schedule-1,,0517d70a880e] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670483820, count=0, elapsed=1668813336389 2022-12-08 15:17:00.992 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:17:00.997 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:17:01.166 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:01.0, nextRun=2022-12-08 15:17:00.0, currentDate=Thu Dec 08 15:17:01 CST 2022 2022-12-08 15:17:01.167 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:16:01.0, nextRunTime=2022-12-08 15:17:00.0} 2022-12-08 15:17:01.190 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:17:01.190 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:17:01.191 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:17:01.309 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:01.0, nextRun=2022-12-08 15:17:00.0, currentDate=Thu Dec 08 15:17:01 CST 2022 2022-12-08 15:17:01.310 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:16:01.0, nextRunTime=2022-12-08 15:17:00.0} 2022-12-08 15:17:01.348 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:17:01.349 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:17:01.349 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:17:01.405 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:01.0, nextRun=2022-12-08 15:17:00.0, currentDate=Thu Dec 08 15:17:01 CST 2022 2022-12-08 15:17:01.406 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:16:01.0, nextRunTime=2022-12-08 15:17:00.0} 2022-12-08 15:17:01.436 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:17:01.436 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:17:01.437 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:17:01.538 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:30.0, nextRun=2022-12-08 15:17:00.0, currentDate=Thu Dec 08 15:17:01 CST 2022 2022-12-08 15:17:01.539 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:16:30.0, nextRunTime=2022-12-08 15:17:00.0} 2022-12-08 15:17:01.555 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:17:01.556 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:17:01.556 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:17:01.597 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:17:01.624 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:01.0, nextRun=2022-12-08 15:17:00.0, currentDate=Thu Dec 08 15:17:01 CST 2022 2022-12-08 15:17:01.625 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:16:01.0, nextRunTime=2022-12-08 15:17:00.0} 2022-12-08 15:17:01.644 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:17:01.644 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:17:01.645 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:17:01.999 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:17:02.346 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 137, operation:EXECUTE, state: RUNNING 2022-12-08 15:17:02.523 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=137, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:17:02.333+08:00, endTime=null} 2022-12-08 15:17:02.582 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 138, operation:EXECUTE, state: RUNNING 2022-12-08 15:17:02.718 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=138, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:17:02.571+08:00, endTime=null} 2022-12-08 15:17:02.752 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:17:02.756 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:02.789 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 139, operation:EXECUTE, state: RUNNING 2022-12-08 15:17:02.834 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=139, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:17:02.776+08:00, endTime=null} 2022-12-08 15:17:02.962 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 140, operation:EXECUTE, state: RUNNING 2022-12-08 15:17:03.025 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=140, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:17:02.943+08:00, endTime=null} 2022-12-08 15:17:03.123 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:137, status:SUCCESS 2022-12-08 15:17:03.132 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:137, status:SUCCESS 2022-12-08 15:17:03.140 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 141, operation:EXECUTE, state: RUNNING 2022-12-08 15:17:03.199 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=141, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:17:03.125+08:00, endTime=null} 2022-12-08 15:17:03.985 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:17:04.118 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:17:04.514 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:138, status:SUCCESS 2022-12-08 15:17:04.528 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:138, status:SUCCESS 2022-12-08 15:17:04.725 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:17:04.726 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:17:04.788 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:139, status:SUCCESS 2022-12-08 15:17:04.793 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:139, status:SUCCESS 2022-12-08 15:17:04.910 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:140, status:SUCCESS 2022-12-08 15:17:04.916 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:140, status:SUCCESS 2022-12-08 15:17:04.947 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:17:05.007 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:141, status:SUCCESS 2022-12-08 15:17:05.014 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:141, status:SUCCESS 2022-12-08 15:17:05.658 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:05.0, nextRun=2022-12-08 15:17:05.0, currentDate=Thu Dec 08 15:17:05 CST 2022 2022-12-08 15:17:05.658 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:16:05.0, nextRunTime=2022-12-08 15:17:05.0} 2022-12-08 15:17:05.677 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:17:05.678 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:17:05.678 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:17:05.756 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:17:05.760 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:06.311 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 142, operation:EXECUTE, state: RUNNING 2022-12-08 15:17:06.394 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=142, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:17:06.299+08:00, endTime=null} 2022-12-08 15:17:07.036 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:17:07.036 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:17:07.165 INFO 42 --- [pool-ocp-schedules-15,,e6e0e33a349f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:17:07.314 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:142, status:SUCCESS 2022-12-08 15:17:07.320 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:142, status:SUCCESS 2022-12-08 15:17:07.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:17:07.598 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:17:07.595598+08:00, lastProcessTime=2022-12-08T15:16:57.601701+08:00 2022-12-08 15:17:07.738 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:17:07.595598+08:00, resultsCount=0 2022-12-08 15:17:07.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:17:07.595598+08:00, resultsCount=0 2022-12-08 15:17:07.739 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:17:07.595598+08:00 2022-12-08 15:17:08.111 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:17:08.526 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:17:08.559 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:17:08.761 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:17:08.765 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:09.270 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:17:09.276 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:17:09.627 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:17:10.124 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:17:10.724 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:17:10.931 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:17:11.369 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:17:11.389 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:17:11.766 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:17:11.771 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:12.075 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:17:12.682 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:17:12.731 INFO 42 --- [pool-ocp-schedules-12,,8cd2ab2f3fdc] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:17:12.731 INFO 42 --- [pool-ocp-schedules-12,,8cd2ab2f3fdc] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:17:13.191 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:17:13.192 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:17:14.070 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:17:14.071 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:17:14.771 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:17:14.777 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:15.006 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:17:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,c860ac6257e7] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:17:15.212 INFO 42 --- [pool-prometheus-cache-monitor1,,c860ac6257e7] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:17:16.588 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:17:16.596 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:17:17.166 INFO 42 --- [pool-ocp-schedules-10,,d4354aaa7b42] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:17:17.216 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:17:17.534 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:17:17.597 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:17:17.594429+08:00, lastProcessTime=2022-12-08T15:17:07.595598+08:00 2022-12-08 15:17:17.712 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:17:17.594429+08:00, resultsCount=0 2022-12-08 15:17:17.712 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:17:17.594429+08:00, resultsCount=0 2022-12-08 15:17:17.713 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:17:17.594429+08:00 2022-12-08 15:17:17.778 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:17:17.783 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:18.138 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:17:18.723 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:17:18.726 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:17:19.370 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:17:19.724 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:17:20.272 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:17:20.272 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:17:20.722 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:21.0, nextRun=2022-12-08 15:17:20.0, currentDate=Thu Dec 08 15:17:20 CST 2022 2022-12-08 15:17:20.722 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:16:21.0, nextRunTime=2022-12-08 15:17:20.0} 2022-12-08 15:17:20.747 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:17:20.747 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:17:20.748 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:17:20.786 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:17:20.791 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:21.714 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 143, operation:EXECUTE, state: RUNNING 2022-12-08 15:17:21.969 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=143, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:17:21.674+08:00, endTime=null} 2022-12-08 15:17:22.130 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:17:22.463 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:17:22.464 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:17:22.919 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:143, status:SUCCESS 2022-12-08 15:17:22.926 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:143, status:SUCCESS 2022-12-08 15:17:23.791 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:17:23.795 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:24.891 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:17:24.900 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:17:25.121 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:17:25.597 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:17:26.186 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:26.0, nextRun=2022-12-08 15:17:25.0, currentDate=Thu Dec 08 15:17:26 CST 2022 2022-12-08 15:17:26.187 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:16:26.0, nextRunTime=2022-12-08 15:17:25.0} 2022-12-08 15:17:26.227 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:17:26.228 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:17:26.228 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:17:26.488 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:17:26.796 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:17:26.801 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:26.990 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:17:27.101 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 144, operation:EXECUTE, state: RUNNING 2022-12-08 15:17:27.131 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=144, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:17:27.088+08:00, endTime=null} 2022-12-08 15:17:27.167 INFO 42 --- [pool-ocp-schedules-6,,85d161e1c454] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:17:27.533 INFO 42 --- [alarm-task-1,,4a0f8bf527c3] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:17:27.601 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:17:27.597315+08:00, lastProcessTime=2022-12-08T15:17:17.594429+08:00 2022-12-08 15:17:27.718 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:17:27.597315+08:00, resultsCount=0 2022-12-08 15:17:27.718 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:17:27.597315+08:00, resultsCount=0 2022-12-08 15:17:27.719 INFO 42 --- [alarm-task-2,,88d62afccad4] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:17:27.597315+08:00 2022-12-08 15:17:27.761 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:17:27.970 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:144, status:SUCCESS 2022-12-08 15:17:27.976 INFO 42 --- [pool-task-coordinator1,d267e73849fc4df0,702a1b21af87] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:144, status:SUCCESS 2022-12-08 15:17:28.182 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:17:28.649 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:17:28.650 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:17:28.775 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:17:28.814 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:17:29.743 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:17:29.744 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:17:29.802 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:17:29.807 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:17:30.483 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:30.0, nextRun=2022-12-08 15:17:30.0, currentDate=Thu Dec 08 15:17:30 CST 2022 2022-12-08 15:17:30.483 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:16:30.0, nextRunTime=2022-12-08 15:17:30.0} 2022-12-08 15:17:30.512 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:17:30.607 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:17:02.0, nextRun=2022-12-08 15:17:30.0, currentDate=Thu Dec 08 15:17:30 CST 2022 2022-12-08 15:17:30.608 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:17:02.0, nextRunTime=2022-12-08 15:17:30.0} 2022-12-08 15:17:30.630 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:17:30.630 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:17:30.631 INFO 42 --- [pool-task-coordinator2,f66f560e2d9d4b5c,113378147a46] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:17:31.244 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 145, operation:EXECUTE, state: RUNNING 2022-12-08 15:17:31.440 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=145, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:17:31.232+08:00, endTime=null} 2022-12-08 15:17:32.181 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:17:32.185 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:17:32.187 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE Run in container Total memory is 8388608KB Starting ocp-server: /usr/lib/jvm/java-1.8.0/bin/java -server -XX:+UseG1GC -Xms5734m -Xmx5734m -Xss512k -XX:+PrintCommandLineFlags -XX:MetaspaceSize=1024m -XX:MaxMetaspaceSize=1024m -XX:+PrintAdaptiveSizePolicy -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -Xloggc:/home/admin/ocp-server/bin/../log/gc.log -XX:+UseGCLogFileRotation -XX:GCLogFileSize=50M -XX:NumberOfGCLogFiles=2 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -Dfile.encoding=UTF-8 -jar /home/admin/ocp-server/bin/../lib/ocp-server-4.0.0-20220930.jar -XX:CompressedClassSpaceSize=1065353216 -XX:ErrorFile=/home/admin/ocp-server/bin/../log/hs_err_pid%p.log -XX:GCLogFileSize=52428800 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/ocp-server/bin/../log/ -XX:InitialHeapSize=6012534784 -XX:MaxHeapSize=6012534784 -XX:MaxMetaspaceSize=1073741824 -XX:MetaspaceSize=1073741824 -XX:NumberOfGCLogFiles=2 -XX:+PrintAdaptiveSizePolicy -XX:+PrintCommandLineFlags -XX:+PrintGC -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ThreadStackSize=512 -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseGCLogFileRotation ___ ___ / _ \ __ ___ __ _ _ _ | _ ) __ _ ___ ___ | (_) | / _| / -_) / _` | | ' \ | _ \ / _` | (_-< / -_) \___/ \__| \___| \__,_| |_||_| |___/ \__,_| /__/ \___| :: Spring Boot :: (v2.3.9.RELEASE) :: OCP Server :: (v4.0.0-20220930) 2022-12-08 15:20:26.909 INFO 42 --- [ main] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:20:28.365 INFO 42 --- [ main] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:20:28.802 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : The following profiles are active: composite,default 2022-12-08 15:20:57.253 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 15:20:58.662 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 1305ms. Found 3 JPA repository interfaces. 2022-12-08 15:20:58.744 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 15:21:00.783 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 2037ms. Found 16 JPA repository interfaces. 2022-12-08 15:21:00.788 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2022-12-08 15:21:16.170 INFO 42 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 15380ms. Found 99 JPA repository interfaces. 2022-12-08 15:21:24.404 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmEventHistoryRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmEventHistoryRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:24.406 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmGroupAlarmTypeRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmGroupAlarmTypeRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:24.407 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmDetectRuleRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmDetectRuleRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:24.408 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'ocpAlarmMetricMetaRepository' and 'com.alipay.ocp.core.metadb.alarm.OcpAlarmMetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:24.890 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricGroupRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricGroupRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:24.892 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricObCollectConfigRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricObCollectConfigRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:24.892 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricClassRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricClassRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:24.893 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'metricMetaRepository' and 'com.alipay.ocp.core.metadb.monitor.MetricMetaRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:25.471 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'sqlAggregateDataRepository' and 'com.alipay.ocp.core.monitordb.alarm.SqlAggregateDataRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:25.472 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obClusterSystemEventRepository' and 'com.alipay.ocp.core.monitordb.ob.ObClusterSystemEventRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:25.473 WARN 42 --- [main,,] o.m.s.mapper.ClassPathMapperScanner : Skipping MapperFactoryBean with name 'obTenantMiniCompactionRepository' and 'com.alipay.ocp.core.monitordb.ob.ObTenantMiniCompactionRepository' mapperInterface. Bean already defined with the same name! 2022-12-08 15:21:26.940 INFO 42 --- [main,,] o.s.cloud.context.scope.GenericScope : BeanFactory id=22bf410e-9c42-33ee-903b-47d732131f72 2022-12-08 15:21:30.530 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler@441cc260' of type [org.springframework.security.access.expression.method.DefaultMethodSecurityExpressionHandler] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 15:21:30.557 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'localSecurityConfiguration.MethodSecurityConfiguration' of type [com.alipay.ocp.server.config.security.LocalSecurityConfiguration$MethodSecurityConfiguration$$EnhancerBySpringCGLIB$$2f89de64] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 15:21:30.717 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Method-level access control enabled. 2022-12-08 15:21:30.736 INFO 42 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'methodSecurityMetadataSource' of type [org.springframework.security.access.method.DelegatingMethodSecurityMetadataSource] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2022-12-08 15:21:36.704 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 15:21:38.188 INFO 42 --- [main,,] org.hibernate.Version : HHH000412: Hibernate ORM core version 5.4.28.Final 2022-12-08 15:21:40.872 INFO 42 --- [main,,] o.hibernate.annotations.common.Version : HCANN000001: Hibernate Commons Annotations {5.1.2.Final} 2022-12-08 15:21:51.811 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-1,metadb-connect-pool} inited 2022-12-08 15:21:52.160 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 15:21:56.357 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 15:21:56.360 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 15:21:56.361 WARN 42 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2022-12-08 15:21:59.077 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000038: Composite-id class does not override equals(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 15:21:59.079 WARN 42 --- [main,,] org.hibernate.mapping.RootClass : HHH000039: Composite-id class does not override hashCode(): com.alipay.ocp.core.metadb.iam.jdbcsession.SpringJdbcSessionAttributeKey 2022-12-08 15:22:13.761 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 15:22:13.975 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 15:22:24.183 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8080 (http) 2022-12-08 15:22:24.301 INFO 42 --- [main,,] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2022-12-08 15:22:24.303 INFO 42 --- [main,,] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.43] 2022-12-08 15:22:25.134 INFO 42 --- [main,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2022-12-08 15:22:25.135 INFO 42 --- [main,,] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 116088 ms 2022-12-08 15:22:36.825 INFO 42 --- [main,,] c.a.o.service.maz.OcpMultiAzoneService : OCP multi-azone not enabled 2022-12-08 15:22:36.841 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set username=monitor_user@monitor_tenant#obcluster 2022-12-08 15:22:36.843 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set url=jdbc:oceanbase://192.168.28.54:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true 2022-12-08 15:22:36.844 INFO 42 --- [main,,] .a.o.s.c.m.MonitorDruidDataSourceWrapper : set driver class=com.oceanbase.jdbc.Driver 2022-12-08 15:22:37.036 INFO 42 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2022-12-08 15:22:40.770 INFO 42 --- [main,,] com.alibaba.druid.pool.DruidDataSource : {dataSource-2,monitordb-connect-pool} inited 2022-12-08 15:22:40.773 INFO 42 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2022-12-08 15:22:42.978 INFO 42 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2022-12-08 15:22:42.981 INFO 42 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2022-12-08 15:22:44.257 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/meta 2022-12-08 15:22:45.316 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Finish migration, location=migration/meta 2022-12-08 15:22:45.317 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Start migration, location=migration/monitor 2022-12-08 15:22:45.320 INFO 42 --- [main,,] com.alipay.ocp.core.util.ResourceUtils : Cannot find any file in location: migration/monitor 2022-12-08 15:22:45.320 INFO 42 --- [main,,] c.a.o.s.initializer.DatabaseInitializer : Migration schemas is empty. 2022-12-08 15:23:30.088 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 24609 ms to scan 31 urls, producing 672 keys and 5542 values 2022-12-08 15:23:53.028 INFO 42 --- [main,,] org.reflections.Reflections : Reflections took 22504 ms to scan 31 urls, producing 73 keys and 4708 values 2022-12-08 15:23:53.140 INFO 42 --- [main,,] c.a.o.server.analyzer.OcpStartUpChecker : audit event is disable 2022-12-08 15:23:56.443 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : ocp-monitor bean configuration done 2022-12-08 15:24:03.897 INFO 42 --- [main,,] c.a.ocp.server.config.BeanConfiguration : begin set auto discover false. 2022-12-08 15:24:03.933 INFO 42 --- [main,,] c.a.ocp.server.config.BeanConfiguration : set auto discover false success. 2022-12-08 15:24:07.192 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Validate and set keys, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC9ZsS5KksUJGjKg1TOSL/wcbPhEUAQRPd8JJBqMjjMBOs8ebvjZOC8+VUlGQjefiv7yZPjlEwkVwIzBJ7sc2fO26AY+n19SqGgsrpd29SJFTkVLefKBhJ6A0GcF4gbcE6Zc8XmpiTY13qeY+4vKst8bkFQMh2Cz43JP1iiq9+dpwIDAQAB, valid=true 2022-12-08 15:24:07.194 INFO 42 --- [main,,] c.a.o.service.iam.user.LoginKeyService : Login key is legal. 2022-12-08 15:24:08.511 INFO 42 --- [main,,] c.a.o.s.s.operator.LocalFileOperator : FileStorageService init, fileDirPath=/home/admin/data/files 2022-12-08 15:24:16.273 INFO 42 --- [main,,] com.alipay.ocp.core.util.BeanUtils : BeanUtils initialized 2022-12-08 15:24:18.899 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:24:18.904 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:24:20.426 INFO 42 --- [main,,] c.a.o.s.a.c.AlarmConfigurationManager : defaultTimeZone not set, use system default, zoneId=Asia/Shanghai 2022-12-08 15:24:21.455 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_daily, createTime=1670483067 2022-12-08 15:24:21.537 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_hour, createTime=1670483062 2022-12-08 15:24:21.617 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_second, createTime=1670483026 2022-12-08 15:24:26.896 INFO 42 --- [main,,] c.a.o.s.a.core.silence.GlobalSilencer : enabled alarm types changed, previous=, current=ob_server_sstable_percent_over_threshold,ob_host_task_timeout,ob_tenant_long_trans_exist,ob_host_net_send_percent_over_threshold,host_agent_goroutine_count_over_threshold,backup_storage_capacity_over_threshold,os_tsar_traffic_drop,tenant_active_memstore_percent_over_threshold,ob_host_data_disk_percent_over_threshold,os_tsar_cpu_util_full,tenant_cpu_percent_over_threshold,ob_tenant_exists_expired_xa_trans,monitor_exporter_unavaliable,ob_tenant_compaction_error,os_tsar_cpu_util_hwm,ob_cluster_exists_inactive_server,os_tsar_traffic_error,ob_host_load1_per_cpu_over_threshold,ob_cluster_operation_info,ob_cluster_frozen_version_delta_over_threshold,ob_cluster_merge_error,no_enough_exporter,backup_storage_capacity_timeout_or_interrupted,ob_tenant_large_trans_exist,inc_backup_delay,host_unavailable,ob_host_mem_percent_over_threshold,os_observer_not_exist,system_obproxy_unavailable,ocp_remote_server_time_diff_too_large,host_ntp_service_not_exist,ob_tenant_expired_trans_exist,host_disk_readonly,node_file_root_usage,os_kernel_io_hang,ob_tenant_task_timeout,same_alarm_rule_detect_too_many_targets,os_tsar_sda_ioawait,ob_log_alarm,os_tsar_traffic_overload,ob_cluster_sync_delay_time_too_long,os_tsar_nvme_ioawait,tenant_memstore_percent_over_threshold,ob_cluster_merge_timeout,ob_zone_sstable_percent_over_threshold,obproxy_cannot_connected,partition_create_failed,node_file_inode_usage,obproxy_process_dead,ob_cluster_rs_not_same,os_tsar_cpu_sys_abnormal,ob_cluster_exists_index_fail_table,ob_tenant_operation_info,host_ntp_offset_too_large,os_nic_1000m_hwm,ob_cluster_no_frozen,ob_host_cpu_percent_over_threshold,ob_cpu_percent_over_threshold,base_backup_too_long_time_no_one_success_task,oms_migrate_delay_over_threshold,vpc_connect_failed,ob_host_disk_readonly,ob_host_net_recv_percent_over_threshold,os_cpu_irq_error,ob_host_connection_percent_over_threshold,ob_cluster_status_check_failed,ocp_local_obproxy_proxyro_user_password_not_same,ob_tenant_no_compaction,host_agent_res_memory_over_threshold,host_agent_open_fd_count_over_threshold,ob_cluster_no_merge,backup_storage_capacity_retry_times_exceeded,obproxyd_process_dead,ob_tenant_log_disk_usage_high,ob_cluster_sync_failed,ob_tenant_no_frozen,ob_tenant500_mem_hold_over_threshold,os_observer_fd_usage,backup_process_dead,ob_cannot_connected,ob_host_tcp_retrans_percent_over_threshold,ob_host_log_disk_percent_over_threshold,ob_host_install_disk_percent_over_threshold,ic_server_connect_failed,os_nic_1000m_full,ob_tenant500_mem_hold_percent_over_threshold,base_backup_fail,os_observer_core_dump,ob_cluster_inspection_not_passed,obagent_dead,ob_host_partition_count_over_threshold 2022-12-08 15:24:28.306 INFO 42 --- [main,,] c.a.o.c.t.e.coordinator.TaskCoordinator : Start task coordinator 2022-12-08 15:24:31.989 INFO 42 --- [main,,] c.a.o.s.a.service.OcpAlarmSearchService : total load alarm history size: 0 2022-12-08 15:24:31.990 INFO 42 --- [main,,] c.a.o.s.a.service.OcpAlarmSearchService : init alarm search done 2022-12-08 15:24:37.096 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2022-12-08 15:24:37.293 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2022-12-08 15:24:37.358 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 15:24:37.385 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 15:24:37.985 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2022-12-08 15:24:38.097 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2022-12-08 15:24:38.116 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 15:24:38.127 INFO 42 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2022-12-08 15:24:38.132 INFO 42 --- [main,,] c.o.o.b.i.c.BackupConfiguration : init backup agent meta cfg 2022-12-08 15:24:38.421 INFO 42 --- [main,,] c.a.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key global_lock_com.oceanbase.ocp.backup.internal.task.backupocptaskmanager 2022-12-08 15:24:38.447 INFO 42 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : upgradeFromOldAgentToNewService start. 2022-12-08 15:24:38.470 INFO 42 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : serviceInfos=[], allMachineList=[] 2022-12-08 15:24:38.518 INFO 42 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : register backup schedules success 2022-12-08 15:24:42.599 INFO 42 --- [main,,] .a.o.s.m.c.MonitorDataRolloverProperties : Monitor retention conf is {ob_cluster_system_event=31, ocp_metric_data_1=8, ocp_metric_data_60=31, metric_hour_data=1098, metric_daily_data=1098} 2022-12-08 15:24:43.064 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Metadb, table=profile_credential_sharing 2022-12-08 15:24:43.066 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_cluster_system_event 2022-12-08 15:24:43.066 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_1 2022-12-08 15:24:43.067 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_60 2022-12-08 15:24:43.068 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_hour_data 2022-12-08 15:24:43.069 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_daily_data 2022-12-08 15:24:43.069 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_second 2022-12-08 15:24:43.070 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_minute 2022-12-08 15:24:43.071 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_hour 2022-12-08 15:24:43.072 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_daily 2022-12-08 15:24:43.073 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=sql_aggregate_data 2022-12-08 15:24:43.074 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_partition_stats_compressed 2022-12-08 15:24:43.074 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_tenant_mini_compaction_info 2022-12-08 15:24:43.075 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_0 2022-12-08 15:24:43.076 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_1 2022-12-08 15:24:43.077 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_2 2022-12-08 15:24:43.077 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat 2022-12-08 15:24:43.078 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sqltext 2022-12-08 15:24:43.079 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0 2022-12-08 15:24:43.080 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan 2022-12-08 15:24:43.080 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_explain 2022-12-08 15:24:43.081 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_sample 2022-12-08 15:24:43.082 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis_task 2022-12-08 15:24:43.082 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis 2022-12-08 15:24:43.083 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_active_session_stat_0 2022-12-08 15:24:43.084 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_snapshot 2022-12-08 15:24:43.084 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cluster 2022-12-08 15:24:43.085 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_tenant 2022-12-08 15:24:43.086 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_server 2022-12-08 15:24:43.086 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_replica 2022-12-08 15:24:43.087 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sysstat 2022-12-08 15:24:43.088 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_row_lock 2022-12-08 15:24:43.088 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_latch 2022-12-08 15:24:43.089 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cache 2022-12-08 15:24:43.090 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_parameter 2022-12-08 15:24:43.091 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_rpc 2022-12-08 15:24:43.091 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_packet 2022-12-08 15:24:43.092 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_clog 2022-12-08 15:24:43.092 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_location_cache 2022-12-08 15:24:43.093 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_gts 2022-12-08 15:24:43.093 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_system_event 2022-12-08 15:24:43.094 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_plan_monitor 2022-12-08 15:24:43.095 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_trans_stat_0 2022-12-08 15:24:43.113 INFO 42 --- [main,,] c.a.o.s.p.PartitionRolloverService : [OCP167004] Submitting initial worker 2022-12-08 15:24:43.272 INFO 42 --- [main,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService updater scheduler started on 192.168.28.62:8080 2022-12-08 15:24:43.322 INFO 42 --- [main,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : Init, apiConnectTimeoutMillis:1000, apiReadTimeoutMillis:1000, taskSchedulePeriodSec:3 2022-12-08 15:24:43.956 WARN 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : Error state, the follower found itself leader. 2022-12-08 15:24:43.957 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2022-12-08 15:24:44.664 INFO 42 --- [main,,] c.a.o.s.m.MonitorBeanConfiguration : Table name=metric_data_minute, createTime=1670483058 2022-12-08 15:24:44.936 INFO 42 --- [main,,] c.o.o.b.i.m.s.StorageExporterServiceImpl : collectEnabled=true,periodMinutes=180, register backup exporter. 2022-12-08 15:24:45.288 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : scheduleEnabled=true 2022-12-08 15:24:45.342 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : initialize global tasks done 2022-12-08 15:24:45.343 INFO 42 --- [main,,] c.a.o.s.a.s.OcpAlarmInitializeService : initialize done 2022-12-08 15:24:46.969 WARN 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : Error state, the follower found itself leader. 2022-12-08 15:24:46.970 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2022-12-08 15:24:47.159 WARN 42 --- [main,,] JpaBaseConfiguration$JpaWebConfiguration : spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning 2022-12-08 15:24:48.278 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:24:48.508 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=CMDB_SYNCER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:02:04+08:00, updateTime=2022-12-08T15:17:28+08:00, expireTime=null, isLeader=false} 2022-12-08 15:24:48.642 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=MC_MANAGER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:02:04+08:00, updateTime=2022-12-08T15:17:28+08:00, expireTime=null, isLeader=false} 2022-12-08 15:24:48.700 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PERF_SQL_ROLLUP, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:02:04+08:00, updateTime=2022-12-08T15:17:27+08:00, expireTime=null, isLeader=false} 2022-12-08 15:24:48.783 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:13:10+08:00, updateTime=2022-12-08T15:17:10+08:00, expireTime=null, isLeader=false} 2022-12-08 15:24:48.821 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=RATE_LIMIT, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:02:04+08:00, updateTime=2022-12-08T15:17:25+08:00, expireTime=null, isLeader=false} 2022-12-08 15:24:48.863 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:12:39+08:00, updateTime=2022-12-08T15:17:09+08:00, expireTime=null, isLeader=false} 2022-12-08 15:24:48.938 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:09:10+08:00, updateTime=2022-12-08T15:17:11+08:00, expireTime=null, isLeader=false} 2022-12-08 15:24:48.965 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=TASK_MANAGER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:02:04+08:00, updateTime=2022-12-08T15:17:32+08:00, expireTime=null, isLeader=false} 2022-12-08 15:24:48.972 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:24:49.015 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:24:49.036 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service MC_MANAGER, Incorrect result size: expected 1, actual 0 2022-12-08 15:24:49.077 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:24:49.089 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PERF_SQL_ROLLUP, Incorrect result size: expected 1, actual 0 2022-12-08 15:24:49.123 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:24:49.134 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service CMDB_SYNCER, Incorrect result size: expected 1, actual 0 2022-12-08 15:24:49.162 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:24:49.174 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service TASK_MANAGER, Incorrect result size: expected 1, actual 0 2022-12-08 15:24:49.219 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:24:49.229 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2022-12-08 15:24:49.261 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:24:49.272 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:24:49.310 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:24:49.322 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:24:49.538 INFO 42 --- [main,,] c.a.o.s.o.ob.ObMetricCollectService : ObMetricCollectService init, aggConfigList:[{"aggFunc":"max","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_cpu_percent","targetMetric":"ob_tenant_server_max_cpu_used_percentage"},{"aggFunc":"max","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_memory_percent","targetMetric":"ob_tenant_server_max_memory_used_percentage"},{"aggFunc":"avg","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_cpu_percent","targetMetric":"ob_tenant_server_avg_cpu_used_percentage"},{"aggFunc":"avg","aggSeconds":86400,"groupByList":["app","obregion","ob_cluster_id","tenant_name","obzone","svr_ip"],"sourceIntervalSeconds":60,"sourceMetric":"ob_memory_percent","targetMetric":"ob_tenant_server_avg_memory_used_percentage"}] 2022-12-08 15:24:49.972 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 gets the leadership... 2022-12-08 15:24:51.939 INFO 42 --- [main,,] .o.s.m.o.c.ClusterSystemEventServiceImpl : Init eventTemplateCache: 172 cache entries, 172 elements. 2022-12-08 15:24:52.163 INFO 42 --- [main,,] c.a.o.s.a.c.AlarmConfiguration : alarm configuration set from system properties 2022-12-08 15:24:52.418 INFO 42 --- [main,,] c.a.o.s.a.c.n.NotificationSender : NotificationSender init, scriptDirectoryPath=/home/admin/ocp-server/alarm-channel-script 2022-12-08 15:24:52.743 INFO 42 --- [main,,] c.a.o.s.a.c.d.metrics.AlarmMetricsQuery : createMetricMetaMapping done, metasCount=88 2022-12-08 15:24:52.973 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:24:53.012 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:24:53.349 INFO 42 --- [main,,] c.a.o.s.a.c.d.metrics.SqlMetricsQuery : createMetricMetaMapping done, metasCount=88 2022-12-08 15:24:56.013 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:24:56.020 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:24:58.203 INFO 42 --- [part-initial-worker,,] c.a.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2022-12-08 15:24:58.207 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2022-12-08 15:24:58.240 INFO 42 --- [part-initial-worker,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=proxy, clusterName=obcluster, obClusterId=null, tenantName=meta_tenant, username=meta_user, address=192.168.28.54, port=2883, database=meta_database) 2022-12-08 15:24:58.241 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=meta_user, tenantName=meta_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=meta_database) 2022-12-08 15:24:58.263 INFO 42 --- [main,,] c.a.o.s.alarm.schedule.AlarmSchedules : AlarmSchedules construct done 2022-12-08 15:24:58.319 INFO 42 --- [obsdk-init-thread-1,,e165dae1a839] com.alibaba.druid.pool.DruidDataSource : {dataSource-3,ob-connector-datasource_proxy_obcluster_null_meta_tenant_meta_user_192.168.28.54_2883} inited 2022-12-08 15:24:58.320 INFO 42 --- [obsdk-init-thread-1,,e165dae1a839] c.a.o.c.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=meta_user, tenantName=meta_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=meta_database) 2022-12-08 15:24:58.321 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2022-12-08 15:24:58.333 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.356 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.368 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.378 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2022-12-08 15:24:58.399 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 15:24:58.403 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize alarmDetectMetricExecutor 2022-12-08 15:24:58.407 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 'alarmDetectMetricExecutor' 2022-12-08 15:24:58.415 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.417 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.422 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:58.433 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.434 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.437 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2022-12-08 15:24:58.497 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2022-12-08 15:24:58.498 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2022-12-08 15:24:58.499 INFO 42 --- [part-initial-worker,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=proxy, clusterName=obcluster, obClusterId=null, tenantName=monitor_tenant, username=monitor_user, address=192.168.28.54, port=2883, database=monitor_database) 2022-12-08 15:24:58.499 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=monitor_user, tenantName=monitor_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=monitor_database) 2022-12-08 15:24:58.506 INFO 42 --- [main,,] o.s.s.concurrent.ThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 15:24:58.507 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize alarmTaskExecutor 2022-12-08 15:24:58.509 INFO 42 --- [main,,] o.s.s.concurrent.ThreadPoolTaskExecutor : Initializing ExecutorService 'alarmTaskExecutor' 2022-12-08 15:24:58.527 INFO 42 --- [main,,] c.a.o.s.a.utils.task.AlarmTaskManager : alarm task manager construct done, executorName=192.168.28.62:42 2022-12-08 15:24:58.539 INFO 42 --- [obsdk-init-thread-2,,0922990d5475] com.alibaba.druid.pool.DruidDataSource : {dataSource-4,ob-connector-datasource_proxy_obcluster_null_monitor_tenant_monitor_user_192.168.28.54_2883} inited 2022-12-08 15:24:58.540 INFO 42 --- [obsdk-init-thread-2,,0922990d5475] c.a.o.c.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=proxy, address=192.168.28.54, port=2883, obsAddrList=null, username=monitor_user, tenantName=monitor_tenant, clusterName=obcluster, obClusterId=null, proxy=null, vpcId=1, compatibilityMode=MYSQL, database=monitor_database) 2022-12-08 15:24:58.542 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2022-12-08 15:24:58.543 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.548 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.549 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.555 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2022-12-08 15:24:58.566 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.567 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.580 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:58.587 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.588 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.591 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2022-12-08 15:24:58.623 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : OcpMonitorManager init start... 2022-12-08 15:24:58.628 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.628 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.632 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:58.633 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484300, interval=60 2022-12-08 15:24:58.636 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486400, interval=3600 2022-12-08 15:24:58.638 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.639 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484300, interval=60 2022-12-08 15:24:58.639 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.642 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2022-12-08 15:24:58.644 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486400, interval=3600 2022-12-08 15:24:58.652 INFO 42 --- [main,,] c.a.o.service.monitor.OcpMonitorManager : OcpMonitorManager init success. 2022-12-08 15:24:58.664 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.665 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.669 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:58.674 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.675 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.679 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2022-12-08 15:24:58.702 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.703 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.708 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:58.715 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.715 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.719 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2022-12-08 15:24:58.757 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.758 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.761 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:58.769 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.770 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.776 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2022-12-08 15:24:58.798 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.799 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.803 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:58.809 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.810 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.814 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2022-12-08 15:24:58.856 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.857 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.861 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:58.867 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.868 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.871 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2022-12-08 15:24:58.891 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 2022-12-08 15:24:58.892 INFO 42 --- [main,,] c.a.o.s.alarm.AlarmBeanConfiguration : initialize notificationSendExecutor 2022-12-08 15:24:58.893 INFO 42 --- [main,,] .a.o.s.a.u.VisibleThreadPoolTaskExecutor : Initializing ExecutorService 'notificationSendExecutor' 2022-12-08 15:24:58.937 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.938 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.942 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:58.957 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.958 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.962 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2022-12-08 15:24:58.989 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:58.990 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:58.994 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.014 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.015 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.019 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2022-12-08 15:24:59.022 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:24:59.025 INFO 42 --- [main,,] c.a.o.s.dataclean.TableCleaningService : Successfully init all table cleaning configurations: {"cleanTaskInstance":{"batchIntervalMillis":0,"batchSize":0,"condition":"create_time <= date_sub(now(), interval 30 day) and type = \"SYS_SCHEDULED\"","priority":1,"tableName":"task_instance"},"cleanSubTaskInstance":{"batchIntervalMillis":0,"batchSize":0,"condition":"task_id in (select id from task_instance where create_time <= date_sub(now(), interval 30 day) and type = \"SYS_SCHEDULED\")","priority":0,"tableName":"subtask_instance"}} 2022-12-08 15:24:59.028 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:24:59.048 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.049 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.053 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.059 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.060 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.065 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2022-12-08 15:24:59.077 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:24:59.098 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.099 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.117 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.126 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.127 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.131 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2022-12-08 15:24:59.159 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.160 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.165 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.172 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.173 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.176 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2022-12-08 15:24:59.193 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:24:59.199 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.199 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.203 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.209 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.210 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.214 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2022-12-08 15:24:59.267 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:24:59.270 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.270 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.275 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.281 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.282 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.289 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2022-12-08 15:24:59.334 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:24:59.337 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.338 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.341 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.347 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.348 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.352 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2022-12-08 15:24:59.405 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.406 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.410 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.419 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.419 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.426 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2022-12-08 15:24:59.494 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.495 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.505 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.514 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.515 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.521 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2022-12-08 15:24:59.550 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.551 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.557 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.568 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.569 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.574 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2022-12-08 15:24:59.614 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.615 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.619 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.626 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.627 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.632 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2022-12-08 15:24:59.660 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.661 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.671 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.677 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.678 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.682 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2022-12-08 15:24:59.711 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.711 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.715 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.722 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.723 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.727 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2022-12-08 15:24:59.773 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.774 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.777 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.785 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.786 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.789 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2022-12-08 15:24:59.819 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.820 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.824 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.831 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.832 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.836 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2022-12-08 15:24:59.867 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.868 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.872 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.880 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.880 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.887 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2022-12-08 15:24:59.971 INFO 42 --- [main,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updater scheduler started on 192.168.28.62:8080 2022-12-08 15:24:59.974 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:24:59.975 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:24:59.987 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:24:59.999 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.000 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.009 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2022-12-08 15:25:00.043 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.046 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.053 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.065 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.066 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.075 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2022-12-08 15:25:00.104 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.106 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.110 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.121 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.122 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.126 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2022-12-08 15:25:00.153 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.154 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.158 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.167 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.168 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.184 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2022-12-08 15:25:00.213 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.214 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.218 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.239 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.240 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.248 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2022-12-08 15:25:00.292 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.293 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.304 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.319 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.320 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.326 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2022-12-08 15:25:00.359 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.360 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.367 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.378 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.379 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.387 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2022-12-08 15:25:00.410 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.411 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.416 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.423 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.424 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.425 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.print.sql = true 2022-12-08 15:25:00.427 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set sqlLogEnabled=true 2022-12-08 15:25:00.428 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2022-12-08 15:25:00.436 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.max-idle.seconds = 3600 2022-12-08 15:25:00.458 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set maxIdleSeconds=3600 2022-12-08 15:25:00.469 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.471 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.473 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.cleanup.period.seconds = 300 2022-12-08 15:25:00.474 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set cleanPeriod=300 2022-12-08 15:25:00.476 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.482 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.operation.global.timeout.millis = 300000 2022-12-08 15:25:00.486 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.486 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set ddlGlobalTimeoutMillis=300000 2022-12-08 15:25:00.488 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.497 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2022-12-08 15:25:00.497 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.timeout.millis = 3000 2022-12-08 15:25:00.499 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set initTimeoutMillis=3000 2022-12-08 15:25:00.507 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.slow.query.threshold.millis = 1000 2022-12-08 15:25:00.508 INFO 42 --- [main,,] c.a.o.core.obsdk.config.Configurations : [obsdk] set slowQueryThresholdMillis=1000 2022-12-08 15:25:00.516 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.holder.capacity = 100 2022-12-08 15:25:00.522 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.523 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.530 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.532 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set cacheSize=100 2022-12-08 15:25:00.537 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.538 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.540 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.read.timeout.millis = 1800000 2022-12-08 15:25:00.541 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketReadTimeoutMillis=1800000 2022-12-08 15:25:00.542 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2022-12-08 15:25:00.549 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.executor.thread-count = 16 2022-12-08 15:25:00.550 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketInitThreadCount=16 2022-12-08 15:25:00.558 INFO 42 --- [main,,] c.a.o.s.o.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.connect.timeout.millis = 2000 2022-12-08 15:25:00.559 INFO 42 --- [main,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk] set socketConnectTimeoutMillis=2000 2022-12-08 15:25:00.572 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.573 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.577 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.584 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.585 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.588 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2022-12-08 15:25:00.610 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.610 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.614 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.620 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.621 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.625 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2022-12-08 15:25:00.640 INFO 42 --- [main,,] c.a.o.service.maz.OcpAzoneDaemonService : Multi azone daemon not enabled 2022-12-08 15:25:00.649 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.649 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.652 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.659 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.660 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.666 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2022-12-08 15:25:00.688 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.689 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.692 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.698 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.699 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.702 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2022-12-08 15:25:00.725 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.726 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.730 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.736 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.737 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.749 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2022-12-08 15:25:00.772 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.772 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.776 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.784 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.785 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.789 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2022-12-08 15:25:00.808 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.809 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.813 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.819 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.820 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.823 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2022-12-08 15:25:00.855 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.856 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.859 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2022-12-08 15:25:00.865 INFO 42 --- [part-initial-worker,,] c.a.o.core.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.28.54, sql port:2883 2022-12-08 15:25:00.866 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2022-12-08 15:25:00.869 INFO 42 --- [part-initial-worker,,] c.a.o.c.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_0 2022-12-08 15:25:00.913 INFO 42 --- [part-initial-worker,,] c.a.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2022-12-08 15:25:01.023 INFO 42 --- [main,,] c.a.o.s.s.BuiltInFilesInitializeLoader : Load lib files, localBuiltInDir=/home/admin/ocp-server/lib 2022-12-08 15:25:01.024 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Remove built-in file:pos.py 2022-12-08 15:25:01.490 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Delete object, bucket=built-in, name=pos.py, objectId=1 2022-12-08 15:25:02.029 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:02.036 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:02.099 INFO 42 --- [main,,] c.a.o.s.s.operator.ObjectBlockOperator : deleteByFileId, deletedBlockCount=1 2022-12-08 15:25:02.659 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Load built-in file:pos.py 2022-12-08 15:25:03.287 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=built-in, name=pos.py, objectId=6 2022-12-08 15:25:04.123 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:25:04.150 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=6, name=pos.py 2022-12-08 15:25:04.151 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Remove built-in file:obproxyd.sh 2022-12-08 15:25:04.187 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Delete object, bucket=built-in, name=obproxyd.sh, objectId=2 2022-12-08 15:25:04.215 INFO 42 --- [main,,] c.a.o.s.s.operator.ObjectBlockOperator : deleteByFileId, deletedBlockCount=1 2022-12-08 15:25:04.531 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Load built-in file:obproxyd.sh 2022-12-08 15:25:04.974 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:25:05.037 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:05.047 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:05.417 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.server.DefaultServerUpdater : Deleted expired server: DistributedServer{id=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:02:21+08:00, updateTime=2022-12-08T15:17:28+08:00, expireTime=2022-12-08T15:17:58+08:00, isActive=false} 2022-12-08 15:25:05.424 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Init saving object, creatorId=200, bucket=built-in, name=obproxyd.sh, objectId=7 2022-12-08 15:25:06.899 INFO 42 --- [main,,] c.a.o.s.s.LocalObjectStorageService : Finish saving object, objectId=7, name=obproxyd.sh 2022-12-08 15:25:06.934 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:libaio-0.3.112-1.el8.x86_64.rpm 2022-12-08 15:25:07.039 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Software package already exist, name=libaio-0.3.112-1.el8.x86_64.rpm 2022-12-08 15:25:07.040 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:t-oceanbase-ocp-agent-4.0.0-20221104145832.alios7.aarch64.rpm 2022-12-08 15:25:07.075 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Software package already exist, name=t-oceanbase-ocp-agent-4.0.0-20221104145832.alios7.aarch64.rpm 2022-12-08 15:25:07.076 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : packageName:t-oceanbase-ocp-agent-4.0.0-20221104150026.alios7.x86_64.rpm 2022-12-08 15:25:07.103 INFO 42 --- [main,,] c.a.o.s.storage.BuiltInFileService : Software package already exist, name=t-oceanbase-ocp-agent-4.0.0-20221104150026.alios7.x86_64.rpm 2022-12-08 15:25:08.048 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:08.056 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:09.193 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:25:09.436 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:25:09.672 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:25:09.686 INFO 42 --- [main,,] f.a.AutowiredAnnotationBeanPostProcessor : Autowired annotation is not supported on static methods: public static void com.alipay.ocp.core.util.jpa.JsonNodeConverter.init(com.fasterxml.jackson.databind.ObjectMapper) 2022-12-08 15:25:10.001 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:25:10.190 INFO 42 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup daemon submitted 2022-12-08 15:25:10.200 INFO 42 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup workers submitted 2022-12-08 15:25:11.057 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:11.074 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:14.075 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:14.082 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:15.916 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:25:17.083 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:17.088 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:17.809 INFO 42 --- [main,,] c.a.o.core.sharding.ShardingCoordinator : Sharding registry started, module=metric-collect 2022-12-08 15:25:19.023 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:25:19.308 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:24:48+08:00, updateTime=2022-12-08T15:24:48+08:00, expireTime=null, isLeader=false} 2022-12-08 15:25:19.315 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:25:19.537 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:25:19.850 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:25:19.935 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:25:20.017 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:25:20.060 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:25:20.091 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:20.099 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:20.110 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:25:20.226 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:25:21.260 INFO 42 --- [main,,] c.a.o.c.t.engine.util.ThreadPrintStream : replaceSystemOut done 2022-12-08 15:25:21.278 INFO 42 --- [main,,] c.a.o.c.t.e.c.SubtaskCoordinator : Start subtask coordinator 2022-12-08 15:25:23.100 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:23.109 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:23.247 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:25:23.260 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:25:23.444 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:25:26.114 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:26.119 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:26.144 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:25:26.314 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:25:26.687 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:25:26.947 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:25:26.948 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:25:28.768 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:17:06.0, nextRun=2022-12-08 15:18:05.0, currentDate=Thu Dec 08 15:25:28 CST 2022 2022-12-08 15:25:28.770 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:17:06.0, nextRunTime=2022-12-08 15:18:05.0} 2022-12-08 15:25:29.008 INFO 42 --- [pool-task-coordinator1,,] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:25:29.021 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:29.021 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:29.029 INFO 42 --- [main,,] o.s.b.a.w.s.WelcomePageHandlerMapping : Adding welcome page: class path resource [static/index.html] 2022-12-08 15:25:29.126 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:29.144 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:29.253 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:145, status:SUCCESS 2022-12-08 15:25:29.330 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:145, status:SUCCESS 2022-12-08 15:25:29.337 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:25:29.337 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:25:29.439 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:17:21.0, nextRun=2022-12-08 15:18:20.0, currentDate=Thu Dec 08 15:25:29 CST 2022 2022-12-08 15:25:29.440 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:17:21.0, nextRunTime=2022-12-08 15:18:20.0} 2022-12-08 15:25:29.466 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:25:29.467 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:29.468 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:29.578 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:17:26.0, nextRun=2022-12-08 15:18:25.0, currentDate=Thu Dec 08 15:25:29 CST 2022 2022-12-08 15:25:29.579 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:17:26.0, nextRunTime=2022-12-08 15:18:25.0} 2022-12-08 15:25:29.830 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:25:29.830 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:29.831 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:29.972 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:00.0, nextRun=2022-12-08 15:20:00.0, currentDate=Thu Dec 08 15:25:29 CST 2022 2022-12-08 15:25:29.973 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=12, name=Refresh agent config, templateName=RefreshAgentConfigSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 15:10:00.0, nextRunTime=2022-12-08 15:20:00.0} 2022-12-08 15:25:29.995 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Refresh agent config, nodeCount=1, taskCount=1 2022-12-08 15:25:29.996 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:29.996 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Refresh agent config, taskDefinitionId=12, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:30.060 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:25:30.101 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:16:01.0, nextRun=2022-12-08 15:18:00.0, currentDate=Thu Dec 08 15:25:30 CST 2022 2022-12-08 15:25:30.102 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:16:01.0, nextRunTime=2022-12-08 15:18:00.0} 2022-12-08 15:25:30.170 WARN 42 --- [main,,] ion$DefaultTemplateResolverConfiguration : Cannot find template location: classpath:/templates/ (please add some templates or check your Thymeleaf configuration) 2022-12-08 15:25:30.191 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:25:30.405 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:25:30.451 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:10:00.0, nextRun=2022-12-08 15:20:00.0, currentDate=Thu Dec 08 15:25:30 CST 2022 2022-12-08 15:25:30.452 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=15, name=Sync system event, templateName=SyncSystemEventSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 15:10:00.0, nextRunTime=2022-12-08 15:20:00.0} 2022-12-08 15:25:30.585 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:25:30.622 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync system event 2022-12-08 15:25:30.671 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:25:30.694 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:17:30.0, nextRun=2022-12-08 15:18:30.0, currentDate=Thu Dec 08 15:25:30 CST 2022 2022-12-08 15:25:30.695 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:17:30.0, nextRunTime=2022-12-08 15:18:30.0} 2022-12-08 15:25:30.730 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:25:30.876 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:01.0, nextRun=2022-12-08 15:20:00.0, currentDate=Thu Dec 08 15:25:30 CST 2022 2022-12-08 15:25:30.877 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 15:15:01.0, nextRunTime=2022-12-08 15:20:00.0} 2022-12-08 15:25:30.898 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 15:25:30.904 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:30.905 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:31.260 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:01.0, nextRun=2022-12-08 15:20:00.0, currentDate=Thu Dec 08 15:25:31 CST 2022 2022-12-08 15:25:31.260 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:15:01.0, nextRunTime=2022-12-08 15:20:00.0} 2022-12-08 15:25:32.145 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:32.151 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:32.268 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:25:32.276 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:25:32.495 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:25:33.256 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 15:25:33.257 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 15:25:33.353 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:17:01.0, nextRun=2022-12-08 15:18:00.0, currentDate=Thu Dec 08 15:25:33 CST 2022 2022-12-08 15:25:33.354 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:17:01.0, nextRunTime=2022-12-08 15:18:00.0} 2022-12-08 15:25:33.371 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:25:33.372 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:33.372 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:33.472 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:25:33.727 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:17:01.0, nextRun=2022-12-08 15:18:00.0, currentDate=Thu Dec 08 15:25:33 CST 2022 2022-12-08 15:25:33.728 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:17:01.0, nextRunTime=2022-12-08 15:18:00.0} 2022-12-08 15:25:33.753 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:25:33.754 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:33.754 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:33.851 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:17:01.0, nextRun=2022-12-08 15:18:00.0, currentDate=Thu Dec 08 15:25:33 CST 2022 2022-12-08 15:25:33.851 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:17:01.0, nextRunTime=2022-12-08 15:18:00.0} 2022-12-08 15:25:33.889 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:25:33.889 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:33.889 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:33.961 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:17:31.0, nextRun=2022-12-08 15:18:00.0, currentDate=Thu Dec 08 15:25:33 CST 2022 2022-12-08 15:25:33.962 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:17:31.0, nextRunTime=2022-12-08 15:18:00.0} 2022-12-08 15:25:33.978 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:25:33.978 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:33.978 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:34.042 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:25:34.320 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:15:02.0, nextRun=2022-12-08 15:20:00.0, currentDate=Thu Dec 08 15:25:34 CST 2022 2022-12-08 15:25:34.320 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:15:02.0, nextRunTime=2022-12-08 15:20:00.0} 2022-12-08 15:25:34.339 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 15:25:34.339 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:34.339 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:34.563 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:17:02.0, nextRun=2022-12-08 15:18:00.0, currentDate=Thu Dec 08 15:25:34 CST 2022 2022-12-08 15:25:34.564 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:17:02.0, nextRunTime=2022-12-08 15:18:00.0} 2022-12-08 15:25:34.850 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:25:35.151 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:35.156 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:35.629 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:25:35.630 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:25:36.365 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:25:36.774 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:25:36.774 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:25:37.903 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:25:37.904 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:25:37.904 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:25:38.157 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:38.162 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:39.509 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:25:39.520 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:25:39.587 INFO 42 --- [main,,] c.a.o.s.c.s.LocalSecurityConfiguration : Local JDBC authentication enabled: whiteList [/api/status.*, /api/v2/time, /api/v2/mc/info, /api/v2/loginKey, .*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|GetObRootServiceInfoUrlTemplate).*, performance/ash/reports/.*/data], basicAuth true, CSRF true 2022-12-08 15:25:39.595 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/assets/**'], [] 2022-12-08 15:25:39.595 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/index.html'], [] 2022-12-08 15:25:39.596 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.js'], [] 2022-12-08 15:25:39.596 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.css'], [] 2022-12-08 15:25:39.596 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/webjars/**'], [] 2022-12-08 15:25:39.596 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: Ant [pattern='/**/*.svg'], [] 2022-12-08 15:25:39.959 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:25:40.662 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:25:40.678 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:25:40.742 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=63ms, period=120000ms 2022-12-08 15:25:40.905 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:25:41.085 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: com.alipay.ocp.server.config.security.BasicAuthenticationSecurityConfiguration$$Lambda$2032/511208456@41244e49, [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@47d9b32d, org.springframework.security.web.context.SecurityContextPersistenceFilter@47962bfd, org.springframework.security.web.header.HeaderWriterFilter@7f4e26a3, org.springframework.security.web.authentication.logout.LogoutFilter@2ca6b438, com.alipay.ocp.server.authentication.PreAuthenticationFilter@721f3526, org.springframework.security.oauth2.server.resource.web.BearerTokenAuthenticationFilter@26f8e09e, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@4d1b2e3f, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@5434c18d, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@70809f39, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@74b3e7f2, org.springframework.security.web.session.SessionManagementFilter@2cc814ed, org.springframework.security.web.access.ExceptionTranslationFilter@5b0ed695, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@6a5fcb32] 2022-12-08 15:25:41.163 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:41.170 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:41.179 INFO 42 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Creating filter chain: any request, [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@3131b41, org.springframework.security.web.context.SecurityContextPersistenceFilter@4ad8bc3, org.springframework.security.web.header.HeaderWriterFilter@1ee3ad6, org.springframework.security.web.csrf.CsrfFilter@c27de3b, org.springframework.security.web.authentication.logout.LogoutFilter@18e94b42, com.alipay.ocp.server.authentication.PreAuthenticationFilter@721f3526, org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter@69af224d, org.springframework.security.oauth2.server.resource.web.BearerTokenAuthenticationFilter@133efe21, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@64829fc5, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@144a3109, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@864ff30, org.springframework.security.web.session.SessionManagementFilter@338afad6, org.springframework.security.web.access.ExceptionTranslationFilter@4c159b48, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@fd01951] 2022-12-08 15:25:41.353 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:25:41.436 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:25:42.124 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:25:42.358 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:25:42.707 INFO 42 --- [main,,] o.s.b.a.e.web.EndpointLinksResolver : Exposing 3 endpoint(s) beneath base path '/actuator' 2022-12-08 15:25:43.104 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:25:43.105 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:25:44.171 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:44.180 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:44.681 INFO 42 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8080 (http) with context path '' 2022-12-08 15:25:44.710 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ************************* ACTIVE OCP PROPERTIES ****************************** 2022-12-08 15:25:44.711 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : Active profiles: [composite, default] 2022-12-08 15:25:44.723 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : apsara.audit.enabled=false 2022-12-08 15:25:44.724 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : backup.dbname.prefix=backup 2022-12-08 15:25:44.724 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : display-parse-failed-sql=true 2022-12-08 15:25:44.724 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : enable-sql.parse-service=true 2022-12-08 15:25:44.725 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file=/home/admin/ocp-server/log/ocp.log 2022-12-08 15:25:44.726 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.max-history=100 2022-12-08 15:25:44.726 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.max-size=100MB 2022-12-08 15:25:44.727 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.name=/home/admin/ocp-server/log/ocp.log 2022-12-08 15:25:44.727 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.file.total-size-cap=10GB 2022-12-08 15:25:44.727 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.com.alipay.ocp=INFO 2022-12-08 15:25:44.727 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.com.oceanbase.ocp=INFO 2022-12-08 15:25:44.728 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.org.hibernate.SQL=INFO 2022-12-08 15:25:44.728 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.level.web=INFO 2022-12-08 15:25:44.728 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.pattern.console=%clr(%d{yyyy-MM-dd HH:mm:ss.SSS}){faint} %clr(%5p) %clr(42){magenta} %clr(---){faint} %clr([%t,%X{traceId},%X{spanId}]){faint} %clr(%-40.40logger{39}){cyan} %clr(:){faint} %m%n%wEx 2022-12-08 15:25:44.729 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : logging.pattern.file=%d{yyyy-MM-dd HH:mm:ss.SSS} %5p 42 --- [%t,%X{traceId},%X{spanId}] %-40.40logger{39} : %m%n%wEx 2022-12-08 15:25:44.729 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : mc.ocp.cluster.role.sync.check-timeout-seconds=120 2022-12-08 15:25:44.729 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : mgragent.log.level=info 2022-12-08 15:25:44.729 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : monagent.log.level=info 2022-12-08 15:25:44.730 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ob.logtailer.keyword.alarm.rules=[{"keyword":"partition table update task cost too much time to execute", "logLevel":"error", "svrType":"observer", "errorCode":4015, "alarmLevel":2}, {"keyword":"is_out_of_memstore_mem=true", "logLevel":"error", "svrType":"observer", "errorCode":100000, "alarmLevel":1}, {"keyword":"clog disk is almost full", "logLevel":"error", "svrType":"observer", "errorCode":100001, "alarmLevel":2}, {"keyword":"set_disk_error:attention!!!", "logLevel":"error", "svrType":"observer", "errorCode":100002, "alarmLevel":2}, {"keyword":"error occurs on data disk or slog disk", "logLevel":"warn", "svrType":"observer", "errorCode":100003, "alarmLevel":2}, {"keyword":"right_to_die_or_duty_to_live", "logLevel":"error", "svrType":"observer", "errorCode":100004, "alarmLevel":1}, {"keyword":"on_fatal_error", "logLevel":"error", "svrType":"observer", "errorCode":4070, "alarmLevel":1}] 2022-12-08 15:25:44.730 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.cleanup.period.seconds=300 2022-12-08 15:25:44.730 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.holder.capacity=100 2022-12-08 15:25:44.730 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.init.executor.thread-count=16 2022-12-08 15:25:44.731 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.init.timeout.millis=3000 2022-12-08 15:25:44.731 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.connector.max-idle.seconds=3600 2022-12-08 15:25:44.731 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.operation.global.timeout.millis=300000 2022-12-08 15:25:44.732 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.print.sql=true 2022-12-08 15:25:44.732 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.slow.query.threshold.millis=1000 2022-12-08 15:25:44.732 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.socket.connect.timeout.millis=2000 2022-12-08 15:25:44.732 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : obsdk.socket.read.timeout.millis=1800000 2022-12-08 15:25:44.732 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.auth.metric-auth-enabled=true 2022-12-08 15:25:44.733 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.auth.username=ocp_agent 2022-12-08 15:25:44.733 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.manager.http.port=62888 2022-12-08 15:25:44.733 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.monitor.http.port=62889 2022-12-08 15:25:44.734 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.agent.ob-cleaner.config={"ob_log":{"path":"{INSTALL_PATH}/log","disk_threshold":80,"rules":[{"file_reg":"\\([a-z]\\+\\.\\)\\?[a-z]\\+\\.log\\.[0-9]\\+","retention_days":8,"keep_percentage":0.6},{"file_reg":"\\([a-z]\\+\\.\\)\\?[a-z]\\+\\.log\\.wf\\.[0-9]\\+","retention_days":30,"keep_percentage":0.8}]},"core_log":{"path":"{INSTALL_PATH}","disk_threshold":80,"rules":[{"file_reg":"core\\.[0-9]\\+","retention_days":8,"keep_percentage":0.6}]}} 2022-12-08 15:25:44.734 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-end-time-offset-seconds=130 2022-12-08 15:25:44.734 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-timeout-seconds=3 2022-12-08 15:25:44.734 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.slow-sql-exclude-obclusters=sys#* 2022-12-08 15:25:44.735 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-min-duration-seconds=60 2022-12-08 15:25:44.735 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-min-log-size-mb=0.5 2022-12-08 15:25:44.735 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans-stat-exclude-obclusters= 2022-12-08 15:25:44.735 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.datasource.trans.query-end-time-offset-seconds=15 2022-12-08 15:25:44.736 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.detect.too-many-targets-alarm-threshold=20 2022-12-08 15:25:44.736 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.enabled=true 2022-12-08 15:25:44.736 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.host.property=svr_ip 2022-12-08 15:25:44.737 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.notification.expired-days=90 2022-12-08 15:25:44.737 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.recover-message-template= 2022-12-08 15:25:44.737 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.batch-max=20 2022-12-08 15:25:44.737 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.enabled=true 2022-12-08 15:25:44.738 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.once-retry-times=1 2022-12-08 15:25:44.738 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.once-timeout-ms=10000 2022-12-08 15:25:44.738 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.period.ms=2000 2022-12-08 15:25:44.738 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.retry-timeout-minutes=60 2022-12-08 15:25:44.739 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.total-failed-retry-times=3 2022-12-08 15:25:44.739 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.total-timeout-seconds=60 2022-12-08 15:25:44.739 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.alarm.send.will-be-sent-in-period-seconds=1800 2022-12-08 15:25:44.739 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.enabled=false 2022-12-08 15:25:44.740 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.addresses=null 2022-12-08 15:25:44.741 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.password=null 2022-12-08 15:25:44.742 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.client.username=null 2022-12-08 15:25:44.742 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.keep.days=7 2022-12-08 15:25:44.742 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.replicas=1 2022-12-08 15:25:44.743 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.es.index.shards=12 2022-12-08 15:25:44.743 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.ob.log.enabled=false 2022-12-08 15:25:44.743 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.analyze.ob.trace.enabled=false 2022-12-08 15:25:44.743 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.audit.enabled=true 2022-12-08 15:25:44.744 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.agent.relation.file.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/backup_agent_ob_relations_config.yaml')} 2022-12-08 15:25:44.744 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.backup-data-retention-days=7 2022-12-08 15:25:44.745 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.backup-liboblog-expire-days=7 2022-12-08 15:25:44.745 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.base-backup-last-finished-threshold=12960 2022-12-08 15:25:44.745 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.base-backup-timeout=10 2022-12-08 15:25:44.746 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.inc-backup-delay-threshold=3600 2022-12-08 15:25:44.746 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.alarm.last-data-backup-max-interval-minutes=1440 2022-12-08 15:25:44.746 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.backup-command.timeout=300 2022-12-08 15:25:44.746 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.logical.log.meta.time.continuity.threshold.seconds=10 2022-12-08 15:25:44.747 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.oss.support.cname=true 2022-12-08 15:25:44.747 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.restore-time-pre-check.enabled=true 2022-12-08 15:25:44.747 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.command.timeout=3600000 2022-12-08 15:25:44.747 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.host.task.concurrency=8 2022-12-08 15:25:44.748 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.max.retry.times=2 2022-12-08 15:25:44.748 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-interval-seconds=60 2022-12-08 15:25:44.749 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-times=60 2022-12-08 15:25:44.749 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.period.minutes=180 2022-12-08 15:25:44.749 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.schedule.enabled=true 2022-12-08 15:25:44.749 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.backup.storage.collect.task.timeout=10800000 2022-12-08 15:25:44.750 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cloud.data.platform.site.url=null 2022-12-08 15:25:44.751 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cloud.meta.platform.site.url=null 2022-12-08 15:25:44.751 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.id=1 2022-12-08 15:25:44.751 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.name=ocp-cluster 2022-12-08 15:25:44.751 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.cluster.role=FOLLOWER 2022-12-08 15:25:44.752 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.config-url.site.url= 2022-12-08 15:25:44.754 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.config-url.use-request-address=true 2022-12-08 15:25:44.755 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.debug.web.cdn.enabled=false 2022-12-08 15:25:44.755 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.debug.web.cdn.location=https://gw-office.alipayobjects.com/a-sit/g/oceanbase/ocp-v2/2.5.0 2022-12-08 15:25:44.755 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.server.expire.seconds=30 2022-12-08 15:25:44.755 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.server.update.seconds=10 2022-12-08 15:25:44.756 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.service.expire.seconds={CMDB_SYNCER:30, TASK_MANAGER:30, RATE_LIMIT:30, PERF_SQL_ROLLUP:30, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:30} 2022-12-08 15:25:44.756 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.distributed.service.update.seconds={CMDB_SYNCER:10, TASK_MANAGER:10, RATE_LIMIT:10, PERF_SQL_ROLLUP:15, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:10} 2022-12-08 15:25:44.756 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.env=private 2022-12-08 15:25:44.756 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.access-key=****** 2022-12-08 15:25:44.757 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.access-secret=****** 2022-12-08 15:25:44.757 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.event.audit.apsara.sls.endpoint=TO_BE_REPLACED 2022-12-08 15:25:44.757 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.built-in.bucket=built-in 2022-12-08 15:25:44.757 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.default-block-split-size=1048576 2022-12-08 15:25:44.758 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.file-server.bucket.type=LOCAL 2022-12-08 15:25:44.758 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.local.built-in.dir=#{systemProperties['user.home'].concat('/ocp-server/lib')} 2022-12-08 15:25:44.758 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.local.dir=#{systemProperties['user.home'].concat('/data/files')} 2022-12-08 15:25:44.758 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.max-concurrent-count=16 2022-12-08 15:25:44.759 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.oss-block-split-size=1048576 2022-12-08 15:25:44.759 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.supported-architecture=x86_64,AArch64 2022-12-08 15:25:44.759 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.sys-package.bucket=sys-package 2022-12-08 15:25:44.759 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.file.try-lock-timeout-milliseconds=60000 2022-12-08 15:25:44.760 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.config.threshold={"-1":{"host_load":{"load1_per_cpu":2},"host_disk_status":{"host_disk_used_percent":85},"host_time":{"clock_diff":500,"ssh_interval":1000},"ob_server_disk_status":{"observer_disk_threshold_percentage":80},"ob_server_partition_count":{"ob_server_partition_count":100000},"obproxy_connection_count":{"obproxy_session_count_percentage":80}}} 2022-12-08 15:25:44.760 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.status.available-keyword=okay 2022-12-08 15:25:44.760 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.health-check.status.unavailable-keyword=bad 2022-12-08 15:25:44.761 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host-manager.staragent.enable=false 2022-12-08 15:25:44.761 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.check.clock-diff.enable=false 2022-12-08 15:25:44.761 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.check.clock-diff.max-diff=50 2022-12-08 15:25:44.761 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.remote-command.default-timeout-millis=30000 2022-12-08 15:25:44.762 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.remote-command.min-timeout-millis=30000 2022-12-08 15:25:44.762 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.host.ssh-ping.max-delay-millis=3000 2022-12-08 15:25:44.762 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.account.system.active=false 2022-12-08 15:25:44.762 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth=local 2022-12-08 15:25:44.763 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-key=****** 2022-12-08 15:25:44.763 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-secret=****** 2022-12-08 15:25:44.763 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.oauth-url=TO_BE_REPLACED 2022-12-08 15:25:44.763 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-domain=TO_BE_REPLACED 2022-12-08 15:25:44.764 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-login-url=TO_BE_REPLACED 2022-12-08 15:25:44.764 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.ops-site-logout-url=TO_BE_REPLACED 2022-12-08 15:25:44.764 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-domain=TO_BE_REPLACED 2022-12-08 15:25:44.765 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-login-url=TO_BE_REPLACED 2022-12-08 15:25:44.765 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.aas.user-site-logout-url=TO_BE_REPLACED 2022-12-08 15:25:44.765 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.access-key=****** 2022-12-08 15:25:44.765 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.access-secret=****** 2022-12-08 15:25:44.766 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.domain=TO_BE_REPLACED 2022-12-08 15:25:44.766 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.endpoint=TO_BE_REPLACED 2022-12-08 15:25:44.766 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.oam.region-name=TO_BE_REPLACED 2022-12-08 15:25:44.768 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.ram.endpoint=TO_BE_REPLACED 2022-12-08 15:25:44.768 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.apsara.ram.region-name=TO_BE_REPLACED 2022-12-08 15:25:44.768 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.basic.enabled=true 2022-12-08 15:25:44.768 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.admin-employee-ids=146380,073156,032575 2022-12-08 15:25:44.769 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.app-name=TO_BE_REPLACED 2022-12-08 15:25:44.769 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.login-env=daily 2022-12-08 15:25:44.769 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.login-url=TO_BE_REPLACED 2022-12-08 15:25:44.769 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.buc.logout-url=TO_BE_REPLACED 2022-12-08 15:25:44.770 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.auth.whitelist=/api/v2/time,/api/v2/mc/info,/api/v2/loginKey,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|GetObRootServiceInfoUrlTemplate).*,performance/ash/reports/.*/data 2022-12-08 15:25:44.770 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.csrf.enabled=true 2022-12-08 15:25:44.770 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.csrf.url.excluded=/api/v2/iam/login.*,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName).* 2022-12-08 15:25:44.770 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.lockout-minutes=10 2022-12-08 15:25:44.771 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.max-attempts=10 2022-12-08 15:25:44.772 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.client.white-list=null 2022-12-08 15:25:44.772 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.lockout-minutes=30 2022-12-08 15:25:44.772 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.login.max-attempts=5 2022-12-08 15:25:44.772 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.preserved.username.list=admin,sys,system,sysdba,dba,oceanbase,obproxy,proxyro,ocp,ocp_monitor,ocp_agent,odc,oms,backup,drc,lbacsys,odp,temp 2022-12-08 15:25:44.773 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.enabled=true 2022-12-08 15:25:44.773 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.connect.timeout=1000 2022-12-08 15:25:44.773 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.read.timeout=1000 2022-12-08 15:25:44.773 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.on-ip.enabled=false 2022-12-08 15:25:44.774 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.on-user.enabled=true 2022-12-08 15:25:44.774 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.rate-limit.task.schedule.period=3 2022-12-08 15:25:44.774 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.iam.role.forbidden.update.username.list=admin,system,obpass,obproxy,ocp_admin,monitor 2022-12-08 15:25:44.774 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.idempotent.client-token.expire.time=14d 2022-12-08 15:25:44.775 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.scrips.sequence-availability.threshold-percentage=0.8 2022-12-08 15:25:44.775 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-cluster-not-exists-name=__UNKNOWN__ 2022-12-08 15:25:44.775 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-database-not-exists-name=__UNKNOWN__ 2022-12-08 15:25:44.775 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-host-not-exists-ip=__UNKNOWN__ 2022-12-08 15:25:44.776 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.target-tenant-not-exists-name=__UNKNOWN__ 2022-12-08 15:25:44.776 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.core-pool-size=5 2022-12-08 15:25:44.776 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.max-pool-size=100 2022-12-08 15:25:44.776 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.queue-size=100 2022-12-08 15:25:44.777 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.inspection.task.thread-keep-alive-time=100 2022-12-08 15:25:44.777 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.internal.rpc.user.password=****** 2022-12-08 15:25:44.777 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.internal.rpc.user.username=system 2022-12-08 15:25:44.777 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.http.connect.timeout=180000 2022-12-08 15:25:44.777 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.http.read.timeout=180000 2022-12-08 15:25:44.778 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.download.tmp.dir=#{systemProperties['user.home'].concat('/logs/ocp')} 2022-12-08 15:25:44.778 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.max-download-speed=1024 2022-12-08 15:25:44.778 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.host=/var/log/message* 2022-12-08 15:25:44.778 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.obproxy=/home/admin/logs/obproxy/log/* 2022-12-08 15:25:44.779 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.observer=%s/log/* 2022-12-08 15:25:44.779 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.log.regex.ocp_agent=/home/admin/ocp_agent/log/* 2022-12-08 15:25:44.779 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.enabled=true 2022-12-08 15:25:44.780 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.private-key=****** 2022-12-08 15:25:44.780 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.login.encryption.public-key=****** 2022-12-08 15:25:44.780 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.meta.cluster.name= 2022-12-08 15:25:44.780 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.metric.collect.interval.second=1 2022-12-08 15:25:44.781 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.migration.meta.baseline=4.0.0-20220930 2022-12-08 15:25:44.781 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.host.enabled=true 2022-12-08 15:25:44.781 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.max-pool-size=3000 2022-12-08 15:25:44.781 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obcluster.enabled=true 2022-12-08 15:25:44.782 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obproxy.enabled=true 2022-12-08 15:25:44.782 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.collect.obsdk.sql-query-row-limit=10000 2022-12-08 15:25:44.783 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.data.retention-days={"ob_cluster_system_event":31,"ocp_metric_data_1":8,"ocp_metric_data_60":31,"metric_hour_data":1098,"metric_daily_data":1098} 2022-12-08 15:25:44.783 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.datasource.query.timeout.sec=120 2022-12-08 15:25:44.783 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.datasource.socket.timeout.ms=120000 2022-12-08 15:25:44.784 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.check-active-period-seconds=60 2022-12-08 15:25:44.784 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.check-inactive-period-seconds=50 2022-12-08 15:25:44.784 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.exporter.inactive.threshold.seconds=300 2022-12-08 15:25:44.784 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.host.exporters=/metrics/node/host,:62888/metrics/stat,:62889/metrics/stat 2022-12-08 15:25:44.785 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.host.metrics-list=load1,load5,load15,cpu_percent,io_read,io_write,io_read_time,io_write_time,io_read_byte,io_write_byte,net_recv,net_send,memory_used,memory_buffers,memory_free,host_disk_used,disk_percent,net_recv_percent,load1_per_cpu,memory_percent,net_send_percent,disk_readonly_flag,ssd_wear_indicator,tcp_retrans_percent,host_partition_usage_percent,memory_cached,ob_log_disk_usage_percent,ob_data_disk_usage_percent,ob_install_disk_usage_percent 2022-12-08 15:25:44.785 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.minute.exporters=:62888/metrics/stat,:62889/metrics/stat,/metrics/ob/extra,/metrics/obcloud/extra 2022-12-08 15:25:44.785 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.ob.exporters=/metrics/node/ob,/metrics/ob/basic,/metrics/ob/extra 2022-12-08 15:25:44.785 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.obproxy.exporters=/metrics/node/obproxy,/metrics/obproxy 2022-12-08 15:25:44.786 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitor.second.exporters=/metrics/node/host,/metrics/node/ob,/metrics/ob/basic,/metrics/node/obproxy,/metrics/obproxy 2022-12-08 15:25:44.786 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.database=monitor_database 2022-12-08 15:25:44.786 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.driverClassName=com.oceanbase.jdbc.Driver 2022-12-08 15:25:44.786 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.initialSize=10 2022-12-08 15:25:44.787 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.keepAlive=true 2022-12-08 15:25:44.787 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.maxActive=200 2022-12-08 15:25:44.787 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.maxWait=2000 2022-12-08 15:25:44.787 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.minIdle=2 2022-12-08 15:25:44.788 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.name=monitordb-connect-pool 2022-12-08 15:25:44.788 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.testWhileIdle=true 2022-12-08 15:25:44.788 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.druid.validationQuery=SELECT 1 FROM DUAL 2022-12-08 15:25:44.788 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.host=192.168.28.54 2022-12-08 15:25:44.789 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.password=****** 2022-12-08 15:25:44.790 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.port=2883 2022-12-08 15:25:44.790 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.monitordb.username=monitor_user@monitor_tenant#obcluster 2022-12-08 15:25:44.790 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.enabled=false 2022-12-08 15:25:44.790 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.heartbeat.expire.seconds=60 2022-12-08 15:25:44.791 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.heartbeat.interval.seconds=10 2022-12-08 15:25:44.791 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.replication.interval.seconds=30 2022-12-08 15:25:44.791 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.multi-cluster.replication.properties.metadb.global-tables=[{"tableName":"mc_ocp_cluster", "mode":"FULL", "querySql":"select `id`, `name`, `role`, `address`, `metadb_config`, `version`, `status`, `last_heartbeat_time`, `create_time`, `update_time` from mc_ocp_cluster","writeSql":"replace into mc_ocp_cluster (`id`, `name`, `role`, `address`, `metadb_config`, `version`, `status`, `last_heartbeat_time`, `create_time`, `update_time`) values (:id, :name, :role, :address, :metadb_config, :version, :status, :last_heartbeat_time, :create_time, :update_time)"},{"tableName":"mc_common_sequence", "mode":"FULL", "querySql":"select `id`, `name`, `next_val`, `create_time`, `update_time` from mc_common_sequence","writeSql":"replace into mc_common_sequence (`id`, `name`, `next_val`, `create_time`, `update_time`) values (:id, :name, :next_val, :create_time, :update_time)"},{"tableName":"mc_ob_cluster", "mode": "FULL", "querySql":"select `ocp_cluster_id`, `ocp_ob_cluster_id`, `ob_cluster_name`, `ob_cluster_id`, `type`, `architecture`, `rootserver_json`, `ob_version`, `locker_id`, `lock_count`, `create_time`, `update_time` from mc_ob_cluster", "writeSql":"replace into mc_ob_cluster (`ocp_cluster_id`, `ocp_ob_cluster_id`, `ob_cluster_name`, `ob_cluster_id`, `type`, `architecture`, `rootserver_json`, `ob_version`, `locker_id`, `lock_count`, `create_time`, `update_time`) values (:ocp_cluster_id, :ocp_ob_cluster_id, :ob_cluster_name, :ob_cluster_id, :type, :architecture, :rootserver_json, :ob_version, :locker_id, :lock_count, :create_time, :update_time)"}, {"tableName":"mc_ocp_cluster_remote_call", "mode":"INCREMENTAL", "querySql":"select `uuid`, `caller_id`, `executor_id`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `max_retry_times`, `retry_interval`, `current_retry_time`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time` from mc_ocp_cluster_remote_call where update_time >= :INCREMENTAL_COLUMN_VALUE", "writeSql":"replace into mc_ocp_cluster_remote_call (`uuid`, `caller_id`, `executor_id`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `max_retry_times`, `retry_interval`, `current_retry_time`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time`) values (:uuid, :caller_id, :executor_id, :task_type, :request_type, :context, :arguments_json, :output_json, :max_retry_times, :retry_interval, :current_retry_time, :timeout, :status, :start_time, :finish_time, :create_time, :update_time)", "queryMaxRecordSql":"select max(update_time) from mc_ocp_cluster_remote_call"}, {"tableName":"mc_ocp_cluster_remote_call_instance", "mode":"INCREMENTAL", "querySql":"select `uuid`, `remote_call_uuid`, `caller_id`, `executor_id`, `server_ip_port`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time` from mc_ocp_cluster_remote_call_instance where update_time >= :INCREMENTAL_COLUMN_VALUE", "writeSql":"replace into mc_ocp_cluster_remote_call_instance (`uuid`, `remote_call_uuid`, `caller_id`, `executor_id`, `server_ip_port`, `task_type`, `request_type`, `context`, `arguments_json`, `output_json`, `timeout`, `status`, `start_time`, `finish_time`, `create_time`, `update_time`) values (:uuid, :remote_call_uuid, :caller_id, :executor_id, :server_ip_port, :task_type, :request_type, :context, :arguments_json, :output_json, :timeout, :status, :start_time, :finish_time, :create_time, :update_time)","queryMaxRecordSql":"select max(update_time) from mc_ocp_cluster_remote_call_instance"}] 2022-12-08 15:25:44.792 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.agent.socks-port=1080 2022-12-08 15:25:44.792 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.host-address=localhost 2022-12-08 15:25:44.792 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.socks-port=1080 2022-12-08 15:25:44.792 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.inter-connector.web-port=8088 2022-12-08 15:25:44.793 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.network.vpc.mode.enabled=false 2022-12-08 15:25:44.793 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.cluster.ops.blacklist= 2022-12-08 15:25:44.793 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.slowsql.threshold=100000 2022-12-08 15:25:44.793 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.upgrade.allow-downgrade=false 2022-12-08 15:25:44.794 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.ob.upgrade.dependencies.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/oceanbase_upgrade_dep.yml')} 2022-12-08 15:25:44.794 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.obcloud.api.address= 2022-12-08 15:25:44.794 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.connector.cache.max-idle-seconds=3600 2022-12-08 15:25:44.795 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.connector.cache.max-size=1000 2022-12-08 15:25:44.797 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connect-timeout=5000 2022-12-08 15:25:44.797 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connection.max-per-route=100 2022-12-08 15:25:44.797 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.connection.max-pool-size=100 2022-12-08 15:25:44.798 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.read-timeout=30000 2022-12-08 15:25:44.798 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.socket-timeout=3000 2022-12-08 15:25:44.798 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.core-pool-size=500 2022-12-08 15:25:44.798 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.keep-alive-time=120000 2022-12-08 15:25:44.799 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.http.thread.max-pool-size=1500 2022-12-08 15:25:44.799 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.ssh.connect-timeout=10000 2022-12-08 15:25:44.799 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.executor.ssh.default-command-timeout=10000 2022-12-08 15:25:44.799 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.delete-server.reserve-data-enabled=false 2022-12-08 15:25:44.800 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.resource.trend.collect.period=daily 2022-12-08 15:25:44.800 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.resource.trend.max-point=20 2022-12-08 15:25:44.800 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.single-idc-for-zone-enabled=true 2022-12-08 15:25:44.800 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.sql-execute.enabled=false 2022-12-08 15:25:44.800 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.sql-execute.sql-type.whitelist=SELECT,SHOW 2022-12-08 15:25:44.801 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.tenant.allow-small-unit=false 2022-12-08 15:25:44.801 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.tenant.whitelist.attach-default-whitelist=true 2022-12-08 15:25:44.801 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.ob.unit.unused.max-reserve-hour=1 2022-12-08 15:25:44.802 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.password=****** 2022-12-08 15:25:44.802 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.username=proxyro 2022-12-08 15:25:44.802 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.obproxy.start.command.template=./bin/obproxy -p 2883 -n %s -o obproxy_config_server_url='%s/services?User_ID=alibaba&UID=test&Action=GetObProxyConfig',enable_metadb_used=false,enable_strict_kernel_release=false,enable_proxy_scramble=true,proxy_mem_limited=2G,log_dir_size_threshold=10G,prometheus_sync_interval=1s 2022-12-08 15:25:44.802 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.operation.odp.root.default.password=****** 2022-12-08 15:25:44.803 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.ash.earliest-analyse-time=8 2022-12-08 15:25:44.803 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.ash.max-analyse-range=60m 2022-12-08 15:25:44.803 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.parallel.sql.limit=2000 2022-12-08 15:25:44.803 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.parallel.sql.partition.retention.days=15 2022-12-08 15:25:44.804 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.awful-performance-index-used-config={"enabled":true, "cpuTimeLimitUs":100000, "execPsLimit":5.0, "fullLogicalReadsLimit":10000} 2022-12-08 15:25:44.804 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.cpu-time-proportion-high-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":10.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":30, "sqlCountLimit":20, "cpuTimePercentLimit":20} 2022-12-08 15:25:44.804 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.database-white-list=oceanbase,information_schema,mysql,__recyclebin,sys,__public 2022-12-08 15:25:44.804 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.diagnose.standby-cluster.enabled=0 2022-12-08 15:25:44.804 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.execution-spike-config={"enabled":true, "cpuTimeLimitUs":3000, "execPsLimit":5.0, "pointsLimit":5, "compareMin":20, "avgExecutionMultiply":{"0":6, "1":5, "5":4, "10":3, "50": 2.5, "100": 2, "500": 1.6}, "stdExecutionMultiply":{"0":80, "1":60 , "3": 30,"5":20, "10":15, "20":8, "30":6, "50":5, "80":4}} 2022-12-08 15:25:44.805 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.index-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2022-12-08 15:25:44.805 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.ineffective-hint-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 15:25:44.805 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.outline-history-query-days=30 2022-12-08 15:25:44.805 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.perf-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2022-12-08 15:25:44.806 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-after-plan-changed-config={"enabled":true, "compareMin":5, "cpuTimeMultiply":{"0":50, "1":30, "10":10, "100":8, "1000":6}} 2022-12-08 15:25:44.806 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":5.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":5, "compareMin":20, "cpuTimeMultiply":{"0":50, "1":30, "10":10, "100":8, "1000":6}} 2022-12-08 15:25:44.806 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.query-timeout=30000000 2022-12-08 15:25:44.807 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.row-lock-contention-high-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":100000, "elapsedTimeLimitUs":0} 2022-12-08 15:25:44.807 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.sql-diagnosis-retention-days=30 2022-12-08 15:25:44.807 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-exists-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 15:25:44.807 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-used-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2022-12-08 15:25:44.808 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql-diag.tenant-white-list=null 2022-12-08 15:25:44.809 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.advisor-plan-max-query-range=7d 2022-12-08 15:25:44.809 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag-plan-change-config={"enabled":true,"schedulePeriodMin":2, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":500,"diagPeriodSec":120,"diagOffsetSec":120,"maxDiagPeriodSec":600} 2022-12-08 15:25:44.809 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-queue-max-size=1000000 2022-12-08 15:25:44.809 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-core-size=30 2022-12-08 15:25:44.810 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-max-size=300 2022-12-08 15:25:44.810 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.earliest-query-time=8d 2022-12-08 15:25:44.810 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.index-advisor-cpu-time-threshold=10 2022-12-08 15:25:44.810 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.index-advisor-elapsed-time-threshold=20 2022-12-08 15:25:44.811 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.info.parameterize.sql=false 2022-12-08 15:25:44.811 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.info.parse.sql.type=true 2022-12-08 15:25:44.811 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.max-query-range=24h 2022-12-08 15:25:44.811 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.batch.insert.size=100 2022-12-08 15:25:44.811 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.core.thread=8 2022-12-08 15:25:44.812 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.insert.query.rate.limit=10 2022-12-08 15:25:44.812 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.max.thread=16 2022-12-08 15:25:44.812 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.query.limit=2000 2022-12-08 15:25:44.812 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.parse.queue.size=20000 2022-12-08 15:25:44.813 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-granularity=30s 2022-12-08 15:25:44.813 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-query-interval=2h 2022-12-08 15:25:44.813 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-retention=8d 2022-12-08 15:25:44.813 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.prepare-partition-ahead=8 2022-12-08 15:25:44.814 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-digest-limit=0 2022-12-08 15:25:44.814 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-digest-trend.points=15 2022-12-08 15:25:44.814 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.query-timeout=30000000 2022-12-08 15:25:44.814 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.slow-sql-limit=2000 2022-12-08 15:25:44.815 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-audit-sample-retention=8d 2022-12-08 15:25:44.815 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-granularity=30s 2022-12-08 15:25:44.815 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-query-interval=2h 2022-12-08 15:25:44.815 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-retention=2d 2022-12-08 15:25:44.816 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-granularity=2m 2022-12-08 15:25:44.816 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-query-interval=12h 2022-12-08 15:25:44.816 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-retention=8d 2022-12-08 15:25:44.816 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-granularity=10m 2022-12-08 15:25:44.816 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-query-interval=48h 2022-12-08 15:25:44.817 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-retention=15d 2022-12-08 15:25:44.817 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-info-secondary-cache-expiration=30m 2022-12-08 15:25:44.817 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level0-query-interval=30m 2022-12-08 15:25:44.817 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level1-query-interval=2h 2022-12-08 15:25:44.818 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.top-sql-limit=2000 2022-12-08 15:25:44.818 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.sql.tuning-advisor-cpu-time-ratio-of-plan-comparison=0.8 2022-12-08 15:25:44.818 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.perf.transaction.partition.retention.days=7 2022-12-08 15:25:44.818 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.site.url=http://192.168.28.62:8080 2022-12-08 15:25:44.819 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.startup-check.metadb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2022-12-08 15:25:44.819 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.startup-check.monitordb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2022-12-08 15:25:44.819 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.default.language=zh-CN 2022-12-08 15:25:44.819 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.default.timezone= 2022-12-08 15:25:44.820 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.event.excluded={balancer: {'start_sql_bkgd_task','finish_sql_bkgd_task'}} 2022-12-08 15:25:44.820 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.address=localhost 2022-12-08 15:25:44.821 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.cluster-name=obdv1 2022-12-08 15:25:44.821 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.database=obproxy 2022-12-08 15:25:44.821 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.enabled=false 2022-12-08 15:25:44.821 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.metadb.user=root@obproxy 2022-12-08 15:25:44.822 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.system.obproxy.port=2888 2022-12-08 15:25:44.822 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.batch-interval-millis=10 2022-12-08 15:25:44.822 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.batch-size=1000 2022-12-08 15:25:44.822 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.preserve-days=30 2022-12-08 15:25:44.823 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.thread.core-pool-size=4 2022-12-08 15:25:44.823 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.table-cleaning.thread.maximum-pool-size=16 2022-12-08 15:25:44.823 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.version=4.0.0 2022-12-08 15:25:44.823 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ocp.web.tracking.enabled=False 2022-12-08 15:25:44.824 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.client-id=TO_BE_REPLACED 2022-12-08 15:25:44.824 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.client-secret=****** 2022-12-08 15:25:44.824 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.issuer=https://example.com/oauth2/default 2022-12-08 15:25:44.824 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : okta.oauth2.redirect-uri=TO_BE_REPLACED 2022-12-08 15:25:44.824 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : server.port=8080 2022-12-08 15:25:44.825 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : server.servlet.session.timeout=30m 2022-12-08 15:25:44.825 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : slow-sql.query-sql-info-from.cache.directly=false 2022-12-08 15:25:44.825 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.data.web.pageable.one-indexed-parameters=true 2022-12-08 15:25:44.825 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.initialSize=10 2022-12-08 15:25:44.826 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.keepAlive=true 2022-12-08 15:25:44.826 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.maxActive=100 2022-12-08 15:25:44.826 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.maxWait=2000 2022-12-08 15:25:44.826 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.minIdle=2 2022-12-08 15:25:44.827 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.name=metadb-connect-pool 2022-12-08 15:25:44.827 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.testWhileIdle=true 2022-12-08 15:25:44.827 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.datasource.druid.validationQuery=SELECT 1 FROM DUAL 2022-12-08 15:25:44.827 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.hibernate.naming-strategy=org.hibernate.cfg.ImprovedNamingStrategy 2022-12-08 15:25:44.828 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.properties.hibernate.dialect=org.hibernate.dialect.MySQL5Dialect 2022-12-08 15:25:44.828 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.jpa.properties.hibernate.globally_quoted_identifiers=true 2022-12-08 15:25:44.828 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.enabled=true 2022-12-08 15:25:44.828 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.max-file-size=2048MB 2022-12-08 15:25:44.829 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : spring.servlet.multipart.max-request-size=2048MB 2022-12-08 15:25:44.829 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.api-docs.enabled=false 2022-12-08 15:25:44.829 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.api-docs.path=/doc/api-docs 2022-12-08 15:25:44.830 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.paths-to-exclude=null 2022-12-08 15:25:44.830 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.paths-to-match=/api/v2/** 2022-12-08 15:25:44.831 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : springdoc.swagger-ui.path=/doc/swagger-ui.html 2022-12-08 15:25:44.831 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : sql-stat.flush-sql-info-to-cache=true 2022-12-08 15:25:44.831 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.core-pool-size=8 2022-12-08 15:25:44.831 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.max-pool-size=64 2022-12-08 15:25:44.832 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : storage.capacity.compute.executor.task-queue-size=1800 2022-12-08 15:25:44.832 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : top-sql.query-sql-info-from.cache.directly=false 2022-12-08 15:25:44.832 INFO 42 --- [main,,] c.a.ocp.server.trace.PropertyLogger : ****************************************************************************** 2022-12-08 15:25:45.355 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:25:45.356 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:25:45.449 INFO 42 --- [pool-ocp-schedules-1,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 15:25:45.491 INFO 42 --- [pool-ocp-schedules-9,,03ae06de8a90] .s.a.AnnotationAsyncExecutionInterceptor : More than one TaskExecutor bean found within the context, and none is named 'taskExecutor'. Mark one of them as primary or name it 'taskExecutor' (possibly as an alias) in order to use it for async processing: [alarmTaskExecutor, notificationSendExecutor, alarmDetectMetricExecutor] 2022-12-08 15:25:45.521 INFO 42 --- [pool-ocp-schedules-2,,ab3d9e829963] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:25:45.649 INFO 42 --- [pool-ocp-schedules-20,,bc81d144f711] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:25:45.655 INFO 42 --- [pool-ocp-schedules-7,,4cb2fd3a4d63] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:25:45.656 INFO 42 --- [pool-ocp-schedules-8,,0b749bdd658d] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:25:45.659 INFO 42 --- [pool-ocp-schedules-2,,ab3d9e829963] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:25:45.667 INFO 42 --- [pool-ocp-schedules-15,,2ee7825fb5d4] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 15:25:45.711 INFO 42 --- [pool-ocp-schedules-19,,3355bf00c75f] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:25:45.711 INFO 42 --- [pool-ocp-schedules-19,,3355bf00c75f] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:25:45.933 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=2 2022-12-08 15:25:45.942 INFO 42 --- [pool-ocp-schedules-8,,c60b22ccc775] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:25:45.950 INFO 42 --- [pool-ocp-schedules-2,,6e62886440b9] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:25:45.953 INFO 42 --- [pool-ocp-schedules-4,,6a796ddcaf55] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 15:25:45.991 INFO 42 --- [pool-ocp-schedules-9,,4d58dc244a02] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:25:46.015 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.service.TaskRepositoryService : fetchNeedExecute, tryAcquireTasksCount=2, fetchedCount=2 2022-12-08 15:25:46.016 INFO 42 --- [pool-ocp-schedules-13,,1fd7fe57cc14] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:25:46.019 INFO 42 --- [pool-ocp-schedules-13,,1fd7fe57cc14] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:25:46.021 INFO 42 --- [pool-ocp-schedules-13,,1fd7fe57cc14] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:25:46.116 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.alarm.core.task.AlarmDetectTask : AlarmDetectTask created 2022-12-08 15:25:46.122 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=1, uuid=5d1c7c8a-1780-40fe-8c4f-b46ce797f238, taskType=AlarmDetect, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T07:02:01.539848Z, startAt=2022-12-08T07:25:45.943Z, endAt=null, heartbeatAt=2022-12-08T07:25:45.943Z, result=executing) 2022-12-08 15:25:46.143 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:25:46.163 INFO 42 --- [pool-ocp-schedules-14,,3945f784fafe] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100000, channelName=钉钉群消息样例 2022-12-08 15:25:46.164 INFO 42 --- [pool-ocp-schedules-14,,3945f784fafe] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=钉钉群消息样例 2022-12-08 15:25:46.315 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100000, channelName=钉钉群消息样例 2022-12-08 15:25:46.316 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=钉钉群消息样例 2022-12-08 15:25:46.357 INFO 42 --- [pool-ocp-schedules-14,,3945f784fafe] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100001, channelName=自定义脚本通道(待配置样例) 2022-12-08 15:25:46.357 INFO 42 --- [pool-ocp-schedules-14,,3945f784fafe] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=自定义脚本通道(待配置样例) 2022-12-08 15:25:46.358 INFO 42 --- [pool-ocp-schedules-14,,3945f784fafe] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=2, updatedCount=2, failedToUpdateCount=0 2022-12-08 15:25:46.445 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:25:46.456 INFO 42 --- [main,,] com.alipay.ocp.OcpServerApplication : Started OcpServerApplication in 337.12 seconds (JVM running for 343.302) 2022-12-08 15:25:46.539 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100001, channelName=自定义脚本通道(待配置样例) 2022-12-08 15:25:46.539 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=自定义脚本通道(待配置样例) 2022-12-08 15:25:46.539 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=2, updatedCount=2, failedToUpdateCount=0 2022-12-08 15:25:46.545 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.core.process.AlarmProcessor : AlarmProcessor init done, lastProcessTime=2022-12-08T15:25:46.539739+08:00 2022-12-08 15:25:46.546 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.core.task.AlarmProcessTask : AlarmProcessTask created 2022-12-08 15:25:46.566 INFO 42 --- [SimpleAsyncTaskExecutor-12,,] c.o.o.p.a.i.SessionEventSyncService : start to sync session wait event info, cluster ids is [] 2022-12-08 15:25:46.567 INFO 42 --- [SimpleAsyncTaskExecutor-12,,] c.o.o.p.a.i.SessionEventSyncService : Sync session wait event info finished, cluster ids is [] 2022-12-08 15:25:46.574 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=2, uuid=142cf501-1f3a-4dfd-adba-cf2d83e0b467, taskType=AlarmProcess, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T07:02:01.647237Z, startAt=2022-12-08T07:25:45.943Z, endAt=null, heartbeatAt=2022-12-08T07:25:45.943Z, result=executing) 2022-12-08 15:25:46.575 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.utils.task.AlarmTaskManager : startNeedExecute, activeCount=0, tryStartCount=2, startedCount=2 2022-12-08 15:25:46.664 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:25:46.651969+08:00, lastProcessTime=2022-12-08T15:25:46.539739+08:00 2022-12-08 15:25:46.668 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:25:46.668 INFO 42 --- [pool-ocp-schedules-18,,d23b28b7a718] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:25:46.740 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obagent_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.742 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obagent_dead 2022-12-08 15:25:46.742 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obagent_dead 2022-12-08 15:25:46.744 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cannot_connected, duration=PT1M, resolveTimeout=PT10S 2022-12-08 15:25:46.744 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cannot_connected 2022-12-08 15:25:46.744 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cannot_connected 2022-12-08 15:25:46.748 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_connection_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.748 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_connection_percent_over_threshold 2022-12-08 15:25:46.748 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_connection_percent_over_threshold 2022-12-08 15:25:46.749 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 15:25:46.749 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_cpu_percent_over_threshold 2022-12-08 15:25:46.749 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_cpu_percent_over_threshold 2022-12-08 15:25:46.750 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 15:25:46.750 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cpu_percent_over_threshold 2022-12-08 15:25:46.750 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cpu_percent_over_threshold 2022-12-08 15:25:46.751 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.751 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold 2022-12-08 15:25:46.751 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_frozen_version_delta_over_threshold 2022-12-08 15:25:46.752 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_net_recv_percent_over_threshold, duration=PT2M, resolveTimeout=PT1M 2022-12-08 15:25:46.752 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_recv_percent_over_threshold 2022-12-08 15:25:46.753 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_net_recv_percent_over_threshold 2022-12-08 15:25:46.753 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_exists_inactive_server, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:25:46.753 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_inactive_server 2022-12-08 15:25:46.754 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_exists_inactive_server 2022-12-08 15:25:46.754 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_exists_index_fail_table, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.755 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_index_fail_table 2022-12-08 15:25:46.755 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_exists_index_fail_table 2022-12-08 15:25:46.756 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_load1_per_cpu_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 15:25:46.756 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_load1_per_cpu_over_threshold 2022-12-08 15:25:46.756 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_load1_per_cpu_over_threshold 2022-12-08 15:25:46.758 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_mem_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.758 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_mem_percent_over_threshold 2022-12-08 15:25:46.758 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_mem_percent_over_threshold 2022-12-08 15:25:46.759 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_merge_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.760 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_timeout 2022-12-08 15:25:46.760 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_merge_timeout 2022-12-08 15:25:46.761 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_merge_error, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.761 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_error 2022-12-08 15:25:46.761 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_merge_error 2022-12-08 15:25:46.762 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_no_frozen, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.762 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_frozen 2022-12-08 15:25:46.762 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_no_frozen 2022-12-08 15:25:46.764 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_no_merge, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.765 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_merge 2022-12-08 15:25:46.765 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_no_merge 2022-12-08 15:25:46.765 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_net_send_percent_over_threshold, duration=PT2M, resolveTimeout=PT1M 2022-12-08 15:25:46.766 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_send_percent_over_threshold 2022-12-08 15:25:46.766 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_net_send_percent_over_threshold 2022-12-08 15:25:46.766 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_partition_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.767 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_partition_count_over_threshold 2022-12-08 15:25:46.767 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_partition_count_over_threshold 2022-12-08 15:25:46.767 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_disk_readonly, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.768 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_disk_readonly 2022-12-08 15:25:46.768 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_disk_readonly 2022-12-08 15:25:46.769 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant500_mem_hold_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.769 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_over_threshold 2022-12-08 15:25:46.769 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant500_mem_hold_over_threshold 2022-12-08 15:25:46.770 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_server_sstable_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.771 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_sstable_percent_over_threshold 2022-12-08 15:25:46.771 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_server_sstable_percent_over_threshold 2022-12-08 15:25:46.772 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_zone_sstable_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.772 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_zone_sstable_percent_over_threshold 2022-12-08 15:25:46.772 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_zone_sstable_percent_over_threshold 2022-12-08 15:25:46.772 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold, duration=PT1M, resolveTimeout=PT10S 2022-12-08 15:25:46.773 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold 2022-12-08 15:25:46.773 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_tcp_retrans_percent_over_threshold 2022-12-08 15:25:46.773 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.774 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold 2022-12-08 15:25:46.774 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant500_mem_hold_percent_over_threshold 2022-12-08 15:25:46.774 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_active_memstore_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.775 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_active_memstore_percent_over_threshold 2022-12-08 15:25:46.775 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_active_memstore_percent_over_threshold 2022-12-08 15:25:46.775 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_cpu_percent_over_threshold, duration=PT1M, resolveTimeout=PT1M 2022-12-08 15:25:46.776 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_cpu_percent_over_threshold 2022-12-08 15:25:46.776 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_cpu_percent_over_threshold 2022-12-08 15:25:46.777 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=tenant_memstore_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.778 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_memstore_percent_over_threshold 2022-12-08 15:25:46.778 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=tenant_memstore_percent_over_threshold 2022-12-08 15:25:46.778 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_sync_failed, duration=PT2M, resolveTimeout=PT1M 2022-12-08 15:25:46.779 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_failed 2022-12-08 15:25:46.779 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_sync_failed 2022-12-08 15:25:46.779 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_status_check_failed, duration=PT2M, resolveTimeout=PT1M 2022-12-08 15:25:46.780 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_status_check_failed 2022-12-08 15:25:46.780 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_status_check_failed 2022-12-08 15:25:46.780 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_cluster_sync_delay_time_too_long, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.780 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_delay_time_too_long 2022-12-08 15:25:46.781 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_cluster_sync_delay_time_too_long 2022-12-08 15:25:46.781 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_exists_expired_xa_trans, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.781 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_exists_expired_xa_trans 2022-12-08 15:25:46.782 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_exists_expired_xa_trans 2022-12-08 15:25:46.782 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=backup_storage_capacity_retry_times_exceeded, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.783 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_retry_times_exceeded 2022-12-08 15:25:46.783 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=backup_storage_capacity_retry_times_exceeded 2022-12-08 15:25:46.783 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=backup_storage_capacity_timeout_or_interrupted, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.784 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_timeout_or_interrupted 2022-12-08 15:25:46.784 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=backup_storage_capacity_timeout_or_interrupted 2022-12-08 15:25:46.784 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_unavailable, duration=PT2M, resolveTimeout=PT1M 2022-12-08 15:25:46.785 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_unavailable 2022-12-08 15:25:46.785 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_unavailable 2022-12-08 15:25:46.786 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ocp_remote_server_time_diff_too_large, duration=PT1M, resolveTimeout=PT1M 2022-12-08 15:25:46.786 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_remote_server_time_diff_too_large 2022-12-08 15:25:46.786 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ocp_remote_server_time_diff_too_large 2022-12-08 15:25:46.787 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxy_process_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.787 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_dead 2022-12-08 15:25:46.788 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxy_process_dead 2022-12-08 15:25:46.788 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxyd_process_dead, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.788 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_dead 2022-12-08 15:25:46.789 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxyd_process_dead 2022-12-08 15:25:46.789 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=obproxy_cannot_connected, duration=PT1M, resolveTimeout=PT10S 2022-12-08 15:25:46.789 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_cannot_connected 2022-12-08 15:25:46.790 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=obproxy_cannot_connected 2022-12-08 15:25:46.790 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_install_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.791 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_install_disk_percent_over_threshold 2022-12-08 15:25:46.791 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_install_disk_percent_over_threshold 2022-12-08 15:25:46.792 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_data_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.792 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_data_disk_percent_over_threshold 2022-12-08 15:25:46.792 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_data_disk_percent_over_threshold 2022-12-08 15:25:46.793 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_log_disk_percent_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.794 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_log_disk_percent_over_threshold 2022-12-08 15:25:46.794 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_log_disk_percent_over_threshold 2022-12-08 15:25:46.794 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=monitor_exporter_unavaliable, duration=PT3M, resolveTimeout=PT1M 2022-12-08 15:25:46.795 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monitor_exporter_unavaliable 2022-12-08 15:25:46.795 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=monitor_exporter_unavaliable 2022-12-08 15:25:46.795 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_ntp_service_not_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.795 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_service_not_exist 2022-12-08 15:25:46.796 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_ntp_service_not_exist 2022-12-08 15:25:46.796 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_ntp_offset_too_large, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.796 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_offset_too_large 2022-12-08 15:25:46.797 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_ntp_offset_too_large 2022-12-08 15:25:46.797 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ic_server_connect_failed, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.797 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ic_server_connect_failed 2022-12-08 15:25:46.798 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ic_server_connect_failed 2022-12-08 15:25:46.798 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=vpc_connect_failed, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.798 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=vpc_connect_failed 2022-12-08 15:25:46.799 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=vpc_connect_failed 2022-12-08 15:25:46.799 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_disk_readonly, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.800 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_disk_readonly 2022-12-08 15:25:46.800 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_disk_readonly 2022-12-08 15:25:46.801 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_goroutine_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.801 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_goroutine_count_over_threshold 2022-12-08 15:25:46.802 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_goroutine_count_over_threshold 2022-12-08 15:25:46.802 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_open_fd_count_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.802 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_open_fd_count_over_threshold 2022-12-08 15:25:46.803 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_open_fd_count_over_threshold 2022-12-08 15:25:46.803 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=host_agent_res_memory_over_threshold, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.804 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_res_memory_over_threshold 2022-12-08 15:25:46.804 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=host_agent_res_memory_over_threshold 2022-12-08 15:25:46.805 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_compaction_error, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.806 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_compaction_error 2022-12-08 15:25:46.806 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_compaction_error 2022-12-08 15:25:46.806 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_no_frozen, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.806 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_frozen 2022-12-08 15:25:46.807 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_no_frozen 2022-12-08 15:25:46.809 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_no_compaction, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.810 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_compaction 2022-12-08 15:25:46.810 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_no_compaction 2022-12-08 15:25:46.811 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_log_disk_usage_high, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.811 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_disk_usage_high 2022-12-08 15:25:46.811 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_log_disk_usage_high 2022-12-08 15:25:46.812 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_host_task_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.812 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_task_timeout 2022-12-08 15:25:46.812 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_host_task_timeout 2022-12-08 15:25:46.813 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_task_timeout, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.813 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_task_timeout 2022-12-08 15:25:46.814 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_task_timeout 2022-12-08 15:25:46.814 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_expired_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.815 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_expired_trans_exist 2022-12-08 15:25:46.815 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_expired_trans_exist 2022-12-08 15:25:46.816 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_long_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.816 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_long_trans_exist 2022-12-08 15:25:46.816 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_long_trans_exist 2022-12-08 15:25:46.817 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=ob_tenant_large_trans_exist, duration=PT0S, resolveTimeout=PT1M 2022-12-08 15:25:46.817 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_large_trans_exist 2022-12-08 15:25:46.817 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=ob_tenant_large_trans_exist 2022-12-08 15:25:46.818 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=node_file_root_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:25:46.818 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_root_usage 2022-12-08 15:25:46.818 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=node_file_root_usage 2022-12-08 15:25:46.821 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_fd_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:25:46.821 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_fd_usage 2022-12-08 15:25:46.822 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_fd_usage 2022-12-08 15:25:46.823 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_sys_abnormal, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.823 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_sys_abnormal 2022-12-08 15:25:46.823 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_sys_abnormal 2022-12-08 15:25:46.825 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_util_full, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.826 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_full 2022-12-08 15:25:46.826 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_util_full 2022-12-08 15:25:46.828 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_cpu_util_hwm, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.828 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_hwm 2022-12-08 15:25:46.828 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_cpu_util_hwm 2022-12-08 15:25:46.830 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_kernel_io_hang, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.831 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_kernel_io_hang 2022-12-08 15:25:46.831 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_kernel_io_hang 2022-12-08 15:25:46.832 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_sda_ioawait, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.833 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_sda_ioawait 2022-12-08 15:25:46.833 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_sda_ioawait 2022-12-08 15:25:46.834 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_nvme_ioawait, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.834 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_nvme_ioawait 2022-12-08 15:25:46.834 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_nvme_ioawait 2022-12-08 15:25:46.835 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_drop, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.835 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_drop 2022-12-08 15:25:46.836 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_drop 2022-12-08 15:25:46.837 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_error, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.837 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_error 2022-12-08 15:25:46.837 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_error 2022-12-08 15:25:46.838 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_not_exist, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:25:46.838 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_not_exist 2022-12-08 15:25:46.838 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_not_exist 2022-12-08 15:25:46.839 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_observer_core_dump, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:25:46.839 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_core_dump 2022-12-08 15:25:46.839 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_observer_core_dump 2022-12-08 15:25:46.840 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_nic_1000m_full, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.842 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_full 2022-12-08 15:25:46.842 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_nic_1000m_full 2022-12-08 15:25:46.843 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_nic_1000m_hwm, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.843 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_hwm 2022-12-08 15:25:46.844 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_nic_1000m_hwm 2022-12-08 15:25:46.845 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_tsar_traffic_overload, duration=PT30S, resolveTimeout=PT10S 2022-12-08 15:25:46.845 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_overload 2022-12-08 15:25:46.845 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_tsar_traffic_overload 2022-12-08 15:25:46.846 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=node_file_inode_usage, duration=PT0S, resolveTimeout=PT10S 2022-12-08 15:25:46.846 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_inode_usage 2022-12-08 15:25:46.846 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=node_file_inode_usage 2022-12-08 15:25:46.847 INFO 42 --- [alarm-task-1,,283f39dff65d] .a.o.s.a.c.d.AlarmRuleDetectStateManager : AlarmRuleDetectStateManager construct done, alarmType=os_cpu_irq_error, duration=PT1M, resolveTimeout=PT10S 2022-12-08 15:25:46.847 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_cpu_irq_error 2022-12-08 15:25:46.848 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=os_cpu_irq_error 2022-12-08 15:25:46.848 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=75, updatedCount=75, failedToUpdateCount=0 2022-12-08 15:25:47.130 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:25:46.651969+08:00, resultsCount=0 2022-12-08 15:25:47.131 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:25:46.651969+08:00, resultsCount=0 2022-12-08 15:25:47.131 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:25:46.651969+08:00 2022-12-08 15:25:47.181 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:47.188 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:47.896 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:25:47.911 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:25:48.473 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:25:49.538 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:25:49.541 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:25:49.914 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:25:49.936 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:25:49.992 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:25:50.188 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:50.193 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:50.230 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:25:50.565 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:24:49+08:00, updateTime=2022-12-08T15:25:19+08:00, expireTime=null, isLeader=false} 2022-12-08 15:25:50.572 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:25:50.906 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:25:51.354 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:25:51.732 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:25:51.807 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:25:51.808 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:25:52.013 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:25:52.658 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:25:52.659 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:25:53.194 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:53.200 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:55.440 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:25:55.448 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:25:55.662 INFO 42 --- [pool-ocp-schedules-20,,db4880224d03] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:25:55.931 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:25:56.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:25:56.201 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:56.210 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:25:56.182826+08:00, lastProcessTime=2022-12-08T15:25:46.651969+08:00 2022-12-08 15:25:56.210 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:56.474 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:25:56.182826+08:00, resultsCount=0 2022-12-08 15:25:56.475 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:25:56.182826+08:00, resultsCount=0 2022-12-08 15:25:56.475 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:25:56.182826+08:00 2022-12-08 15:25:56.565 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:25:56.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,ed025699c396] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484360, interval=60 2022-12-08 15:25:56.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,ed025699c396] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484356, count=0, elapsed=1668813872280 2022-12-08 15:25:56.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,28e40b73dfbb] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484360, interval=60 2022-12-08 15:25:56.641 INFO 42 --- [pool-prometheus-minute-schedule-2,,28e40b73dfbb] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484356, count=0, elapsed=1668813872285 2022-12-08 15:25:58.389 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:25:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,e25c9ca0d2ef] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:25:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,e25c9ca0d2ef] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:25:58.765 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:25:59.211 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:25:59.216 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:25:59.230 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:25:59.231 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:00.066 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:30.0, nextRun=2022-12-08 15:26:00.0, currentDate=Thu Dec 08 15:26:00 CST 2022 2022-12-08 15:26:00.067 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:25:30.0, nextRunTime=2022-12-08 15:26:00.0} 2022-12-08 15:26:00.098 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:26:00.432 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:33.0, nextRun=2022-12-08 15:26:00.0, currentDate=Thu Dec 08 15:26:00 CST 2022 2022-12-08 15:26:00.433 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:25:33.0, nextRunTime=2022-12-08 15:26:00.0} 2022-12-08 15:26:00.458 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:26:00.459 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:26:00.459 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:26:00.634 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:34.0, nextRun=2022-12-08 15:26:00.0, currentDate=Thu Dec 08 15:26:00 CST 2022 2022-12-08 15:26:00.636 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:25:34.0, nextRunTime=2022-12-08 15:26:00.0} 2022-12-08 15:26:00.690 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.o.o.p.t.i.a.CollectTransSatatSchedule : The last trans sql collect task is still running, skip current task 2022-12-08 15:26:00.691 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Collect trans stat to SqlAggregateData for alarm 2022-12-08 15:26:00.769 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:34.0, nextRun=2022-12-08 15:26:00.0, currentDate=Thu Dec 08 15:26:00 CST 2022 2022-12-08 15:26:00.775 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:25:34.0, nextRunTime=2022-12-08 15:26:00.0} 2022-12-08 15:26:00.813 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.o.o.p.s.i.a.CollectSlowSqlSchedule : The last slow sql collect task is still running, skip current task 2022-12-08 15:26:00.813 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Collect SlowSql to SqlAggregateData for alarm 2022-12-08 15:26:01.017 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:34.0, nextRun=2022-12-08 15:26:00.0, currentDate=Thu Dec 08 15:26:01 CST 2022 2022-12-08 15:26:01.018 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:25:34.0, nextRunTime=2022-12-08 15:26:00.0} 2022-12-08 15:26:01.044 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:26:01.044 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:26:01.045 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:26:01.099 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:01.245 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:35.0, nextRun=2022-12-08 15:26:00.0, currentDate=Thu Dec 08 15:26:01 CST 2022 2022-12-08 15:26:01.246 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:25:35.0, nextRunTime=2022-12-08 15:26:00.0} 2022-12-08 15:26:01.266 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:26:01.267 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:26:01.268 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:26:01.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:01.723 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:01.732 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:26:02.013 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:02.217 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:02.222 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:02.299 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:26:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,9b287d955df9] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484420, interval=60 2022-12-08 15:26:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,9b287d955df9] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484362, count=0, elapsed=1668813878274 2022-12-08 15:26:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,e8f047a23e48] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484420, interval=60 2022-12-08 15:26:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,e8f047a23e48] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484362, count=0, elapsed=1668813878278 2022-12-08 15:26:04.134 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:26:04.142 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:26:04.880 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:05.223 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:05.230 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:05.238 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:26:05.663 INFO 42 --- [pool-ocp-schedules-5,,e52e147aa680] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:26:05.939 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:06.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:26:06.176 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:26:06.171884+08:00, lastProcessTime=2022-12-08T15:25:56.182826+08:00 2022-12-08 15:26:06.200 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:29.0, nextRun=2022-12-08 15:26:05.0, currentDate=Thu Dec 08 15:26:06 CST 2022 2022-12-08 15:26:06.201 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:25:29.0, nextRunTime=2022-12-08 15:26:05.0} 2022-12-08 15:26:06.228 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:26:06.229 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:26:06.229 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:26:06.285 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:26:06.402 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:26:06.171884+08:00, resultsCount=0 2022-12-08 15:26:06.402 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:26:06.171884+08:00, resultsCount=0 2022-12-08 15:26:06.403 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:26:06.171884+08:00 2022-12-08 15:26:06.620 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:26:07.323 INFO 42 --- [pool-ocp-schedules-6,,4af2d5207b63] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:26:07.324 INFO 42 --- [pool-ocp-schedules-6,,4af2d5207b63] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:26:08.048 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:08.048 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:08.231 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:08.238 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:09.159 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:09.160 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:11.229 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:11.239 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:11.244 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:11.866 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:26:12.070 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:26:12.081 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:26:12.299 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:12.613 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:12.703 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:26:14.245 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:14.250 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:14.749 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:15.500 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:26:15.665 INFO 42 --- [pool-ocp-schedules-17,,b2779529f594] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:26:16.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:16.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:26:16.162 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:26:16.157007+08:00, lastProcessTime=2022-12-08T15:26:06.171884+08:00 2022-12-08 15:26:16.403 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:26:16.157007+08:00, resultsCount=0 2022-12-08 15:26:16.403 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:26:16.157007+08:00, resultsCount=0 2022-12-08 15:26:16.404 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:26:16.157007+08:00 2022-12-08 15:26:16.730 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:26:17.251 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:17.257 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:17.786 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T15:13:18.269, end=2022-12-08T15:25:17.326} 2022-12-08 15:26:17.788 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T15:13:18.329, end=2022-12-08T15:25:17.326} 2022-12-08 15:26:17.848 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:26:17.848 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:26:18.464 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:14:18.504, end=2022-12-08T15:24:17.777} 2022-12-08 15:26:18.490 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:26:18.498 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:18.498 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:19.580 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:26:19.993 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:26:20.258 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:20.268 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:20.595 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:26:21.179 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:26:21.491 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 160, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:21.554 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:25:50+08:00, updateTime=2022-12-08T15:25:50+08:00, expireTime=null, isLeader=false} 2022-12-08 15:26:21.564 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:26:21.606 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:29.0, nextRun=2022-12-08 15:26:20.0, currentDate=Thu Dec 08 15:26:21 CST 2022 2022-12-08 15:26:21.608 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:25:29.0, nextRunTime=2022-12-08 15:26:20.0} 2022-12-08 15:26:21.609 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:26:21.616 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:26:21.648 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:26:21.649 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:26:21.649 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:26:21.686 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=160, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:26:21.431+08:00, endTime=null} 2022-12-08 15:26:21.797 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 146, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:21.920 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:22.116 INFO 42 --- [pool-subtask-executor1,781355287a7246f6,47ff002d1062] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=160, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=160, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:21.429+08:00, sub_task_instance_id=160}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:22.309 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:22.509 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=146, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:26:21.776+08:00, endTime=null} 2022-12-08 15:26:22.590 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 147, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:22.651 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:26:22.657 INFO 42 --- [pool-subtask-executor1,781355287a7246f6,47ff002d1062] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 160, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:22.881 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:23.050 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:23.059 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=147, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:26:22.568+08:00, endTime=null} 2022-12-08 15:26:23.159 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 148, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:23.172 INFO 42 --- [pool-subtask-executor2,781355287a7246f6,0a1208b84f34] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=146, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=146, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:21.774+08:00, sub_task_instance_id=146}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:23.269 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:23.275 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:23.484 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:26:23.923 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:26:23.930 INFO 42 --- [pool-subtask-executor2,781355287a7246f6,0a1208b84f34] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 146, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:23.932 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=148, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:26:23.132+08:00, endTime=null} 2022-12-08 15:26:24.042 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 149, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:24.054 INFO 42 --- [pool-subtask-executor3,781355287a7246f6,c2803cb980fe] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=147, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=147, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:22.567+08:00, sub_task_instance_id=147}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:24.218 INFO 42 --- [pool-subtask-executor4,781355287a7246f6,e4b9fb7d8b4b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=148, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=148, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:23.131+08:00, sub_task_instance_id=148}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 15:26:24.325 INFO 42 --- [pool-subtask-executor3,781355287a7246f6,c2803cb980fe] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 147, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:24.337 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=149, name=Refresh all agent config, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.RefreshAllAgentConfigTask, seriesId=0, startTime=2022-12-08T15:26:24.024+08:00, endTime=null} 2022-12-08 15:26:24.429 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 150, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:24.458 INFO 42 --- [pool-subtask-executor4,781355287a7246f6,e4b9fb7d8b4b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 148, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:24.478 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:160, status:SUCCESS 2022-12-08 15:26:24.487 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:160, status:SUCCESS 2022-12-08 15:26:24.555 INFO 42 --- [pool-subtask-executor5,781355287a7246f6,66700dc5c1d4] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=149, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=149, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:24.022+08:00, sub_task_instance_id=149}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:24.852 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=150, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T15:26:24.410+08:00, endTime=null} 2022-12-08 15:26:24.937 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 151, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:25.025 INFO 42 --- [pool-subtask-executor5,781355287a7246f6,66700dc5c1d4] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 149, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:25.120 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=151, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:26:24.922+08:00, endTime=null} 2022-12-08 15:26:25.223 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 152, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:25.237 INFO 42 --- [pool-subtask-executor6,781355287a7246f6,9ad76a2d30a5] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=150, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=150, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:24.408+08:00, sub_task_instance_id=150}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:25.658 INFO 42 --- [pool-subtask-executor7,781355287a7246f6,7e91a6fb7f1b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=151, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=151, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:24.920+08:00, sub_task_instance_id=151}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:25.667 INFO 42 --- [pool-ocp-schedules-5,,1106f3a75fca] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:26:25.667 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:25.668 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:25.689 INFO 42 --- [pool-subtask-executor6,781355287a7246f6,9ad76a2d30a5] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 150, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:25.700 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=152, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:26:25.205+08:00, endTime=null} 2022-12-08 15:26:25.780 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 153, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:26.067 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:30.0, nextRun=2022-12-08 15:26:25.0, currentDate=Thu Dec 08 15:26:26 CST 2022 2022-12-08 15:26:26.068 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:25:30.0, nextRunTime=2022-12-08 15:26:25.0} 2022-12-08 15:26:26.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:26:26.119 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:26:26.120 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:26:26.121 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:26:26.137 INFO 42 --- [pool-subtask-executor7,781355287a7246f6,7e91a6fb7f1b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 151, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:26.144 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=153, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:26:25.762+08:00, endTime=null} 2022-12-08 15:26:26.177 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:26:26.170579+08:00, lastProcessTime=2022-12-08T15:26:16.157007+08:00 2022-12-08 15:26:26.269 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 154, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:26.279 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:26.288 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:26.322 INFO 42 --- [pool-subtask-executor8,781355287a7246f6,5d86e45503a5] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=152, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=152, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:25.204+08:00, sub_task_instance_id=152}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:26.404 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:26:26.170579+08:00, resultsCount=0 2022-12-08 15:26:26.405 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:26:26.170579+08:00, resultsCount=0 2022-12-08 15:26:26.406 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:26:26.170579+08:00 2022-12-08 15:26:26.459 INFO 42 --- [pool-subtask-executor9,781355287a7246f6,b93c813fc652] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=153, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=153, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:25.761+08:00, sub_task_instance_id=153}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:26.483 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:26.484 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:26.488 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=154, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:26:26.242+08:00, endTime=null} 2022-12-08 15:26:26.561 INFO 42 --- [pool-subtask-executor8,781355287a7246f6,5d86e45503a5] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 152, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:26.561 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:146, status:SUCCESS 2022-12-08 15:26:26.569 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:146, status:SUCCESS 2022-12-08 15:26:26.711 INFO 42 --- [pool-subtask-executor9,781355287a7246f6,b93c813fc652] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 153, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:26.735 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 155, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:26.736 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:147, status:SUCCESS 2022-12-08 15:26:26.748 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:147, status:SUCCESS 2022-12-08 15:26:26.890 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=155, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T15:26:26.720+08:00, endTime=null} 2022-12-08 15:26:26.945 INFO 42 --- [pool-subtask-executor10,781355287a7246f6,e6cc8bc38855] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=154, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=154, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:26.240+08:00, sub_task_instance_id=154}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:26.946 INFO 42 --- [pool-subtask-executor10,781355287a7246f6,e6cc8bc38855] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:26:26.962 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:148, status:SUCCESS 2022-12-08 15:26:26.978 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:148, status:SUCCESS 2022-12-08 15:26:26.996 INFO 42 --- [pool-subtask-executor10,781355287a7246f6,e6cc8bc38855] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:26:27.092 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:26:27.105 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 156, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:27.220 INFO 42 --- [pool-subtask-executor10,781355287a7246f6,e6cc8bc38855] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 154, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:27.228 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=156, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:26:27.087+08:00, endTime=null} 2022-12-08 15:26:27.245 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:149, status:SUCCESS 2022-12-08 15:26:27.252 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:149, status:SUCCESS 2022-12-08 15:26:27.302 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 157, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:27.311 INFO 42 --- [pool-subtask-executor11,781355287a7246f6,9351bfc31326] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=155, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=155, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:26.716+08:00, sub_task_instance_id=155}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:27.312 INFO 42 --- [pool-subtask-executor11,781355287a7246f6,9351bfc31326] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2022-12-08 15:26:27.330 INFO 42 --- [pool-subtask-executor11,781355287a7246f6,9351bfc31326] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2022-12-08 15:26:27.374 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=157, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:26:27.291+08:00, endTime=null} 2022-12-08 15:26:27.385 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:150, status:SUCCESS 2022-12-08 15:26:27.392 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:150, status:SUCCESS 2022-12-08 15:26:27.452 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 158, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:27.462 INFO 42 --- [pool-ocp-schedules-20,,0ef8f1531cdd] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:26:27.480 INFO 42 --- [pool-subtask-executor11,781355287a7246f6,9351bfc31326] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 155, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:27.615 INFO 42 --- [pool-ocp-schedules-20,,0ef8f1531cdd] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:26:27.555 INFO 42 --- [pool-subtask-executor13,781355287a7246f6,5668163d84ec] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=157, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=157, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:27.290+08:00, sub_task_instance_id=157}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:27.611 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:151, status:SUCCESS 2022-12-08 15:26:27.624 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:151, status:SUCCESS 2022-12-08 15:26:27.955 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=158, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:26:27.440+08:00, endTime=null} 2022-12-08 15:26:27.967 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:152, status:SUCCESS 2022-12-08 15:26:27.975 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:152, status:SUCCESS 2022-12-08 15:26:28.001 INFO 42 --- [pool-subtask-executor13,781355287a7246f6,5668163d84ec] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 157, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:28.030 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 159, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:28.121 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:153, status:SUCCESS 2022-12-08 15:26:28.132 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:153, status:SUCCESS 2022-12-08 15:26:28.157 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=159, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:26:28.014+08:00, endTime=null} 2022-12-08 15:26:28.195 INFO 42 --- [pool-subtask-executor14,781355287a7246f6,3e2ef354277b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=158, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=158, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:27.439+08:00, sub_task_instance_id=158}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:28.196 INFO 42 --- [pool-subtask-executor14,781355287a7246f6,3e2ef354277b] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:26:28.211 INFO 42 --- [pool-subtask-executor14,781355287a7246f6,3e2ef354277b] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:26:28.284 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:154, status:SUCCESS 2022-12-08 15:26:28.293 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:154, status:SUCCESS 2022-12-08 15:26:28.363 INFO 42 --- [pool-subtask-executor14,781355287a7246f6,3e2ef354277b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 158, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:28.489 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:155, status:SUCCESS 2022-12-08 15:26:28.497 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:155, status:SUCCESS 2022-12-08 15:26:28.691 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:156, status:SUCCESS 2022-12-08 15:26:28.699 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:156, status:SUCCESS 2022-12-08 15:26:28.830 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:157, status:SUCCESS 2022-12-08 15:26:28.836 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:157, status:SUCCESS 2022-12-08 15:26:28.945 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:158, status:SUCCESS 2022-12-08 15:26:28.954 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:158, status:SUCCESS 2022-12-08 15:26:29.022 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:26:29.031 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:26:29.052 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:159, status:SUCCESS 2022-12-08 15:26:29.057 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:159, status:SUCCESS 2022-12-08 15:26:29.178 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:29.256 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 161, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:29.289 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:29.296 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:29.408 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=161, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:26:29.241+08:00, endTime=null} 2022-12-08 15:26:29.483 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 162, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:29.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:29.762 INFO 42 --- [pool-subtask-executor16,781355287a7246f6,adb4ead60880] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=161, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=161, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:29.239+08:00, sub_task_instance_id=161}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:29.787 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=162, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:26:29.469+08:00, endTime=null} 2022-12-08 15:26:30.008 INFO 42 --- [pool-subtask-executor16,781355287a7246f6,adb4ead60880] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 161, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:30.127 INFO 42 --- [pool-subtask-executor17,781355287a7246f6,f52c99aed42a] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=162, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=162, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:29.467+08:00, sub_task_instance_id=162}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 15:26:30.219 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:26:30.337 INFO 42 --- [pool-subtask-executor17,781355287a7246f6,f52c99aed42a] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 162, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:30.666 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:161, status:SUCCESS 2022-12-08 15:26:30.673 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:161, status:SUCCESS 2022-12-08 15:26:30.768 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:162, status:SUCCESS 2022-12-08 15:26:30.775 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:162, status:SUCCESS 2022-12-08 15:26:31.345 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:31.0, nextRun=2022-12-08 15:26:30.0, currentDate=Thu Dec 08 15:26:31 CST 2022 2022-12-08 15:26:31.346 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:25:31.0, nextRunTime=2022-12-08 15:26:30.0} 2022-12-08 15:26:31.368 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:26:31.490 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:01.0, nextRun=2022-12-08 15:26:30.0, currentDate=Thu Dec 08 15:26:31 CST 2022 2022-12-08 15:26:31.491 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:26:01.0, nextRunTime=2022-12-08 15:26:30.0} 2022-12-08 15:26:31.512 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:26:31.512 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:26:31.513 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:26:31.889 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 163, operation:EXECUTE, state: RUNNING 2022-12-08 15:26:32.009 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=163, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:26:31.872+08:00, endTime=null} 2022-12-08 15:26:32.297 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:32.302 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:32.416 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:32.416 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:32.607 INFO 42 --- [pool-subtask-executor18,781355287a7246f6,b21426280ef9] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=163, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=163, task_operation=execute, latest_execution_start_time=2022-12-08T15:26:31.870+08:00, sub_task_instance_id=163}, listMap={}}, executor=192.168.28.62 2022-12-08 15:26:32.608 INFO 42 --- [pool-subtask-executor18,781355287a7246f6,b21426280ef9] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:26:32.650 INFO 42 --- [pool-subtask-executor18,781355287a7246f6,b21426280ef9] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:26:32.651 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:33.028 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:33.029 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:33.062 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:26:33.072 INFO 42 --- [pool-subtask-executor18,781355287a7246f6,b21426280ef9] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 163, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:26:33.924 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:33.971 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:163, status:SUCCESS 2022-12-08 15:26:33.978 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:163, status:SUCCESS 2022-12-08 15:26:34.191 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:26:35.303 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:35.309 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:35.669 INFO 42 --- [pool-ocp-schedules-19,,4625d581feea] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:26:36.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:26:36.168 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:26:36.173 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:26:36.166083+08:00, lastProcessTime=2022-12-08T15:26:26.170579+08:00 2022-12-08 15:26:36.179 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:26:36.180 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:26:36.297 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:26:36.166083+08:00, resultsCount=0 2022-12-08 15:26:36.298 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:26:36.166083+08:00, resultsCount=0 2022-12-08 15:26:36.298 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:26:36.166083+08:00 2022-12-08 15:26:37.226 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:26:38.310 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:38.316 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:39.127 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:41.317 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:41.322 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:43.062 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:43.249 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:26:44.191 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:44.323 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:44.328 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:44.497 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:26:45.472 INFO 42 --- [pool-ocp-schedules-15,,7052c41b3844] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:26:45.514 INFO 42 --- [pool-ocp-schedules-15,,7052c41b3844] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:26:45.657 INFO 42 --- [pool-ocp-schedules-7,,4884a900b1bb] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:26:45.670 INFO 42 --- [pool-ocp-schedules-11,,09172a069096] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:26:45.761 INFO 42 --- [pool-ocp-schedules-19,,6bbe1260554e] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:26:46.083 INFO 42 --- [pool-ocp-schedules-13,,bfe9648d100a] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:26:46.084 INFO 42 --- [pool-ocp-schedules-3,,f6f916b4b116] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:26:46.117 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:26:46.167 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:26:46.164348+08:00, lastProcessTime=2022-12-08T15:26:36.166083+08:00 2022-12-08 15:26:46.333 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:26:46.164348+08:00, resultsCount=0 2022-12-08 15:26:46.334 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:26:46.164348+08:00, resultsCount=0 2022-12-08 15:26:46.334 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:26:46.164348+08:00 2022-12-08 15:26:46.653 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:26:46.844 INFO 42 --- [pool-ocp-schedules-8,,9bdd5d7ebfbd] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:26:46.875 INFO 42 --- [pool-ocp-schedules-17,,85a165c23dae] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:26:46.875 INFO 42 --- [pool-ocp-schedules-17,,85a165c23dae] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:26:46.876 INFO 42 --- [pool-ocp-schedules-17,,85a165c23dae] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:26:47.294 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:26:47.330 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:47.335 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:48.098 INFO 42 --- [pool-ocp-schedules-8,,cd772228b3d5] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:26:48.099 INFO 42 --- [pool-ocp-schedules-8,,cd772228b3d5] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:26:49.863 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:26:50.239 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:26:50.336 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:50.341 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:50.419 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:24:49+08:00, updateTime=2022-12-08T15:26:19+08:00, expireTime=null, isLeader=false} 2022-12-08 15:26:50.427 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:26:51.348 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:26:51.871 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:26:51.878 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:26:51.920 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:26:52.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:52.765 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:52.990 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:26:53.249 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:53.343 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:53.349 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:53.551 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:26:54.468 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:26:55.033 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:26:55.175 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:55.175 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:55.672 INFO 42 --- [pool-ocp-schedules-6,,64a7d79163a4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:26:55.876 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:26:55.877 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:26:56.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:26:56.157 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:26:56.153680+08:00, lastProcessTime=2022-12-08T15:26:46.164348+08:00 2022-12-08 15:26:56.286 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:26:56.153680+08:00, resultsCount=0 2022-12-08 15:26:56.287 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:26:56.153680+08:00, resultsCount=0 2022-12-08 15:26:56.288 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:26:56.153680+08:00 2022-12-08 15:26:56.352 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:56.360 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:26:57.420 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:26:58.523 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:26:58.530 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:26:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,13f69beb763a] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:26:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,13f69beb763a] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:26:59.133 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:26:59.361 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:26:59.367 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:00.001 INFO 42 --- [pool-ocp-schedules-9,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:27:01.629 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:00.0, nextRun=2022-12-08 15:27:00.0, currentDate=Thu Dec 08 15:27:01 CST 2022 2022-12-08 15:27:01.631 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:26:00.0, nextRunTime=2022-12-08 15:27:00.0} 2022-12-08 15:27:01.648 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:27:01.649 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:27:01.649 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:27:01.913 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:01.0, nextRun=2022-12-08 15:27:00.0, currentDate=Thu Dec 08 15:27:01 CST 2022 2022-12-08 15:27:01.914 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:26:01.0, nextRunTime=2022-12-08 15:27:00.0} 2022-12-08 15:27:01.946 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:27:01.947 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:27:01.947 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:27:02.253 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:01.0, nextRun=2022-12-08 15:27:00.0, currentDate=Thu Dec 08 15:27:02 CST 2022 2022-12-08 15:27:02.253 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:26:01.0, nextRunTime=2022-12-08 15:27:00.0} 2022-12-08 15:27:02.280 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:27:02.280 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:27:02.281 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:27:02.368 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:02.374 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,ec8c8dea219e] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484480, interval=60 2022-12-08 15:27:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,ec8c8dea219e] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484422, count=0, elapsed=1668813938214 2022-12-08 15:27:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,83053caedbf8] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484480, interval=60 2022-12-08 15:27:02.641 INFO 42 --- [pool-prometheus-minute-schedule-1,,83053caedbf8] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484422, count=0, elapsed=1668813938219 2022-12-08 15:27:03.005 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:31.0, nextRun=2022-12-08 15:27:00.0, currentDate=Thu Dec 08 15:27:03 CST 2022 2022-12-08 15:27:03.006 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:26:31.0, nextRunTime=2022-12-08 15:27:00.0} 2022-12-08 15:27:03.064 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:27:03.065 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:27:03.065 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:27:03.125 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 164, operation:EXECUTE, state: RUNNING 2022-12-08 15:27:03.246 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=164, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:27:03.110+08:00, endTime=null} 2022-12-08 15:27:03.254 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:01.0, nextRun=2022-12-08 15:27:00.0, currentDate=Thu Dec 08 15:27:03 CST 2022 2022-12-08 15:27:03.255 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:26:01.0, nextRunTime=2022-12-08 15:27:00.0} 2022-12-08 15:27:03.277 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:27:03.278 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:27:03.278 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:27:03.324 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 165, operation:EXECUTE, state: RUNNING 2022-12-08 15:27:03.327 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:03.437 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=165, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:27:03.311+08:00, endTime=null} 2022-12-08 15:27:03.466 INFO 42 --- [pool-subtask-executor19,781355287a7246f6,872f2f77e654] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=164, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=164, task_operation=execute, latest_execution_start_time=2022-12-08T15:27:03.108+08:00, sub_task_instance_id=164}, listMap={}}, executor=192.168.28.62 2022-12-08 15:27:03.567 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 166, operation:EXECUTE, state: RUNNING 2022-12-08 15:27:03.849 INFO 42 --- [pool-subtask-executor19,781355287a7246f6,872f2f77e654] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 164, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:27:03.952 INFO 42 --- [pool-subtask-executor20,781355287a7246f6,e52f6427283d] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=165, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=165, task_operation=execute, latest_execution_start_time=2022-12-08T15:27:03.309+08:00, sub_task_instance_id=165}, listMap={}}, executor=192.168.28.62 2022-12-08 15:27:03.957 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:27:04.094 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=166, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:27:03.538+08:00, endTime=null} 2022-12-08 15:27:04.125 INFO 42 --- [pool-subtask-executor20,781355287a7246f6,e52f6427283d] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 165, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:27:04.710 INFO 42 --- [pool-subtask-executor21,781355287a7246f6,b6ed32ddcc67] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=166, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=166, task_operation=execute, latest_execution_start_time=2022-12-08T15:27:03.537+08:00, sub_task_instance_id=166}, listMap={}}, executor=192.168.28.62 2022-12-08 15:27:05.035 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:05.066 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:06.0, nextRun=2022-12-08 15:27:05.0, currentDate=Thu Dec 08 15:27:05 CST 2022 2022-12-08 15:27:05.066 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:26:06.0, nextRunTime=2022-12-08 15:27:05.0} 2022-12-08 15:27:05.079 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:27:05.079 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:27:05.079 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:27:05.180 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:164, status:SUCCESS 2022-12-08 15:27:05.187 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:164, status:SUCCESS 2022-12-08 15:27:05.187 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 167, operation:EXECUTE, state: RUNNING 2022-12-08 15:27:05.343 INFO 42 --- [pool-subtask-executor21,781355287a7246f6,b6ed32ddcc67] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 166, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:27:05.357 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:27:05.375 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:05.378 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:05.605 INFO 42 --- [pool-ocp-schedules-9,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:27:05.674 INFO 42 --- [pool-ocp-schedules-16,,81cd2b9039cd] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:27:05.889 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=167, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:27:05.175+08:00, endTime=null} 2022-12-08 15:27:05.903 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:165, status:SUCCESS 2022-12-08 15:27:05.914 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:165, status:SUCCESS 2022-12-08 15:27:05.944 INFO 42 --- [pool-ocp-schedules-9,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:27:06.091 INFO 42 --- [pool-ocp-schedules-9,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:27:06.128 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:27:06.208 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:27:06.197057+08:00, lastProcessTime=2022-12-08T15:26:56.153680+08:00 2022-12-08 15:27:06.226 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=168, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:27:05.969+08:00, endTime=null} 2022-12-08 15:27:06.301 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:166, status:SUCCESS 2022-12-08 15:27:06.308 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:166, status:SUCCESS 2022-12-08 15:27:06.408 INFO 42 --- [pool-subtask-executor22,781355287a7246f6,a3e81b72f033] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=167, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=167, task_operation=execute, latest_execution_start_time=2022-12-08T15:27:05.173+08:00, sub_task_instance_id=167}, listMap={}}, executor=192.168.28.62 2022-12-08 15:27:06.409 INFO 42 --- [pool-subtask-executor22,781355287a7246f6,a3e81b72f033] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:27:06.450 INFO 42 --- [pool-subtask-executor22,781355287a7246f6,a3e81b72f033] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:27:06.451 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:27:06.197057+08:00, resultsCount=0 2022-12-08 15:27:06.452 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:27:06.197057+08:00, resultsCount=0 2022-12-08 15:27:06.452 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:27:06.197057+08:00 2022-12-08 15:27:06.482 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:27:06.578 INFO 42 --- [pool-ocp-schedules-9,,] o.s.boot.SpringApplication : Started application in 6.363 seconds (JVM running for 423.424) 2022-12-08 15:27:06.581 INFO 42 --- [pool-subtask-executor22,781355287a7246f6,a3e81b72f033] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 167, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:27:07.343 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 169, operation:EXECUTE, state: RUNNING 2022-12-08 15:27:07.416 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=169, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:27:07.332+08:00, endTime=null} 2022-12-08 15:27:07.561 INFO 42 --- [pool-subtask-executor24,781355287a7246f6,3fba314aeb54] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=169, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=169, task_operation=execute, latest_execution_start_time=2022-12-08T15:27:07.331+08:00, sub_task_instance_id=169}, listMap={}}, executor=192.168.28.62 2022-12-08 15:27:07.651 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:27:07.693 INFO 42 --- [pool-subtask-executor24,781355287a7246f6,3fba314aeb54] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 169, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:27:07.799 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:167, status:SUCCESS 2022-12-08 15:27:07.805 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:167, status:SUCCESS 2022-12-08 15:27:07.879 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:168, status:SUCCESS 2022-12-08 15:27:07.886 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:168, status:SUCCESS 2022-12-08 15:27:07.963 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:169, status:SUCCESS 2022-12-08 15:27:07.968 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:169, status:SUCCESS 2022-12-08 15:27:08.137 INFO 42 --- [pool-ocp-schedules-9,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:27:08.137+08:00 2022-12-08 15:27:08.147 INFO 42 --- [pool-ocp-schedules-5,,95759fd61383] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:27:08.147 INFO 42 --- [pool-ocp-schedules-5,,95759fd61383] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:27:08.379 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:08.383 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:09.937 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:27:11.384 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:11.392 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:13.430 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:14.109 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:27:14.393 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:14.400 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:15.057 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:27:15.064 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:27:15.215 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:15.358 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:15.511 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:15.676 INFO 42 --- [pool-ocp-schedules-10,,0142304330a5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:27:15.699 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:27:15.882 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:27:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:27:16.161 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:27:16.157730+08:00, lastProcessTime=2022-12-08T15:27:06.197057+08:00 2022-12-08 15:27:16.354 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:27:16.157730+08:00, resultsCount=0 2022-12-08 15:27:16.354 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:27:16.157730+08:00, resultsCount=0 2022-12-08 15:27:16.355 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:27:16.157730+08:00 2022-12-08 15:27:17.401 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:17.410 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:17.701 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:27:18.392 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:18.392 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:18.699 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:18.700 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:19.992 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:27:20.411 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:20.417 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:20.546 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:27:20.680 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:22.0, nextRun=2022-12-08 15:27:20.0, currentDate=Thu Dec 08 15:27:20 CST 2022 2022-12-08 15:27:20.682 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:26:22.0, nextRunTime=2022-12-08 15:27:20.0} 2022-12-08 15:27:20.702 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:27:20.703 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:27:20.703 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:27:21.279 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:27:21.286 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:27:21.557 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:27:21.647 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:21.675 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 170, operation:EXECUTE, state: RUNNING 2022-12-08 15:27:21.816 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=170, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:27:21.654+08:00, endTime=null} 2022-12-08 15:27:22.064 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:27:22.077 INFO 42 --- [pool-subtask-executor25,781355287a7246f6,df5723271ce9] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=170, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=170, task_operation=execute, latest_execution_start_time=2022-12-08T15:27:21.653+08:00, sub_task_instance_id=170}, listMap={}}, executor=192.168.28.62 2022-12-08 15:27:22.112 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:22.183 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:26:21+08:00, updateTime=2022-12-08T15:26:51+08:00, expireTime=null, isLeader=false} 2022-12-08 15:27:22.189 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:27:22.248 INFO 42 --- [pool-subtask-executor25,781355287a7246f6,df5723271ce9] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 170, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:27:22.681 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:27:23.006 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:170, status:SUCCESS 2022-12-08 15:27:23.013 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:170, status:SUCCESS 2022-12-08 15:27:23.418 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:23.423 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:23.917 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:24.272 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:27:24.823 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:24.824 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:25.270 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:25.271 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:25.644 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:25.677 INFO 42 --- [pool-ocp-schedules-1,,dcb546293016] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:27:25.936 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:27:26.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:27:26.157 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:27:26.153924+08:00, lastProcessTime=2022-12-08T15:27:16.157730+08:00 2022-12-08 15:27:26.267 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:27:26.153924+08:00, resultsCount=0 2022-12-08 15:27:26.268 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:27:26.153924+08:00, resultsCount=0 2022-12-08 15:27:26.268 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:27:26.153924+08:00 2022-12-08 15:27:26.294 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:26.0, nextRun=2022-12-08 15:27:25.0, currentDate=Thu Dec 08 15:27:26 CST 2022 2022-12-08 15:27:26.295 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:26:26.0, nextRunTime=2022-12-08 15:27:25.0} 2022-12-08 15:27:26.400 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:27:26.401 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:27:26.401 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:27:26.424 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:26.429 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:26.975 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 171, operation:EXECUTE, state: RUNNING 2022-12-08 15:27:27.076 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=171, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:27:26.953+08:00, endTime=null} 2022-12-08 15:27:27.255 INFO 42 --- [pool-subtask-executor26,781355287a7246f6,73ed61a270c0] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=171, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=171, task_operation=execute, latest_execution_start_time=2022-12-08T15:27:26.952+08:00, sub_task_instance_id=171}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 15:27:27.407 INFO 42 --- [pool-subtask-executor26,781355287a7246f6,73ed61a270c0] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 171, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:27:27.761 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:171, status:SUCCESS 2022-12-08 15:27:27.772 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:171, status:SUCCESS 2022-12-08 15:27:27.837 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:27:28.169 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:27:28.174 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:27:28.293 INFO 42 --- [pool-ocp-schedules-19,,0a4592c17042] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:27:28.293 INFO 42 --- [pool-ocp-schedules-19,,0a4592c17042] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:27:28.796 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:29.430 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:29.435 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:30.998 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:31.0, nextRun=2022-12-08 15:27:30.0, currentDate=Thu Dec 08 15:27:30 CST 2022 2022-12-08 15:27:30.999 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:26:31.0, nextRunTime=2022-12-08 15:27:30.0} 2022-12-08 15:27:31.026 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:27:31.116 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:27:03.0, nextRun=2022-12-08 15:27:30.0, currentDate=Thu Dec 08 15:27:31 CST 2022 2022-12-08 15:27:31.116 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:27:03.0, nextRunTime=2022-12-08 15:27:30.0} 2022-12-08 15:27:31.135 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:27:31.136 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:27:31.136 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:27:31.146 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:31.411 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:27:31.874 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:31.874 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:32.225 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 172, operation:EXECUTE, state: RUNNING 2022-12-08 15:27:32.436 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:32.442 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:32.498 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=172, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:27:32.209+08:00, endTime=null} 2022-12-08 15:27:32.928 INFO 42 --- [pool-subtask-executor27,781355287a7246f6,8a202c4d69a4] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=172, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=172, task_operation=execute, latest_execution_start_time=2022-12-08T15:27:32.207+08:00, sub_task_instance_id=172}, listMap={}}, executor=192.168.28.62 2022-12-08 15:27:32.928 INFO 42 --- [pool-subtask-executor27,781355287a7246f6,8a202c4d69a4] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:27:32.947 INFO 42 --- [pool-subtask-executor27,781355287a7246f6,8a202c4d69a4] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:27:33.111 INFO 42 --- [pool-subtask-executor27,781355287a7246f6,8a202c4d69a4] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 172, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:27:33.347 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:172, status:SUCCESS 2022-12-08 15:27:33.356 INFO 42 --- [pool-task-coordinator2,,] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:172, status:SUCCESS 2022-12-08 15:27:34.000 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:34.389 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:27:34.409 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:34.409 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:35.443 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:35.448 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:35.679 INFO 42 --- [pool-ocp-schedules-11,,8459cc40f364] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:27:35.849 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:36.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:27:36.155 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:27:36.151323+08:00, lastProcessTime=2022-12-08T15:27:26.153924+08:00 2022-12-08 15:27:36.215 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:27:36.282 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:27:36.151323+08:00, resultsCount=0 2022-12-08 15:27:36.283 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:27:36.151323+08:00, resultsCount=0 2022-12-08 15:27:36.283 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:27:36.151323+08:00 2022-12-08 15:27:36.809 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:27:37.058 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:27:37.064 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:27:37.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:38.077 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:27:38.307 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:38.448 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:38.454 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:38.900 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:27:40.338 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:27:40.355 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=17ms, period=120000ms 2022-12-08 15:27:40.623 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:40.624 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:41.454 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:41.459 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:41.824 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:41.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:44.127 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:44.459 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:27:44.461 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:44.474 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:44.498 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:27:44.517 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:27:45.360 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:45.473 INFO 42 --- [pool-ocp-schedules-11,,cd7f13f4a9e1] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:27:45.510 INFO 42 --- [pool-ocp-schedules-11,,cd7f13f4a9e1] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:27:45.658 INFO 42 --- [pool-ocp-schedules-9,,79422bd58dfb] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:27:45.681 INFO 42 --- [pool-ocp-schedules-12,,63053d2e3f18] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:27:45.713 INFO 42 --- [pool-ocp-schedules-2,,2ccc8ad808c8] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:27:45.713 INFO 42 --- [pool-ocp-schedules-2,,2ccc8ad808c8] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:27:45.779 INFO 42 --- [pool-ocp-schedules-6,,17d9e0dbed5a] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:27:46.039 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:46.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:27:46.152 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:27:46.149350+08:00, lastProcessTime=2022-12-08T15:27:36.151323+08:00 2022-12-08 15:27:46.261 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:27:46.149350+08:00, resultsCount=0 2022-12-08 15:27:46.262 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:27:46.149350+08:00, resultsCount=0 2022-12-08 15:27:46.262 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:27:46.149350+08:00 2022-12-08 15:27:46.345 INFO 42 --- [pool-ocp-schedules-17,,94afea57cb2d] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:27:46.347 INFO 42 --- [pool-ocp-schedules-10,,e4dddd68e2ce] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:27:46.617 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:27:46.982 INFO 42 --- [pool-ocp-schedules-8,,b54f6985b199] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:27:47.016 INFO 42 --- [pool-ocp-schedules-9,,6d4a0847e517] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:27:47.017 INFO 42 --- [pool-ocp-schedules-9,,6d4a0847e517] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:27:47.017 INFO 42 --- [pool-ocp-schedules-9,,6d4a0847e517] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:27:47.147 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:47.475 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:47.481 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:47.695 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:27:48.425 INFO 42 --- [pool-ocp-schedules-1,,b2760a7660b6] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:27:48.426 INFO 42 --- [pool-ocp-schedules-1,,b2760a7660b6] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:27:48.608 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:48.609 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:48.760 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:27:50.173 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:27:50.307 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:25:19+08:00, updateTime=2022-12-08T15:27:19+08:00, expireTime=null, isLeader=false} 2022-12-08 15:27:50.315 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:27:50.481 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:50.491 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:50.495 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:50.496 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:50.737 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:27:51.950 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:27:52.370 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:27:53.247 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:27:53.255 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:27:53.491 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:53.496 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:53.570 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:54.460 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:54.619 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:27:54.806 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:27:55.362 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:27:55.682 INFO 42 --- [pool-ocp-schedules-12,,c60a367b0003] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:27:56.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:27:56.118 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:27:56.171 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:27:56.168521+08:00, lastProcessTime=2022-12-08T15:27:46.149350+08:00 2022-12-08 15:27:56.352 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:27:56.168521+08:00, resultsCount=0 2022-12-08 15:27:56.353 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:27:56.168521+08:00, resultsCount=0 2022-12-08 15:27:56.353 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:27:56.168521+08:00 2022-12-08 15:27:56.497 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:56.502 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:27:56.644 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:56.645 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:56.869 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:27:58.144 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:27:58.145 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:27:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,3381a621d581] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:27:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,3381a621d581] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:27:58.799 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:27:59.502 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:27:59.511 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:00.790 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:28:00.797 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:28:00.819 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:26:00.0, nextRun=2022-12-08 15:28:00.0, currentDate=Thu Dec 08 15:28:00 CST 2022 2022-12-08 15:28:00.820 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:26:00.0, nextRunTime=2022-12-08 15:28:00.0} 2022-12-08 15:28:00.851 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:28:01.017 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:27:02.0, nextRun=2022-12-08 15:28:00.0, currentDate=Thu Dec 08 15:28:01 CST 2022 2022-12-08 15:28:01.018 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:27:02.0, nextRunTime=2022-12-08 15:28:00.0} 2022-12-08 15:28:01.038 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:28:01.039 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:28:01.039 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:28:01.163 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:27:02.0, nextRun=2022-12-08 15:28:00.0, currentDate=Thu Dec 08 15:28:01 CST 2022 2022-12-08 15:28:01.164 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:27:02.0, nextRunTime=2022-12-08 15:28:00.0} 2022-12-08 15:28:01.191 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:28:01.192 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:28:01.192 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:28:01.287 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:01.287 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:27:02.0, nextRun=2022-12-08 15:28:00.0, currentDate=Thu Dec 08 15:28:01 CST 2022 2022-12-08 15:28:01.287 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:27:02.0, nextRunTime=2022-12-08 15:28:00.0} 2022-12-08 15:28:01.310 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:28:01.310 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:28:01.310 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:28:01.443 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:27:31.0, nextRun=2022-12-08 15:28:00.0, currentDate=Thu Dec 08 15:28:01 CST 2022 2022-12-08 15:28:01.444 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:27:31.0, nextRunTime=2022-12-08 15:28:00.0} 2022-12-08 15:28:01.461 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:28:01.461 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:28:01.462 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:28:01.928 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:27:03.0, nextRun=2022-12-08 15:28:00.0, currentDate=Thu Dec 08 15:28:01 CST 2022 2022-12-08 15:28:01.929 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:27:03.0, nextRunTime=2022-12-08 15:28:00.0} 2022-12-08 15:28:01.955 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:28:01.955 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:28:01.956 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:28:01.987 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 176, operation:EXECUTE, state: RUNNING 2022-12-08 15:28:02.089 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=176, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:28:01.972+08:00, endTime=null} 2022-12-08 15:28:02.176 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 173, operation:EXECUTE, state: RUNNING 2022-12-08 15:28:02.255 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=173, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:28:02.159+08:00, endTime=null} 2022-12-08 15:28:02.341 INFO 42 --- [pool-subtask-executor28,781355287a7246f6,37f6bdda98c2] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=176, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=176, task_operation=execute, latest_execution_start_time=2022-12-08T15:28:01.970+08:00, sub_task_instance_id=176}, listMap={}}, executor=192.168.28.62 2022-12-08 15:28:02.342 INFO 42 --- [pool-subtask-executor28,781355287a7246f6,37f6bdda98c2] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:28:02.349 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 174, operation:EXECUTE, state: RUNNING 2022-12-08 15:28:02.358 INFO 42 --- [pool-subtask-executor28,781355287a7246f6,37f6bdda98c2] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:28:02.404 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=174, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:28:02.336+08:00, endTime=null} 2022-12-08 15:28:02.467 INFO 42 --- [pool-subtask-executor29,781355287a7246f6,88678bce5b4e] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=173, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=173, task_operation=execute, latest_execution_start_time=2022-12-08T15:28:02.158+08:00, sub_task_instance_id=173}, listMap={}}, executor=192.168.28.62 2022-12-08 15:28:02.480 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 175, operation:EXECUTE, state: RUNNING 2022-12-08 15:28:02.481 INFO 42 --- [pool-subtask-executor28,781355287a7246f6,37f6bdda98c2] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 176, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:28:02.512 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:02.523 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:02.585 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=175, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:28:02.468+08:00, endTime=null} 2022-12-08 15:28:02.596 INFO 42 --- [pool-subtask-executor29,781355287a7246f6,88678bce5b4e] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 173, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:28:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,4a961332dc03] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484540, interval=60 2022-12-08 15:28:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,4a961332dc03] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484482, count=0, elapsed=1668813998154 2022-12-08 15:28:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,8691f013175c] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484540, interval=60 2022-12-08 15:28:02.641 INFO 42 --- [pool-prometheus-minute-schedule-1,,8691f013175c] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484482, count=0, elapsed=1668813998159 2022-12-08 15:28:02.686 INFO 42 --- [pool-subtask-executor30,781355287a7246f6,52cd86e16e01] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=174, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=174, task_operation=execute, latest_execution_start_time=2022-12-08T15:28:02.335+08:00, sub_task_instance_id=174}, listMap={}}, executor=192.168.28.62 2022-12-08 15:28:02.806 INFO 42 --- [pool-subtask-executor30,781355287a7246f6,52cd86e16e01] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 174, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:28:02.827 INFO 42 --- [pool-subtask-executor31,781355287a7246f6,e62a03a7b45e] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=175, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=175, task_operation=execute, latest_execution_start_time=2022-12-08T15:28:02.467+08:00, sub_task_instance_id=175}, listMap={}}, executor=192.168.28.62 2022-12-08 15:28:02.846 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:03.353 INFO 42 --- [pool-subtask-executor31,781355287a7246f6,e62a03a7b45e] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 175, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:28:03.490 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:28:03.539 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:173, status:SUCCESS 2022-12-08 15:28:03.549 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:173, status:SUCCESS 2022-12-08 15:28:03.681 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 177, operation:EXECUTE, state: RUNNING 2022-12-08 15:28:03.788 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:174, status:SUCCESS 2022-12-08 15:28:03.802 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:174, status:SUCCESS 2022-12-08 15:28:03.836 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=177, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:28:03.668+08:00, endTime=null} 2022-12-08 15:28:03.985 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:175, status:SUCCESS 2022-12-08 15:28:03.993 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:175, status:SUCCESS 2022-12-08 15:28:04.384 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:176, status:SUCCESS 2022-12-08 15:28:04.450 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:04.537 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:04.545 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:176, status:SUCCESS 2022-12-08 15:28:04.571 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:04.796 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:28:05.524 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:05.538 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:05.684 INFO 42 --- [pool-ocp-schedules-10,,8ea00af469db] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:28:06.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:28:06.152 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:28:06.148778+08:00, lastProcessTime=2022-12-08T15:27:56.168521+08:00 2022-12-08 15:28:06.216 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:06.288 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:28:06.148778+08:00, resultsCount=0 2022-12-08 15:28:06.289 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:28:06.148778+08:00, resultsCount=0 2022-12-08 15:28:06.289 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:28:06.148778+08:00 2022-12-08 15:28:06.364 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:06.365 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:06.521 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:177, status:SUCCESS 2022-12-08 15:28:06.534 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:177, status:SUCCESS 2022-12-08 15:28:06.606 INFO 42 --- [pool-task-coordinator2,,] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:27:05.0, nextRun=2022-12-08 15:28:05.0, currentDate=Thu Dec 08 15:28:06 CST 2022 2022-12-08 15:28:06.607 INFO 42 --- [pool-task-coordinator2,,] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:27:05.0, nextRunTime=2022-12-08 15:28:05.0} 2022-12-08 15:28:06.639 INFO 42 --- [pool-task-coordinator2,,] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:28:06.640 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:28:06.641 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:28:06.943 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 178, operation:EXECUTE, state: RUNNING 2022-12-08 15:28:06.980 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=178, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:28:06.930+08:00, endTime=null} 2022-12-08 15:28:07.132 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:28:07.317 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:28:08.161 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:178, status:SUCCESS 2022-12-08 15:28:08.175 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:178, status:SUCCESS 2022-12-08 15:28:08.539 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:08.544 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:08.869 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:28:08.890 INFO 42 --- [pool-ocp-schedules-18,,2e1e05f9764b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:28:08.891 INFO 42 --- [pool-ocp-schedules-18,,2e1e05f9764b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:28:09.121 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:28:09.127 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:28:09.563 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:10.883 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:11.400 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:28:11.545 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:11.551 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:12.729 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:12.730 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:14.382 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:14.383 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:14.552 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:14.556 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:14.659 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:14.865 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:28:15.689 INFO 42 --- [pool-ocp-schedules-18,,1052b6bafd99] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:28:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:28:16.154 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:28:16.150896+08:00, lastProcessTime=2022-12-08T15:28:06.148778+08:00 2022-12-08 15:28:16.331 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:28:16.150896+08:00, resultsCount=0 2022-12-08 15:28:16.332 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:28:16.150896+08:00, resultsCount=0 2022-12-08 15:28:16.332 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:28:16.150896+08:00 2022-12-08 15:28:16.494 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:16.879 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:28:16.884 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:28:17.395 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:28:17.522 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:17.557 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:17.562 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:19.007 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:19.100 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:28:19.537 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:28:19.713 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:24:17.777, end=2022-12-08T15:26:19.56} 2022-12-08 15:28:19.765 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:28:20.424 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:27:21.0, nextRun=2022-12-08 15:28:20.0, currentDate=Thu Dec 08 15:28:20 CST 2022 2022-12-08 15:28:20.425 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:27:21.0, nextRunTime=2022-12-08 15:28:20.0} 2022-12-08 15:28:20.427 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:28:20.449 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:28:20.450 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:28:20.450 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:28:20.563 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:20.568 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:20.759 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:20.759 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:20.828 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:28:21.226 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 179, operation:EXECUTE, state: RUNNING 2022-12-08 15:28:21.538 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=179, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:28:21.215+08:00, endTime=null} 2022-12-08 15:28:22.241 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:22.242 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:22.270 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:28:22.523 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:28:23.167 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:179, status:SUCCESS 2022-12-08 15:28:23.175 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:179, status:SUCCESS 2022-12-08 15:28:23.569 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:23.577 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:24.771 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:24.907 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:28:24.914 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:28:24.919 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:28:25.279 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:27:26.0, nextRun=2022-12-08 15:28:25.0, currentDate=Thu Dec 08 15:28:25 CST 2022 2022-12-08 15:28:25.280 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:27:26.0, nextRunTime=2022-12-08 15:28:25.0} 2022-12-08 15:28:25.323 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:28:25.324 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:28:25.324 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:28:25.367 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:25.652 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 180, operation:EXECUTE, state: RUNNING 2022-12-08 15:28:25.691 INFO 42 --- [pool-ocp-schedules-10,,ebbf761f02f2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:28:25.751 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=180, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:28:25.641+08:00, endTime=null} 2022-12-08 15:28:26.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:28:26.155 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:28:26.151755+08:00, lastProcessTime=2022-12-08T15:28:16.150896+08:00 2022-12-08 15:28:26.327 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:28:26.151755+08:00, resultsCount=0 2022-12-08 15:28:26.328 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:28:26.151755+08:00, resultsCount=0 2022-12-08 15:28:26.328 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:28:26.151755+08:00 2022-12-08 15:28:26.542 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:26.578 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:26.584 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:27.120 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:27.245 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:28:27.704 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:180, status:SUCCESS 2022-12-08 15:28:27.719 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:180, status:SUCCESS 2022-12-08 15:28:27.731 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:28:28.550 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:28.551 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:28.953 INFO 42 --- [pool-ocp-schedules-4,,86a42de0ba5d] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:28:28.953 INFO 42 --- [pool-ocp-schedules-4,,86a42de0ba5d] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:28:29.225 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:28:29.585 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:29.591 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:30.050 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:27:31.0, nextRun=2022-12-08 15:28:30.0, currentDate=Thu Dec 08 15:28:30 CST 2022 2022-12-08 15:28:30.052 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:27:31.0, nextRunTime=2022-12-08 15:28:30.0} 2022-12-08 15:28:30.092 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:28:30.189 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:30.189 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:30.665 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:01.0, nextRun=2022-12-08 15:28:30.0, currentDate=Thu Dec 08 15:28:30 CST 2022 2022-12-08 15:28:30.666 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:28:01.0, nextRunTime=2022-12-08 15:28:30.0} 2022-12-08 15:28:30.690 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:28:30.690 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:28:30.690 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:28:30.894 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 181, operation:EXECUTE, state: RUNNING 2022-12-08 15:28:31.018 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=181, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:28:30.871+08:00, endTime=null} 2022-12-08 15:28:32.579 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:181, status:SUCCESS 2022-12-08 15:28:32.586 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:181, status:SUCCESS 2022-12-08 15:28:32.592 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:32.596 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:32.731 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:28:32.737 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:28:33.628 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:34.862 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:34.898 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:35.201 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:28:35.315 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:28:35.597 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:35.601 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:35.692 INFO 42 --- [pool-ocp-schedules-5,,c9090d6573d5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:28:36.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:28:36.151 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:28:36.147055+08:00, lastProcessTime=2022-12-08T15:28:26.151755+08:00 2022-12-08 15:28:36.251 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:28:36.147055+08:00, resultsCount=0 2022-12-08 15:28:36.252 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:28:36.147055+08:00, resultsCount=0 2022-12-08 15:28:36.252 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:28:36.147055+08:00 2022-12-08 15:28:36.722 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:36.763 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:36.764 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:37.355 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:28:37.844 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:28:38.125 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:38.125 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:38.602 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:38.607 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:39.477 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:28:40.766 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:28:40.776 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:28:41.367 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:41.608 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:41.612 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:43.728 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:43.921 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:28:44.613 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:44.619 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:44.625 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:44.625 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:45.110 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:45.370 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:28:45.475 INFO 42 --- [pool-ocp-schedules-3,,45fa33f2cdbc] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:28:45.500 INFO 42 --- [pool-ocp-schedules-3,,45fa33f2cdbc] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:28:45.659 INFO 42 --- [pool-ocp-schedules-6,,5b9cd332e4eb] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:28:45.693 INFO 42 --- [pool-ocp-schedules-1,,15ba5a3698df] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:28:45.798 INFO 42 --- [pool-ocp-schedules-13,,8d73b33f724d] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:28:46.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:28:46.157 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:28:46.153705+08:00, lastProcessTime=2022-12-08T15:28:36.147055+08:00 2022-12-08 15:28:46.265 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:28:46.153705+08:00, resultsCount=0 2022-12-08 15:28:46.266 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:28:46.153705+08:00, resultsCount=0 2022-12-08 15:28:46.266 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:28:46.153705+08:00 2022-12-08 15:28:46.416 INFO 42 --- [pool-ocp-schedules-7,,ebbe847a8933] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:28:46.451 INFO 42 --- [pool-ocp-schedules-20,,8968f9f8a2e9] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:28:46.832 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:46.869 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:46.869 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:47.152 INFO 42 --- [pool-ocp-schedules-13,,533804a93639] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:28:47.186 INFO 42 --- [pool-ocp-schedules-5,,4bfcedcbd79c] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:28:47.187 INFO 42 --- [pool-ocp-schedules-5,,4bfcedcbd79c] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:28:47.188 INFO 42 --- [pool-ocp-schedules-5,,4bfcedcbd79c] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:28:47.620 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:47.625 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:47.938 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:28:49.218 INFO 42 --- [pool-ocp-schedules-7,,a20d65f34372] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:28:49.219 INFO 42 --- [pool-ocp-schedules-7,,a20d65f34372] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:28:49.618 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:28:49.625 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:28:49.923 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:28:50.166 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:50.499 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:28:50.625 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:50.631 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:51.038 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:28:51.133 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:26:50+08:00, updateTime=2022-12-08T15:28:20+08:00, expireTime=null, isLeader=false} 2022-12-08 15:28:51.139 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:28:51.434 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:51.932 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:28:52.493 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:28:52.836 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:28:53.313 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:53.313 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:53.632 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:53.637 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:54.540 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:28:54.541 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:28:55.370 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:55.515 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:28:55.695 INFO 42 --- [pool-ocp-schedules-6,,f19fe3a73273] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:28:56.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:28:56.154 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:28:56.151537+08:00, lastProcessTime=2022-12-08T15:28:46.153705+08:00 2022-12-08 15:28:56.286 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:28:56.151537+08:00, resultsCount=0 2022-12-08 15:28:56.287 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:28:56.151537+08:00, resultsCount=0 2022-12-08 15:28:56.287 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:28:56.151537+08:00 2022-12-08 15:28:56.638 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:56.643 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:57.146 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:28:57.298 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:28:57.304 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:28:57.761 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:58.417 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:28:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,ae694e699a65] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:28:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,ae694e699a65] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:28:59.643 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:28:59.651 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:28:59.872 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:28:59.967 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:29:00.155 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:01.0, nextRun=2022-12-08 15:29:00.0, currentDate=Thu Dec 08 15:29:00 CST 2022 2022-12-08 15:29:00.156 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:28:01.0, nextRunTime=2022-12-08 15:29:00.0} 2022-12-08 15:29:00.173 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:29:00.174 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:29:00.174 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:29:00.329 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:29:00.525 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:01.0, nextRun=2022-12-08 15:29:00.0, currentDate=Thu Dec 08 15:29:00 CST 2022 2022-12-08 15:29:00.526 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:28:01.0, nextRunTime=2022-12-08 15:29:00.0} 2022-12-08 15:29:00.553 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:29:00.554 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:29:00.555 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:29:00.594 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 182, operation:EXECUTE, state: RUNNING 2022-12-08 15:29:00.921 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:00.922 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:01.030 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:01.0, nextRun=2022-12-08 15:29:00.0, currentDate=Thu Dec 08 15:29:01 CST 2022 2022-12-08 15:29:01.031 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:28:01.0, nextRunTime=2022-12-08 15:29:00.0} 2022-12-08 15:29:01.032 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=182, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:29:00.577+08:00, endTime=null} 2022-12-08 15:29:01.061 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:29:01.062 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:29:01.062 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:29:01.163 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:31.0, nextRun=2022-12-08 15:29:00.0, currentDate=Thu Dec 08 15:29:01 CST 2022 2022-12-08 15:29:01.164 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:28:31.0, nextRunTime=2022-12-08 15:29:00.0} 2022-12-08 15:29:01.185 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:29:01.185 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:29:01.185 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:29:01.300 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:02.0, nextRun=2022-12-08 15:29:00.0, currentDate=Thu Dec 08 15:29:01 CST 2022 2022-12-08 15:29:01.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:28:02.0, nextRunTime=2022-12-08 15:29:00.0} 2022-12-08 15:29:01.318 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:29:01.319 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:29:01.319 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:29:02.123 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 183, operation:EXECUTE, state: RUNNING 2022-12-08 15:29:02.206 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=183, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:29:02.101+08:00, endTime=null} 2022-12-08 15:29:02.282 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 184, operation:EXECUTE, state: RUNNING 2022-12-08 15:29:02.733 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:02.735 INFO 42 --- [pool-prometheus-minute-schedule-1,,7681bca779b5] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484600, interval=60 2022-12-08 15:29:02.736 INFO 42 --- [pool-prometheus-minute-schedule-1,,7681bca779b5] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484542, count=0, elapsed=1668814058194 2022-12-08 15:29:02.737 INFO 42 --- [pool-prometheus-minute-schedule-1,,c394cb9829cc] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484600, interval=60 2022-12-08 15:29:02.737 INFO 42 --- [pool-prometheus-minute-schedule-1,,c394cb9829cc] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484542, count=0, elapsed=1668814058195 2022-12-08 15:29:02.740 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:02.778 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=184, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:29:02.268+08:00, endTime=null} 2022-12-08 15:29:02.796 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:182, status:SUCCESS 2022-12-08 15:29:02.802 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:182, status:SUCCESS 2022-12-08 15:29:02.855 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 185, operation:EXECUTE, state: RUNNING 2022-12-08 15:29:02.947 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:02.948 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:03.134 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=185, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:29:02.831+08:00, endTime=null} 2022-12-08 15:29:03.212 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 186, operation:EXECUTE, state: RUNNING 2022-12-08 15:29:03.237 INFO 42 --- [pool-subtask-executor31,6d808bd684a44ecd,c3318f815084] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=184, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=184, task_operation=execute, latest_execution_start_time=2022-12-08T15:29:02.266+08:00, sub_task_instance_id=184}, listMap={}}, executor=192.168.28.62 2022-12-08 15:29:03.348 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=186, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:29:03.199+08:00, endTime=null} 2022-12-08 15:29:03.394 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,f1dd2d9696e8] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=185, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=185, task_operation=execute, latest_execution_start_time=2022-12-08T15:29:02.830+08:00, sub_task_instance_id=185}, listMap={}}, executor=192.168.28.62 2022-12-08 15:29:03.395 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,f1dd2d9696e8] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:29:03.410 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,f1dd2d9696e8] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:29:03.527 INFO 42 --- [pool-subtask-executor31,6d808bd684a44ecd,c3318f815084] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 184, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:29:03.681 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,f1dd2d9696e8] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 185, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:29:04.955 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:183, status:SUCCESS 2022-12-08 15:29:04.962 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:183, status:SUCCESS 2022-12-08 15:29:05.133 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:184, status:SUCCESS 2022-12-08 15:29:05.139 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:184, status:SUCCESS 2022-12-08 15:29:05.392 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:185, status:SUCCESS 2022-12-08 15:29:05.399 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:185, status:SUCCESS 2022-12-08 15:29:05.444 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:05.696 INFO 42 --- [pool-ocp-schedules-3,,4fae2ffd5cb1] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:29:05.718 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:29:05.723 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:186, status:SUCCESS 2022-12-08 15:29:05.731 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:186, status:SUCCESS 2022-12-08 15:29:05.741 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:05.747 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:06.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:29:06.150 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:29:06.146408+08:00, lastProcessTime=2022-12-08T15:28:56.151537+08:00 2022-12-08 15:29:06.248 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:29:06.146408+08:00, resultsCount=0 2022-12-08 15:29:06.249 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:29:06.146408+08:00, resultsCount=0 2022-12-08 15:29:06.249 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:29:06.146408+08:00 2022-12-08 15:29:06.458 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:29:06.465 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:29:06.544 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:07.0, nextRun=2022-12-08 15:29:05.0, currentDate=Thu Dec 08 15:29:06 CST 2022 2022-12-08 15:29:06.544 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:28:07.0, nextRunTime=2022-12-08 15:29:05.0} 2022-12-08 15:29:06.563 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:29:06.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:29:06.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:29:07.216 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:07.320 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:07.497 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 187, operation:EXECUTE, state: RUNNING 2022-12-08 15:29:07.576 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=187, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:29:07.483+08:00, endTime=null} 2022-12-08 15:29:07.627 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:29:08.562 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:29:08.563 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:187, status:SUCCESS 2022-12-08 15:29:08.569 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:187, status:SUCCESS 2022-12-08 15:29:08.748 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:08.753 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:09.436 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:09.611 INFO 42 --- [pool-ocp-schedules-19,,686c1ac7985a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:29:09.611 INFO 42 --- [pool-ocp-schedules-19,,686c1ac7985a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:29:09.711 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:29:10.010 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:29:10.453 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:10.454 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:11.754 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:11.759 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:12.712 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:12.713 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:14.761 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:14.765 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:15.523 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:29:15.528 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:29:15.697 INFO 42 --- [pool-ocp-schedules-1,,2083b7ff9a12] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:29:15.706 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:15.783 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:16.037 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:29:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:29:16.153 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:29:16.149681+08:00, lastProcessTime=2022-12-08T15:29:06.146408+08:00 2022-12-08 15:29:16.319 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:29:16.149681+08:00, resultsCount=0 2022-12-08 15:29:16.320 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:29:16.149681+08:00, resultsCount=0 2022-12-08 15:29:16.320 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:29:16.149681+08:00 2022-12-08 15:29:16.717 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:17.173 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:29:17.330 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:17.767 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:17.777 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:18.604 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:29:18.886 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:18.887 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:19.908 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:19.908 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:20.145 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:29:20.555 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:20.0, nextRun=2022-12-08 15:29:20.0, currentDate=Thu Dec 08 15:29:20 CST 2022 2022-12-08 15:29:20.556 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:28:20.0, nextRunTime=2022-12-08 15:29:20.0} 2022-12-08 15:29:20.579 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:29:20.580 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:29:20.580 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:29:20.779 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:20.784 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:20.820 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:29:20.825 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 188, operation:EXECUTE, state: RUNNING 2022-12-08 15:29:20.917 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=188, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:29:20.812+08:00, endTime=null} 2022-12-08 15:29:21.226 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:29:21.731 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:188, status:SUCCESS 2022-12-08 15:29:21.739 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:188, status:SUCCESS 2022-12-08 15:29:22.703 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:29:22.763 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:29:22.773 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:29:22.942 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:29:23.010 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:23.785 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:23.791 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:25.367 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:25.532 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:29:25.545 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:25.0, nextRun=2022-12-08 15:29:25.0, currentDate=Thu Dec 08 15:29:25 CST 2022 2022-12-08 15:29:25.547 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:28:25.0, nextRunTime=2022-12-08 15:29:25.0} 2022-12-08 15:29:25.606 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:29:25.607 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:29:25.607 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:29:25.698 INFO 42 --- [pool-ocp-schedules-4,,5284ecec3416] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:29:25.758 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:26.047 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 189, operation:EXECUTE, state: RUNNING 2022-12-08 15:29:26.089 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:26.089 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:26.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:29:26.155 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:29:26.151146+08:00, lastProcessTime=2022-12-08T15:29:16.149681+08:00 2022-12-08 15:29:26.235 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:29:26.268 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:29:26.151146+08:00, resultsCount=0 2022-12-08 15:29:26.269 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:29:26.151146+08:00, resultsCount=0 2022-12-08 15:29:26.269 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:29:26.151146+08:00 2022-12-08 15:29:26.285 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=189, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:29:26.030+08:00, endTime=null} 2022-12-08 15:29:26.793 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:26.798 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:27.219 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:189, status:SUCCESS 2022-12-08 15:29:27.225 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:189, status:SUCCESS 2022-12-08 15:29:27.502 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:28.529 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:28.530 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:28.721 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:29:29.799 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:29.804 INFO 42 --- [pool-ocp-schedules-19,,29f7ee365ab6] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:29:29.804 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:29.804 INFO 42 --- [pool-ocp-schedules-19,,29f7ee365ab6] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:29:30.200 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:29:30.520 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:30.0, nextRun=2022-12-08 15:29:30.0, currentDate=Thu Dec 08 15:29:30 CST 2022 2022-12-08 15:29:30.521 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:28:30.0, nextRunTime=2022-12-08 15:29:30.0} 2022-12-08 15:29:30.543 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:29:30.761 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:29:01.0, nextRun=2022-12-08 15:29:30.0, currentDate=Thu Dec 08 15:29:30 CST 2022 2022-12-08 15:29:30.762 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:29:01.0, nextRunTime=2022-12-08 15:29:30.0} 2022-12-08 15:29:30.781 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:29:30.782 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:29:30.782 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:29:30.782 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:29:30.788 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:29:31.431 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 190, operation:EXECUTE, state: RUNNING 2022-12-08 15:29:31.479 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=190, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:29:31.410+08:00, endTime=null} 2022-12-08 15:29:31.827 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:32.428 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:32.805 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:32.812 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:32.815 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:29:33.226 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:190, status:SUCCESS 2022-12-08 15:29:33.233 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:190, status:SUCCESS 2022-12-08 15:29:34.945 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:34.945 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:35.700 INFO 42 --- [pool-ocp-schedules-17,,3c03cae7fdeb] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:29:35.810 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:35.810 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:35.813 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:35.817 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:35.847 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:36.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:29:36.165 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:29:36.161645+08:00, lastProcessTime=2022-12-08T15:29:26.151146+08:00 2022-12-08 15:29:36.304 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:29:36.161645+08:00, resultsCount=0 2022-12-08 15:29:36.305 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:29:36.161645+08:00, resultsCount=0 2022-12-08 15:29:36.306 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:29:36.161645+08:00 2022-12-08 15:29:36.342 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:29:37.770 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:37.914 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:29:38.697 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:29:38.706 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:29:38.818 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:38.831 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:38.914 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:29:39.074 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:40.191 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:29:40.218 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=26ms, period=120000ms 2022-12-08 15:29:40.460 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:29:41.668 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:41.832 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:41.838 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:42.140 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:29:42.214 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:42.214 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:44.839 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:44.843 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:45.136 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:45.137 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:45.473 INFO 42 --- [pool-ocp-schedules-14,,ccb824a6932f] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:29:45.508 INFO 42 --- [pool-ocp-schedules-14,,ccb824a6932f] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:29:45.661 INFO 42 --- [pool-ocp-schedules-3,,b3e00a7bc378] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:29:45.702 INFO 42 --- [pool-ocp-schedules-4,,1803990e6800] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:29:45.715 INFO 42 --- [pool-ocp-schedules-10,,da00b023c385] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:29:45.716 INFO 42 --- [pool-ocp-schedules-10,,da00b023c385] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:29:45.803 INFO 42 --- [pool-ocp-schedules-11,,daaf52630de1] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:29:46.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:29:46.156 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:46.186 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:29:46.181866+08:00, lastProcessTime=2022-12-08T15:29:36.161645+08:00 2022-12-08 15:29:46.366 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:29:46.181866+08:00, resultsCount=0 2022-12-08 15:29:46.366 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:29:46.181866+08:00, resultsCount=0 2022-12-08 15:29:46.367 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:29:46.181866+08:00 2022-12-08 15:29:46.534 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:29:46.535 INFO 42 --- [pool-ocp-schedules-14,,21ed3a3da36d] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:29:46.535 INFO 42 --- [pool-ocp-schedules-16,,b7a0aef4bf5f] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:29:47.439 INFO 42 --- [pool-ocp-schedules-15,,47192b22c32e] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:29:47.543 INFO 42 --- [pool-ocp-schedules-5,,d9cf9fa04c4f] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:29:47.544 INFO 42 --- [pool-ocp-schedules-5,,d9cf9fa04c4f] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:29:47.545 INFO 42 --- [pool-ocp-schedules-5,,d9cf9fa04c4f] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:29:47.555 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:29:47.561 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:29:47.844 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:47.851 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:47.915 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:48.188 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:48.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:49.082 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:29:49.173 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:29:49.996 INFO 42 --- [pool-ocp-schedules-6,,dd2491b7998a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:29:49.997 INFO 42 --- [pool-ocp-schedules-6,,dd2491b7998a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:29:50.852 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:50.858 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:50.910 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:29:50.951 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:29:51.394 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:29:51.570 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:51.570 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:51.871 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:29:51.872 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:29:52.990 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:29:53.180 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:29:53.859 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:53.864 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:55.109 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:29:55.114 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:29:55.704 INFO 42 --- [pool-ocp-schedules-13,,c046be3d5148] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:29:56.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:29:56.149 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:29:56.145982+08:00, lastProcessTime=2022-12-08T15:29:46.181866+08:00 2022-12-08 15:29:56.251 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:29:56.145982+08:00, resultsCount=0 2022-12-08 15:29:56.251 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:29:56.145982+08:00, resultsCount=0 2022-12-08 15:29:56.252 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:29:56.145982+08:00 2022-12-08 15:29:56.304 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:56.676 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:29:56.865 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:56.870 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:29:58.047 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:29:58.078 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:58.078 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:29:58.178 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:29:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,dd7760ae7466] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:29:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,dd7760ae7466] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:29:59.325 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:29:59.871 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:29:59.876 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:00.000 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:30:01.038 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:30:01.168 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:01.169 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:01.172 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:01.172 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:01.498 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:30.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:01 CST 2022 2022-12-08 15:30:01.499 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=12, name=Refresh agent config, templateName=RefreshAgentConfigSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 15:25:30.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:01.520 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Refresh agent config, nodeCount=1, taskCount=1 2022-12-08 15:30:01.521 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:01.521 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Refresh agent config, taskDefinitionId=12, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:01.737 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:28:01.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:01 CST 2022 2022-12-08 15:30:01.738 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:28:01.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:01.765 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:30:01.834 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:30.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:01 CST 2022 2022-12-08 15:30:01.834 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=15, name=Sync system event, templateName=SyncSystemEventSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 15:25:30.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:01.855 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync system event 2022-12-08 15:30:01.955 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 191, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:01.982 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:31.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:01 CST 2022 2022-12-08 15:30:01.983 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 15:25:31.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:02.003 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 15:30:02.004 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:02.004 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:02.093 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=191, name=Refresh all agent config, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.RefreshAllAgentConfigTask, seriesId=0, startTime=2022-12-08T15:30:01.940+08:00, endTime=null} 2022-12-08 15:30:02.128 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:31.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:02 CST 2022 2022-12-08 15:30:02.128 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:25:31.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:02.168 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 15:30:02.169 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 15:30:02.309 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:29:00.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:02 CST 2022 2022-12-08 15:30:02.310 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:29:00.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:02.331 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:30:02.332 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:02.332 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:02.531 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:29:01.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:02 CST 2022 2022-12-08 15:30:02.532 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:29:01.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:02.575 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:30:02.575 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:02.576 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,392a31facf04] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484660, interval=60 2022-12-08 15:30:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,392a31facf04] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484602, count=0, elapsed=1668814118033 2022-12-08 15:30:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,d4546fe6c17b] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484660, interval=60 2022-12-08 15:30:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,d4546fe6c17b] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484602, count=0, elapsed=1668814118038 2022-12-08 15:30:02.877 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:02.893 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:03.024 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:29:01.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:03 CST 2022 2022-12-08 15:30:03.027 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:29:01.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:03.072 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:30:03.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:03.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:03.328 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:29:31.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:03 CST 2022 2022-12-08 15:30:03.329 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:29:31.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:03.343 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:191, status:SUCCESS 2022-12-08 15:30:03.354 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:30:03.355 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:03.355 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:03.357 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:191, status:SUCCESS 2022-12-08 15:30:03.361 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 192, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:03.428 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=192, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T15:30:03.349+08:00, endTime=null} 2022-12-08 15:30:03.470 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:30:03.477 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:30:03.480 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:25:34.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:03 CST 2022 2022-12-08 15:30:03.480 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:25:34.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:03.497 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 15:30:03.497 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:03.497 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:03.500 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 193, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:03.771 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=193, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:30:03.487+08:00, endTime=null} 2022-12-08 15:30:03.774 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:29:01.0, nextRun=2022-12-08 15:30:00.0, currentDate=Thu Dec 08 15:30:03 CST 2022 2022-12-08 15:30:03.775 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:29:01.0, nextRunTime=2022-12-08 15:30:00.0} 2022-12-08 15:30:03.788 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:30:03.788 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:03.788 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:03.826 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 194, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:04.019 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=194, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:30:03.815+08:00, endTime=null} 2022-12-08 15:30:04.071 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,db56a10c8d73] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=193, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=193, task_operation=execute, latest_execution_start_time=2022-12-08T15:30:03.486+08:00, sub_task_instance_id=193}, listMap={}}, executor=192.168.28.62 2022-12-08 15:30:04.267 INFO 42 --- [pool-subtask-executor31,6d808bd684a44ecd,01f40deb0fa7] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=194, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=194, task_operation=execute, latest_execution_start_time=2022-12-08T15:30:03.814+08:00, sub_task_instance_id=194}, listMap={}}, executor=192.168.28.62 2022-12-08 15:30:04.524 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,db56a10c8d73] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 193, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:30:04.657 INFO 42 --- [pool-subtask-executor31,6d808bd684a44ecd,01f40deb0fa7] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 194, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:30:04.658 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:04.662 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:04.803 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:30:05.099 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 195, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:05.315 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=195, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:30:05.084+08:00, endTime=null} 2022-12-08 15:30:05.376 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 196, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:05.474 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:29:07.0, nextRun=2022-12-08 15:30:05.0, currentDate=Thu Dec 08 15:30:05 CST 2022 2022-12-08 15:30:05.475 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:29:07.0, nextRunTime=2022-12-08 15:30:05.0} 2022-12-08 15:30:05.482 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=196, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:30:05.363+08:00, endTime=null} 2022-12-08 15:30:05.491 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:192, status:SUCCESS 2022-12-08 15:30:05.491 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:30:05.492 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:05.492 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:05.499 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:192, status:SUCCESS 2022-12-08 15:30:05.554 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 197, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:05.572 INFO 42 --- [pool-subtask-executor31,6d808bd684a44ecd,11d9938b80fc] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=195, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=195, task_operation=execute, latest_execution_start_time=2022-12-08T15:30:05.083+08:00, sub_task_instance_id=195}, listMap={}}, executor=192.168.28.62 2022-12-08 15:30:05.639 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=197, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T15:30:05.539+08:00, endTime=null} 2022-12-08 15:30:05.648 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:193, status:SUCCESS 2022-12-08 15:30:05.650 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,c50626bfae82] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=196, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=196, task_operation=execute, latest_execution_start_time=2022-12-08T15:30:05.362+08:00, sub_task_instance_id=196}, listMap={}}, executor=192.168.28.62 2022-12-08 15:30:05.650 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,c50626bfae82] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:30:05.657 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:193, status:SUCCESS 2022-12-08 15:30:05.667 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,c50626bfae82] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:30:05.682 INFO 42 --- [pool-subtask-executor31,6d808bd684a44ecd,11d9938b80fc] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 195, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:30:05.705 INFO 42 --- [pool-ocp-schedules-1,,1b002f2195ba] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:30:05.710 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 198, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:05.894 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:05.899 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:06.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:30:06.134 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,c50626bfae82] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 196, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:30:06.148 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=198, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:30:05.697+08:00, endTime=null} 2022-12-08 15:30:06.164 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:30:06.161343+08:00, lastProcessTime=2022-12-08T15:29:56.145982+08:00 2022-12-08 15:30:06.171 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:194, status:SUCCESS 2022-12-08 15:30:06.181 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:194, status:SUCCESS 2022-12-08 15:30:06.289 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:30:06.161343+08:00, resultsCount=0 2022-12-08 15:30:06.289 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:30:06.161343+08:00, resultsCount=0 2022-12-08 15:30:06.290 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:30:06.161343+08:00 2022-12-08 15:30:06.310 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:195, status:SUCCESS 2022-12-08 15:30:06.324 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:195, status:SUCCESS 2022-12-08 15:30:06.471 INFO 42 --- [pool-ocp-schedules-15,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:30:06.501 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:196, status:SUCCESS 2022-12-08 15:30:06.676 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:06.679 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:196, status:SUCCESS 2022-12-08 15:30:06.752 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:30:06.948 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:197, status:SUCCESS 2022-12-08 15:30:06.954 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:197, status:SUCCESS 2022-12-08 15:30:07.021 INFO 42 --- [pool-ocp-schedules-15,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:30:07.170 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:30:07.250 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 199, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:07.565 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=199, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:30:07.238+08:00, endTime=null} 2022-12-08 15:30:07.597 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : Started application in 7.522 seconds (JVM running for 604.443) 2022-12-08 15:30:07.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:07.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:07.761 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:07.761 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:08.102 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:08.244 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:30:08.453 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:198, status:SUCCESS 2022-12-08 15:30:08.460 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:198, status:SUCCESS 2022-12-08 15:30:08.553 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:199, status:SUCCESS 2022-12-08 15:30:08.563 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:199, status:SUCCESS 2022-12-08 15:30:08.900 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:08.907 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:09.750 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:30:10.113 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:30:10.113+08:00 2022-12-08 15:30:10.217 INFO 42 --- [pool-ocp-schedules-13,,f92de2a50766] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:30:10.218 INFO 42 --- [pool-ocp-schedules-13,,f92de2a50766] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:30:10.441 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:30:10.457 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:30:10.887 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:11.001 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:11.557 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:30:11.652 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:30:11.908 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:11.913 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:13.971 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:13.971 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:14.063 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:14.063 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:14.913 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:14.920 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:15.705 INFO 42 --- [pool-ocp-schedules-2,,a77b09928077] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:30:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:30:16.157 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:30:16.153495+08:00, lastProcessTime=2022-12-08T15:30:06.161343+08:00 2022-12-08 15:30:16.273 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:30:16.153495+08:00, resultsCount=0 2022-12-08 15:30:16.275 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:30:16.153495+08:00, resultsCount=0 2022-12-08 15:30:16.275 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:30:16.153495+08:00 2022-12-08 15:30:16.752 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:17.073 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:30:17.171 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:30:17.176 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:30:17.921 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:17.926 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:18.150 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:19.831 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:30:20.089 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:29:21.0, nextRun=2022-12-08 15:30:20.0, currentDate=Thu Dec 08 15:30:20 CST 2022 2022-12-08 15:30:20.090 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:29:21.0, nextRunTime=2022-12-08 15:30:20.0} 2022-12-08 15:30:20.111 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:30:20.112 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:20.112 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:20.181 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:20.272 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:26:19.56, end=2022-12-08T15:28:20.231} 2022-12-08 15:30:20.302 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:30:20.799 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 200, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:20.858 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=200, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:30:20.785+08:00, endTime=null} 2022-12-08 15:30:20.927 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:20.931 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:21.020 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:30:21.112 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:27:50+08:00, updateTime=2022-12-08T15:29:50+08:00, expireTime=null, isLeader=false} 2022-12-08 15:30:21.118 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:30:21.517 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:30:21.680 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:200, status:SUCCESS 2022-12-08 15:30:21.687 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:200, status:SUCCESS 2022-12-08 15:30:21.729 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:30:23.181 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:30:23.230 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:27:22+08:00, updateTime=2022-12-08T15:29:52+08:00, expireTime=null, isLeader=false} 2022-12-08 15:30:23.238 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:30:23.310 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:30:23.932 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:23.936 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:25.672 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:29:26.0, nextRun=2022-12-08 15:30:25.0, currentDate=Thu Dec 08 15:30:25 CST 2022 2022-12-08 15:30:25.673 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:29:26.0, nextRunTime=2022-12-08 15:30:25.0} 2022-12-08 15:30:25.707 INFO 42 --- [pool-ocp-schedules-8,,ea3d67bdd079] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:30:25.721 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:30:25.721 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:25.722 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:25.983 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 201, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:26.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:30:26.160 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:30:26.156252+08:00, lastProcessTime=2022-12-08T15:30:16.153495+08:00 2022-12-08 15:30:26.202 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=201, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:30:25.970+08:00, endTime=null} 2022-12-08 15:30:26.306 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:30:26.156252+08:00, resultsCount=0 2022-12-08 15:30:26.307 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:30:26.156252+08:00, resultsCount=0 2022-12-08 15:30:26.307 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:30:26.156252+08:00 2022-12-08 15:30:26.936 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:26.941 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:27.073 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:27.170 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:30:27.592 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:30:28.135 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:201, status:SUCCESS 2022-12-08 15:30:28.141 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:201, status:SUCCESS 2022-12-08 15:30:28.568 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:29.935 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:30:29.942 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:29.947 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:30.719 INFO 42 --- [pool-ocp-schedules-1,,d3d9ee0ce423] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:30:30.719 INFO 42 --- [pool-ocp-schedules-1,,d3d9ee0ce423] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:30:30.807 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:29:31.0, nextRun=2022-12-08 15:30:30.0, currentDate=Thu Dec 08 15:30:30 CST 2022 2022-12-08 15:30:30.808 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:29:31.0, nextRunTime=2022-12-08 15:30:30.0} 2022-12-08 15:30:30.828 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:30:31.074 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:03.0, nextRun=2022-12-08 15:30:30.0, currentDate=Thu Dec 08 15:30:31 CST 2022 2022-12-08 15:30:31.075 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:30:03.0, nextRunTime=2022-12-08 15:30:30.0} 2022-12-08 15:30:31.096 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:30:31.097 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:30:31.097 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:30:31.343 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 202, operation:EXECUTE, state: RUNNING 2022-12-08 15:30:31.511 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=202, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:30:31.330+08:00, endTime=null} 2022-12-08 15:30:31.811 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:30:32.947 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:32.952 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:33.530 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:30:33.536 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:30:34.009 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:34.893 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:202, status:SUCCESS 2022-12-08 15:30:34.905 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:202, status:SUCCESS 2022-12-08 15:30:35.708 INFO 42 --- [pool-ocp-schedules-15,,f73a531378e4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:30:35.953 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:35.958 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:36.118 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:30:36.161 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:30:36.157925+08:00, lastProcessTime=2022-12-08T15:30:26.156252+08:00 2022-12-08 15:30:36.416 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:30:36.157925+08:00, resultsCount=0 2022-12-08 15:30:36.416 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:30:36.157925+08:00, resultsCount=0 2022-12-08 15:30:36.416 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:30:36.157925+08:00 2022-12-08 15:30:36.503 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:37.064 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:30:37.131 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:37.366 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:30:38.363 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:30:38.959 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:38.964 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:39.015 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:39.587 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:39.588 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:40.147 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:30:41.964 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:41.969 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:42.219 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:30:42.224 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:30:42.517 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:30:42.686 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:43.295 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:43.874 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:30:44.970 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:44.974 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:45.453 INFO 42 --- [pool-ocp-schedules-3,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 15:30:45.471 INFO 42 --- [pool-ocp-schedules-13,,86738a9e7111] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:30:45.519 INFO 42 --- [pool-ocp-schedules-13,,86738a9e7111] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:30:45.663 INFO 42 --- [pool-ocp-schedules-2,,1060e1131250] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:30:45.709 INFO 42 --- [pool-ocp-schedules-20,,29ff694e93e3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:30:45.752 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:45.753 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:45.753 INFO 42 --- [pool-ocp-schedules-5,,d255fa448b62] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 15:30:45.809 INFO 42 --- [pool-ocp-schedules-4,,2807d7d481c1] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:30:46.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:30:46.158 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:30:46.154622+08:00, lastProcessTime=2022-12-08T15:30:36.157925+08:00 2022-12-08 15:30:46.289 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:30:46.154622+08:00, resultsCount=0 2022-12-08 15:30:46.289 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:30:46.154622+08:00, resultsCount=0 2022-12-08 15:30:46.289 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:30:46.154622+08:00 2022-12-08 15:30:46.427 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:46.427 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:46.990 INFO 42 --- [pool-ocp-schedules-11,,c34549a00989] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:30:46.990 INFO 42 --- [pool-ocp-schedules-13,,7547ec4791f9] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:30:47.191 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:47.607 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:30:47.753 INFO 42 --- [pool-ocp-schedules-5,,f521bb6193d0] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:30:47.887 INFO 42 --- [pool-ocp-schedules-10,,e4c4c921d367] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:30:47.888 INFO 42 --- [pool-ocp-schedules-10,,e4c4c921d367] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:30:47.888 INFO 42 --- [pool-ocp-schedules-10,,e4c4c921d367] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:30:47.975 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:47.990 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:49.085 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:49.192 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:30:49.515 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:30:49.919 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:50.254 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:30:50.991 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:50.996 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:51.194 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:30:51.332 INFO 42 --- [pool-ocp-schedules-11,,538e8c315f8d] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:30:51.333 INFO 42 --- [pool-ocp-schedules-11,,538e8c315f8d] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:30:51.896 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:30:52.531 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:52.681 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:30:52.808 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:30:53.159 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:53.160 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:53.275 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:30:53.398 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:30:53.997 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:54.002 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:55.596 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:30:55.597 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:30:55.710 INFO 42 --- [pool-ocp-schedules-9,,ab6988fdb675] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:30:56.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:30:56.153 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:30:56.149831+08:00, lastProcessTime=2022-12-08T15:30:46.154622+08:00 2022-12-08 15:30:56.290 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:30:56.149831+08:00, resultsCount=0 2022-12-08 15:30:56.291 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:30:56.149831+08:00, resultsCount=0 2022-12-08 15:30:56.291 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:30:56.149831+08:00 2022-12-08 15:30:57.003 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:30:57.007 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:30:57.550 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:57.841 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:30:58.310 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:30:58.315 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:30:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,3f9b46dd720b] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:30:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,3f9b46dd720b] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:30:58.680 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:30:59.474 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:30:59.522 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:00.008 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:00.013 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:00.089 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:31:00.455 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:31:01.388 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:02.0, nextRun=2022-12-08 15:31:00.0, currentDate=Thu Dec 08 15:31:01 CST 2022 2022-12-08 15:31:01.389 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:30:02.0, nextRunTime=2022-12-08 15:31:00.0} 2022-12-08 15:31:01.410 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:31:01.411 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:31:01.411 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:31:01.623 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:03.0, nextRun=2022-12-08 15:31:00.0, currentDate=Thu Dec 08 15:31:01 CST 2022 2022-12-08 15:31:01.624 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:30:03.0, nextRunTime=2022-12-08 15:31:00.0} 2022-12-08 15:31:01.657 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:31:01.657 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:31:01.657 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:31:01.777 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:03.0, nextRun=2022-12-08 15:31:00.0, currentDate=Thu Dec 08 15:31:01 CST 2022 2022-12-08 15:31:01.778 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:30:03.0, nextRunTime=2022-12-08 15:31:00.0} 2022-12-08 15:31:01.800 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:31:01.801 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:31:01.801 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:31:01.859 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:31.0, nextRun=2022-12-08 15:31:00.0, currentDate=Thu Dec 08 15:31:01 CST 2022 2022-12-08 15:31:01.860 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:30:31.0, nextRunTime=2022-12-08 15:31:00.0} 2022-12-08 15:31:01.877 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:31:01.878 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:31:01.878 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:31:01.935 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:04.0, nextRun=2022-12-08 15:31:00.0, currentDate=Thu Dec 08 15:31:01 CST 2022 2022-12-08 15:31:01.936 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:30:04.0, nextRunTime=2022-12-08 15:31:00.0} 2022-12-08 15:31:01.953 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:31:01.953 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:31:01.954 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:31:01.990 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 203, operation:EXECUTE, state: RUNNING 2022-12-08 15:31:02.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:02.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:02.037 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=203, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:31:01.979+08:00, endTime=null} 2022-12-08 15:31:02.104 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 204, operation:EXECUTE, state: RUNNING 2022-12-08 15:31:02.179 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=204, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:31:02.090+08:00, endTime=null} 2022-12-08 15:31:02.243 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 205, operation:EXECUTE, state: RUNNING 2022-12-08 15:31:02.296 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=205, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:31:02.231+08:00, endTime=null} 2022-12-08 15:31:02.357 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 206, operation:EXECUTE, state: RUNNING 2022-12-08 15:31:02.527 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=206, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:31:02.345+08:00, endTime=null} 2022-12-08 15:31:02.605 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,0347f068b91b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=205, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=205, task_operation=execute, latest_execution_start_time=2022-12-08T15:31:02.229+08:00, sub_task_instance_id=205}, listMap={}}, executor=192.168.28.62 2022-12-08 15:31:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,f6a5b960b406] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484720, interval=60 2022-12-08 15:31:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,f6a5b960b406] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484662, count=0, elapsed=1668814177973 2022-12-08 15:31:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,5df04d19cafb] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484720, interval=60 2022-12-08 15:31:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,5df04d19cafb] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484662, count=0, elapsed=1668814177978 2022-12-08 15:31:02.672 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:02.672 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:02.729 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:31:02.839 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,0347f068b91b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 205, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:31:02.980 INFO 42 --- [pool-subtask-executor29,6d808bd684a44ecd,00f3e0694544] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=206, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=206, task_operation=execute, latest_execution_start_time=2022-12-08T15:31:02.344+08:00, sub_task_instance_id=206}, listMap={}}, executor=192.168.28.62 2022-12-08 15:31:02.980 INFO 42 --- [pool-subtask-executor29,6d808bd684a44ecd,00f3e0694544] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:31:03.004 INFO 42 --- [pool-subtask-executor29,6d808bd684a44ecd,00f3e0694544] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:31:03.014 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:03.020 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:03.145 INFO 42 --- [pool-subtask-executor29,6d808bd684a44ecd,00f3e0694544] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 206, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:31:03.607 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 207, operation:EXECUTE, state: RUNNING 2022-12-08 15:31:03.758 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=207, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:31:03.595+08:00, endTime=null} 2022-12-08 15:31:04.359 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:203, status:SUCCESS 2022-12-08 15:31:04.365 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:203, status:SUCCESS 2022-12-08 15:31:04.796 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:204, status:SUCCESS 2022-12-08 15:31:04.801 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:204, status:SUCCESS 2022-12-08 15:31:04.982 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:205, status:SUCCESS 2022-12-08 15:31:04.990 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:205, status:SUCCESS 2022-12-08 15:31:05.078 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:206, status:SUCCESS 2022-12-08 15:31:05.086 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:206, status:SUCCESS 2022-12-08 15:31:05.189 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:207, status:SUCCESS 2022-12-08 15:31:05.197 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:207, status:SUCCESS 2022-12-08 15:31:05.468 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:31:05.475 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:31:05.711 INFO 42 --- [pool-ocp-schedules-16,,756d3cf06bcb] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:31:05.853 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:06.028 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:06.031 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:06.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:31:06.160 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:31:06.156850+08:00, lastProcessTime=2022-12-08T15:30:56.149831+08:00 2022-12-08 15:31:06.266 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:31:06.156850+08:00, resultsCount=0 2022-12-08 15:31:06.267 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:31:06.156850+08:00, resultsCount=0 2022-12-08 15:31:06.267 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:31:06.156850+08:00 2022-12-08 15:31:06.291 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:05.0, nextRun=2022-12-08 15:31:05.0, currentDate=Thu Dec 08 15:31:06 CST 2022 2022-12-08 15:31:06.292 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:30:05.0, nextRunTime=2022-12-08 15:31:05.0} 2022-12-08 15:31:06.309 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:31:06.310 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:31:06.310 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:31:06.851 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 208, operation:EXECUTE, state: RUNNING 2022-12-08 15:31:07.023 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=208, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:31:06.839+08:00, endTime=null} 2022-12-08 15:31:07.591 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:07.936 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:31:08.181 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:08.245 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:208, status:SUCCESS 2022-12-08 15:31:08.257 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:208, status:SUCCESS 2022-12-08 15:31:08.772 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:31:08.791 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:31:09.032 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:09.036 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:09.256 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:09.257 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:09.553 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:10.535 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:31:11.314 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:11.315 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:11.486 INFO 42 --- [pool-ocp-schedules-16,,fdd455e24728] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:31:11.487 INFO 42 --- [pool-ocp-schedules-16,,fdd455e24728] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:31:12.037 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:12.041 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:12.864 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:31:14.687 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:31:14.692 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:31:15.042 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:15.047 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:15.713 INFO 42 --- [pool-ocp-schedules-8,,edc39a557e68] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:31:15.768 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:31:16.157 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:31:16.154312+08:00, lastProcessTime=2022-12-08T15:31:06.156850+08:00 2022-12-08 15:31:16.269 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:31:16.154312+08:00, resultsCount=0 2022-12-08 15:31:16.270 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:31:16.154312+08:00, resultsCount=0 2022-12-08 15:31:16.270 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:31:16.154312+08:00 2022-12-08 15:31:17.656 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:17.819 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:17.989 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:31:18.048 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:18.052 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:18.113 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:31:18.538 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T15:25:17.326, end=2022-12-08T15:30:18.498} 2022-12-08 15:31:18.538 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T15:25:17.326, end=2022-12-08T15:30:18.498} 2022-12-08 15:31:18.552 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:31:18.552 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:31:18.969 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:18.969 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:19.650 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:20.615 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:31:20.662 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:20.0, nextRun=2022-12-08 15:31:20.0, currentDate=Thu Dec 08 15:31:20 CST 2022 2022-12-08 15:31:20.663 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:30:20.0, nextRunTime=2022-12-08 15:31:20.0} 2022-12-08 15:31:20.679 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:31:20.680 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:31:20.680 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:31:20.856 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:20.857 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:21.053 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:21.059 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:21.273 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 209, operation:EXECUTE, state: RUNNING 2022-12-08 15:31:21.326 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=209, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:31:21.247+08:00, endTime=null} 2022-12-08 15:31:21.896 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:31:22.138 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:209, status:SUCCESS 2022-12-08 15:31:22.145 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:209, status:SUCCESS 2022-12-08 15:31:22.221 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:31:22.441 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:28:51+08:00, updateTime=2022-12-08T15:30:51+08:00, expireTime=null, isLeader=false} 2022-12-08 15:31:22.455 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:31:22.915 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:31:23.162 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:31:23.167 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:31:23.390 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:31:23.954 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:24.060 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:24.069 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:24.157 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:31:25.454 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:25.714 INFO 42 --- [pool-ocp-schedules-2,,e0df4251e295] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:31:25.815 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:26.0, nextRun=2022-12-08 15:31:25.0, currentDate=Thu Dec 08 15:31:25 CST 2022 2022-12-08 15:31:25.816 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:30:26.0, nextRunTime=2022-12-08 15:31:25.0} 2022-12-08 15:31:25.861 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:31:25.869 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:31:25.870 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:31:25.870 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:31:26.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:31:26.149 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:31:26.145254+08:00, lastProcessTime=2022-12-08T15:31:16.154312+08:00 2022-12-08 15:31:26.249 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:31:26.145254+08:00, resultsCount=0 2022-12-08 15:31:26.249 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:31:26.145254+08:00, resultsCount=0 2022-12-08 15:31:26.249 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:31:26.145254+08:00 2022-12-08 15:31:26.487 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 210, operation:EXECUTE, state: RUNNING 2022-12-08 15:31:26.784 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=210, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:31:26.467+08:00, endTime=null} 2022-12-08 15:31:27.069 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:27.074 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:27.206 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:27.207 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:27.988 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:210, status:SUCCESS 2022-12-08 15:31:27.995 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:210, status:SUCCESS 2022-12-08 15:31:28.055 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:28.248 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:31:28.769 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:28.769 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:29.938 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:30.075 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:30.079 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:30.315 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:31.0, nextRun=2022-12-08 15:31:30.0, currentDate=Thu Dec 08 15:31:30 CST 2022 2022-12-08 15:31:30.316 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:30:31.0, nextRunTime=2022-12-08 15:31:30.0} 2022-12-08 15:31:30.336 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:31:30.631 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:31:02.0, nextRun=2022-12-08 15:31:30.0, currentDate=Thu Dec 08 15:31:30 CST 2022 2022-12-08 15:31:30.632 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:31:02.0, nextRunTime=2022-12-08 15:31:30.0} 2022-12-08 15:31:30.649 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:31:30.650 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:31:30.650 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:31:30.714 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:31:30.888 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 211, operation:EXECUTE, state: RUNNING 2022-12-08 15:31:31.240 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=211, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:31:30.876+08:00, endTime=null} 2022-12-08 15:31:31.326 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:31:31.331 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:31:31.565 INFO 42 --- [pool-ocp-schedules-2,,558375407352] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:31:31.565 INFO 42 --- [pool-ocp-schedules-2,,558375407352] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:31:31.849 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:32.982 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:31:33.080 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:33.085 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:33.207 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:211, status:SUCCESS 2022-12-08 15:31:33.218 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:211, status:SUCCESS 2022-12-08 15:31:33.563 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:33.854 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:31:35.341 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:35.341 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:35.715 INFO 42 --- [pool-ocp-schedules-5,,0cd6069244b8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:31:36.086 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:36.092 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:36.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:31:36.150 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:31:36.147132+08:00, lastProcessTime=2022-12-08T15:31:26.145254+08:00 2022-12-08 15:31:36.239 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:31:36.147132+08:00, resultsCount=0 2022-12-08 15:31:36.240 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:31:36.147132+08:00, resultsCount=0 2022-12-08 15:31:36.240 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:31:36.147132+08:00 2022-12-08 15:31:36.789 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:36.790 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:38.249 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:38.583 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:31:39.093 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:39.098 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:39.428 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:31:39.654 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:31:39.660 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:31:39.940 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:40.153 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:40.295 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:31:40.310 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=15ms, period=120000ms 2022-12-08 15:31:40.739 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:31:42.098 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:42.103 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:42.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:42.490 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:31:43.073 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:43.074 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:43.080 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:31:45.103 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:45.108 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:45.401 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:45.401 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:45.471 INFO 42 --- [pool-ocp-schedules-5,,67c7e6d76e21] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:31:45.498 INFO 42 --- [pool-ocp-schedules-5,,67c7e6d76e21] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:31:45.664 INFO 42 --- [pool-ocp-schedules-10,,4285f899f1b5] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:31:45.717 INFO 42 --- [pool-ocp-schedules-4,,d310302e427f] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:31:45.717 INFO 42 --- [pool-ocp-schedules-9,,524b887ad183] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:31:45.718 INFO 42 --- [pool-ocp-schedules-4,,d310302e427f] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:31:45.822 INFO 42 --- [pool-ocp-schedules-12,,04e94675982a] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:31:46.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:31:46.159 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:31:46.156352+08:00, lastProcessTime=2022-12-08T15:31:36.147132+08:00 2022-12-08 15:31:46.259 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:31:46.156352+08:00, resultsCount=0 2022-12-08 15:31:46.259 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:31:46.156352+08:00, resultsCount=0 2022-12-08 15:31:46.260 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:31:46.156352+08:00 2022-12-08 15:31:47.303 INFO 42 --- [pool-ocp-schedules-11,,4e6cfee81c55] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:31:47.304 INFO 42 --- [pool-ocp-schedules-17,,44bd12ca1792] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:31:48.109 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:48.160 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:48.162 INFO 42 --- [pool-ocp-schedules-2,,563bfca5a4a3] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:31:48.205 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:31:48.210 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:31:48.388 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:48.434 INFO 42 --- [pool-ocp-schedules-4,,216a26288d7e] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:31:48.435 INFO 42 --- [pool-ocp-schedules-4,,216a26288d7e] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:31:48.435 INFO 42 --- [pool-ocp-schedules-4,,216a26288d7e] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:31:48.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:49.265 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:31:49.658 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:49.983 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:31:50.417 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:51.011 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:31:51.162 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:51.173 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:51.616 INFO 42 --- [pool-ocp-schedules-19,,ffb6a22097f2] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:31:51.616 INFO 42 --- [pool-ocp-schedules-19,,ffb6a22097f2] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:31:51.746 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:51.746 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:52.221 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:31:52.252 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:30:21+08:00, updateTime=2022-12-08T15:31:21+08:00, expireTime=null, isLeader=false} 2022-12-08 15:31:52.259 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:31:52.504 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:31:52.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:52.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:53.153 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:31:53.430 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:31:54.174 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:54.180 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:54.610 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:31:55.243 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:31:55.249 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:31:55.718 INFO 42 --- [pool-ocp-schedules-3,,a574662a35b0] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:31:55.809 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:56.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:31:56.160 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:31:56.156166+08:00, lastProcessTime=2022-12-08T15:31:46.156352+08:00 2022-12-08 15:31:56.294 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:31:56.156166+08:00, resultsCount=0 2022-12-08 15:31:56.295 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:31:56.156166+08:00, resultsCount=0 2022-12-08 15:31:56.295 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:31:56.156166+08:00 2022-12-08 15:31:57.181 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:31:57.185 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:31:58.131 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:31:58.434 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:31:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,07c6c92f8095] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:31:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,07c6c92f8095] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:31:58.678 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:31:58.866 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:31:58.866 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:31:59.653 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:32:00.186 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:00.191 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:00.345 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:02.0, nextRun=2022-12-08 15:32:00.0, currentDate=Thu Dec 08 15:32:00 CST 2022 2022-12-08 15:32:00.347 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:30:02.0, nextRunTime=2022-12-08 15:32:00.0} 2022-12-08 15:32:00.386 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:32:00.458 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:00.563 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:31:01.0, nextRun=2022-12-08 15:32:00.0, currentDate=Thu Dec 08 15:32:00 CST 2022 2022-12-08 15:32:00.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:31:01.0, nextRunTime=2022-12-08 15:32:00.0} 2022-12-08 15:32:00.589 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:32:00.589 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:32:00.589 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:32:00.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:31:02.0, nextRun=2022-12-08 15:32:00.0, currentDate=Thu Dec 08 15:32:00 CST 2022 2022-12-08 15:32:00.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:31:02.0, nextRunTime=2022-12-08 15:32:00.0} 2022-12-08 15:32:00.665 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:32:00.666 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:32:00.666 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:32:00.707 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 212, operation:EXECUTE, state: RUNNING 2022-12-08 15:32:00.723 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:31:02.0, nextRun=2022-12-08 15:32:00.0, currentDate=Thu Dec 08 15:32:00 CST 2022 2022-12-08 15:32:00.724 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:31:02.0, nextRunTime=2022-12-08 15:32:00.0} 2022-12-08 15:32:00.746 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=212, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:32:00.693+08:00, endTime=null} 2022-12-08 15:32:00.746 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:32:00.747 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:32:00.747 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:32:01.087 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:31:31.0, nextRun=2022-12-08 15:32:00.0, currentDate=Thu Dec 08 15:32:01 CST 2022 2022-12-08 15:32:01.088 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:31:31.0, nextRunTime=2022-12-08 15:32:00.0} 2022-12-08 15:32:01.104 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:32:01.105 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:32:01.105 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:32:01.192 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:32:01.208 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:31:02.0, nextRun=2022-12-08 15:32:00.0, currentDate=Thu Dec 08 15:32:01 CST 2022 2022-12-08 15:32:01.208 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:31:02.0, nextRunTime=2022-12-08 15:32:00.0} 2022-12-08 15:32:01.226 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:32:01.226 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:32:01.226 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:32:01.437 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:01.438 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:01.825 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 213, operation:EXECUTE, state: RUNNING 2022-12-08 15:32:01.891 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=213, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:32:01.812+08:00, endTime=null} 2022-12-08 15:32:01.964 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 214, operation:EXECUTE, state: RUNNING 2022-12-08 15:32:02.016 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=214, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:32:01.952+08:00, endTime=null} 2022-12-08 15:32:02.091 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 215, operation:EXECUTE, state: RUNNING 2022-12-08 15:32:02.163 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=215, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:32:02.080+08:00, endTime=null} 2022-12-08 15:32:02.193 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,097e57c8be16] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=214, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=214, task_operation=execute, latest_execution_start_time=2022-12-08T15:32:01.951+08:00, sub_task_instance_id=214}, listMap={}}, executor=192.168.28.62 2022-12-08 15:32:02.227 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 216, operation:EXECUTE, state: RUNNING 2022-12-08 15:32:02.512 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,097e57c8be16] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 214, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:32:02.518 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=216, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:32:02.213+08:00, endTime=null} 2022-12-08 15:32:02.551 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:212, status:SUCCESS 2022-12-08 15:32:02.562 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:212, status:SUCCESS 2022-12-08 15:32:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,caf2f0829ffc] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484780, interval=60 2022-12-08 15:32:02.637 INFO 42 --- [pool-prometheus-minute-schedule-1,,caf2f0829ffc] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484722, count=0, elapsed=1668814237915 2022-12-08 15:32:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,aa3341d20365] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484780, interval=60 2022-12-08 15:32:02.641 INFO 42 --- [pool-prometheus-minute-schedule-1,,aa3341d20365] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484722, count=0, elapsed=1668814237919 2022-12-08 15:32:02.977 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:213, status:SUCCESS 2022-12-08 15:32:03.114 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:213, status:SUCCESS 2022-12-08 15:32:03.193 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:03.199 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:03.264 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:214, status:SUCCESS 2022-12-08 15:32:03.265 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:32:03.271 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:214, status:SUCCESS 2022-12-08 15:32:03.476 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:215, status:SUCCESS 2022-12-08 15:32:03.482 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:215, status:SUCCESS 2022-12-08 15:32:03.663 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:216, status:SUCCESS 2022-12-08 15:32:03.668 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:216, status:SUCCESS 2022-12-08 15:32:03.694 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:32:03.699 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:32:04.542 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:05.494 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:05.590 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:31:06.0, nextRun=2022-12-08 15:32:05.0, currentDate=Thu Dec 08 15:32:05 CST 2022 2022-12-08 15:32:05.591 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:31:06.0, nextRunTime=2022-12-08 15:32:05.0} 2022-12-08 15:32:05.606 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:32:05.607 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:32:05.607 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:32:05.720 INFO 42 --- [pool-ocp-schedules-14,,162a12bf681c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:32:05.809 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:32:06.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:32:06.156 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:32:06.151917+08:00, lastProcessTime=2022-12-08T15:31:56.156166+08:00 2022-12-08 15:32:06.200 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:06.204 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:06.265 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:32:06.151917+08:00, resultsCount=0 2022-12-08 15:32:06.265 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:32:06.151917+08:00, resultsCount=0 2022-12-08 15:32:06.266 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:32:06.151917+08:00 2022-12-08 15:32:06.658 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 217, operation:EXECUTE, state: RUNNING 2022-12-08 15:32:06.880 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=217, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:32:06.646+08:00, endTime=null} 2022-12-08 15:32:07.655 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:07.656 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:08.215 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:217, status:SUCCESS 2022-12-08 15:32:08.222 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:217, status:SUCCESS 2022-12-08 15:32:08.536 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:08.536 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:08.704 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:09.205 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:09.210 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:09.636 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:32:10.165 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:32:10.536 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:11.082 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:32:11.087 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:32:11.232 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:32:11.596 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:11.662 INFO 42 --- [pool-ocp-schedules-4,,1265d90ad7c4] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:32:11.662 INFO 42 --- [pool-ocp-schedules-4,,1265d90ad7c4] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:32:12.211 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:12.215 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:13.329 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:32:14.055 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:14.210 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:32:14.659 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:14.659 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:15.216 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:15.222 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:15.721 INFO 42 --- [pool-ocp-schedules-17,,b326276362ce] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:32:16.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:32:16.159 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:32:16.148144+08:00, lastProcessTime=2022-12-08T15:32:06.151917+08:00 2022-12-08 15:32:16.285 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:32:16.148144+08:00, resultsCount=0 2022-12-08 15:32:16.285 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:32:16.148144+08:00, resultsCount=0 2022-12-08 15:32:16.285 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:32:16.148144+08:00 2022-12-08 15:32:17.130 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:17.131 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:18.223 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:18.230 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:18.730 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:19.371 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:32:19.379 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:32:20.266 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:32:20.321 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:20.432 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:31:21.0, nextRun=2022-12-08 15:32:20.0, currentDate=Thu Dec 08 15:32:20 CST 2022 2022-12-08 15:32:20.433 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:31:21.0, nextRunTime=2022-12-08 15:32:20.0} 2022-12-08 15:32:20.457 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:32:20.457 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:32:20.457 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:32:20.753 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:20.975 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:28:20.231, end=2022-12-08T15:30:20.769} 2022-12-08 15:32:20.989 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:32:21.147 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 218, operation:EXECUTE, state: RUNNING 2022-12-08 15:32:21.190 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=218, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:32:21.129+08:00, endTime=null} 2022-12-08 15:32:21.231 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:21.236 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:21.260 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:32:21.303 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:21.599 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:32:22.288 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:32:22.416 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:218, status:SUCCESS 2022-12-08 15:32:22.424 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:218, status:SUCCESS 2022-12-08 15:32:22.555 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:32:23.365 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:32:23.497 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:32:23.582 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:23.582 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:24.236 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:24.241 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:24.365 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:24.365 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:25.165 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:32:25.722 INFO 42 --- [pool-ocp-schedules-17,,48116f9b5c30] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:32:26.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:32:26.151 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:32:26.148665+08:00, lastProcessTime=2022-12-08T15:32:16.148144+08:00 2022-12-08 15:32:26.258 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:32:26.148665+08:00, resultsCount=0 2022-12-08 15:32:26.258 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:32:26.148665+08:00, resultsCount=0 2022-12-08 15:32:26.258 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:32:26.148665+08:00 2022-12-08 15:32:26.418 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:31:26.0, nextRun=2022-12-08 15:32:25.0, currentDate=Thu Dec 08 15:32:26 CST 2022 2022-12-08 15:32:26.419 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:31:26.0, nextRunTime=2022-12-08 15:32:25.0} 2022-12-08 15:32:26.461 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:32:26.462 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:32:26.462 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:32:26.777 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:32:26.783 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:32:27.242 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:27.247 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:27.431 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:27.464 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 219, operation:EXECUTE, state: RUNNING 2022-12-08 15:32:27.537 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=219, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:32:27.451+08:00, endTime=null} 2022-12-08 15:32:28.763 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:219, status:SUCCESS 2022-12-08 15:32:28.770 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:219, status:SUCCESS 2022-12-08 15:32:28.932 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:29.741 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:29.955 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:32:30.247 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:30.252 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:30.543 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:30.544 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:30.566 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:32:30.856 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:31.063 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:31:30.0, nextRun=2022-12-08 15:32:30.0, currentDate=Thu Dec 08 15:32:31 CST 2022 2022-12-08 15:32:31.064 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:31:30.0, nextRunTime=2022-12-08 15:32:30.0} 2022-12-08 15:32:31.087 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:32:31.151 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:01.0, nextRun=2022-12-08 15:32:30.0, currentDate=Thu Dec 08 15:32:31 CST 2022 2022-12-08 15:32:31.151 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:32:01.0, nextRunTime=2022-12-08 15:32:30.0} 2022-12-08 15:32:31.175 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:32:31.176 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:32:31.176 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:32:31.288 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:32:31.678 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 220, operation:EXECUTE, state: RUNNING 2022-12-08 15:32:31.721 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=220, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:32:31.664+08:00, endTime=null} 2022-12-08 15:32:31.743 INFO 42 --- [pool-ocp-schedules-17,,7e4a2d0afb0f] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:32:31.744 INFO 42 --- [pool-ocp-schedules-17,,7e4a2d0afb0f] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:32:32.742 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:220, status:SUCCESS 2022-12-08 15:32:32.748 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:220, status:SUCCESS 2022-12-08 15:32:32.954 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:32.955 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:33.253 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:33.263 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:33.426 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:32:35.598 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:32:35.604 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:32:35.723 INFO 42 --- [pool-ocp-schedules-18,,ac33122a60d2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:32:36.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:32:36.146 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:36.163 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:32:36.155081+08:00, lastProcessTime=2022-12-08T15:32:26.148665+08:00 2022-12-08 15:32:36.264 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:36.272 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:36.275 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:32:36.155081+08:00, resultsCount=0 2022-12-08 15:32:36.275 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:32:36.155081+08:00, resultsCount=0 2022-12-08 15:32:36.275 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:32:36.155081+08:00 2022-12-08 15:32:36.982 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:37.216 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:32:38.957 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:39.259 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:39.259 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:39.273 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:39.291 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:40.055 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:40.055 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:40.194 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:32:40.731 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:32:40.933 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:41.392 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:32:42.292 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:42.297 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:42.497 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:32:42.505 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:32:43.324 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:43.503 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:32:45.298 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:45.303 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:45.416 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:45.474 INFO 42 --- [pool-ocp-schedules-1,,f58f3954bc77] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:32:45.503 INFO 42 --- [pool-ocp-schedules-1,,f58f3954bc77] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:32:45.612 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:32:45.665 INFO 42 --- [pool-ocp-schedules-3,,66b932c60bb7] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:32:45.726 INFO 42 --- [pool-ocp-schedules-11,,2ba54455a4ac] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:32:45.828 INFO 42 --- [pool-ocp-schedules-16,,6bf3fac94a86] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:32:46.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:32:46.175 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:32:46.171037+08:00, lastProcessTime=2022-12-08T15:32:36.155081+08:00 2022-12-08 15:32:46.289 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:32:46.171037+08:00, resultsCount=0 2022-12-08 15:32:46.289 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:32:46.171037+08:00, resultsCount=0 2022-12-08 15:32:46.289 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:32:46.171037+08:00 2022-12-08 15:32:46.389 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:46.389 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:47.636 INFO 42 --- [pool-ocp-schedules-13,,8032a9e2ee75] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:32:47.637 INFO 42 --- [pool-ocp-schedules-18,,6e225fc9e493] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:32:48.245 INFO 42 --- [pool-ocp-schedules-5,,64b6cdaceb6c] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:32:48.303 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:48.308 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:48.466 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:48.466 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:48.526 INFO 42 --- [pool-ocp-schedules-12,,d67e636085a4] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:32:48.527 INFO 42 --- [pool-ocp-schedules-12,,d67e636085a4] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:32:48.527 INFO 42 --- [pool-ocp-schedules-12,,d67e636085a4] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:32:48.997 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:50.772 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:32:50.949 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:32:50.957 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:32:51.001 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:32:51.308 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:51.313 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:51.521 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:51.542 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:32:52.013 INFO 42 --- [pool-ocp-schedules-1,,19facf4e271e] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:32:52.014 INFO 42 --- [pool-ocp-schedules-1,,19facf4e271e] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:32:52.317 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:32:52.624 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:32:52.717 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:53.093 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:32:53.521 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:32:53.582 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:32:54.314 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:54.319 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:55.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:55.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:55.310 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:32:55.727 INFO 42 --- [pool-ocp-schedules-8,,a0886c0f6498] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:32:55.989 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:32:55.990 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:32:56.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:32:56.156 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:32:56.152108+08:00, lastProcessTime=2022-12-08T15:32:46.171037+08:00 2022-12-08 15:32:56.270 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:32:56.152108+08:00, resultsCount=0 2022-12-08 15:32:56.271 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:32:56.152108+08:00, resultsCount=0 2022-12-08 15:32:56.271 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:32:56.152108+08:00 2022-12-08 15:32:57.319 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:32:57.324 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:32:58.339 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:32:58.344 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:32:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,92a535983311] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:32:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,92a535983311] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:32:59.041 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:32:59.176 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:00.001 INFO 42 --- [pool-ocp-schedules-19,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:33:00.325 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:00.329 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:00.958 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:33:01.072 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:01.146 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:01.0, nextRun=2022-12-08 15:33:00.0, currentDate=Thu Dec 08 15:33:01 CST 2022 2022-12-08 15:33:01.148 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:32:01.0, nextRunTime=2022-12-08 15:33:00.0} 2022-12-08 15:33:01.167 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:33:01.168 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:33:01.168 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:33:01.219 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:01.0, nextRun=2022-12-08 15:33:00.0, currentDate=Thu Dec 08 15:33:01 CST 2022 2022-12-08 15:33:01.220 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:32:01.0, nextRunTime=2022-12-08 15:33:00.0} 2022-12-08 15:33:01.249 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:33:01.252 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:33:01.253 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:33:01.305 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:01.326 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:01.0, nextRun=2022-12-08 15:33:00.0, currentDate=Thu Dec 08 15:33:01 CST 2022 2022-12-08 15:33:01.327 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:32:01.0, nextRunTime=2022-12-08 15:33:00.0} 2022-12-08 15:33:01.354 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:33:01.355 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:33:01.355 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:33:01.397 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:31.0, nextRun=2022-12-08 15:33:00.0, currentDate=Thu Dec 08 15:33:01 CST 2022 2022-12-08 15:33:01.398 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:32:31.0, nextRunTime=2022-12-08 15:33:00.0} 2022-12-08 15:33:01.428 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:33:01.429 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:33:01.429 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:33:01.529 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:01.0, nextRun=2022-12-08 15:33:00.0, currentDate=Thu Dec 08 15:33:01 CST 2022 2022-12-08 15:33:01.529 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:33:01.530 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:32:01.0, nextRunTime=2022-12-08 15:33:00.0} 2022-12-08 15:33:01.553 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:33:01.553 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:33:01.553 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:33:02.013 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:33:02.155 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 224, operation:EXECUTE, state: RUNNING 2022-12-08 15:33:02.188 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=224, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:33:02.141+08:00, endTime=null} 2022-12-08 15:33:02.266 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 225, operation:EXECUTE, state: RUNNING 2022-12-08 15:33:02.299 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=225, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:33:02.243+08:00, endTime=null} 2022-12-08 15:33:02.369 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 221, operation:EXECUTE, state: RUNNING 2022-12-08 15:33:02.408 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=221, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:33:02.353+08:00, endTime=null} 2022-12-08 15:33:02.473 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:02.544 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:02.476 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 222, operation:EXECUTE, state: RUNNING 2022-12-08 15:33:02.626 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=222, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:33:02.463+08:00, endTime=null} 2022-12-08 15:33:02.633 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,9f89e897de45] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=221, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=221, task_operation=execute, latest_execution_start_time=2022-12-08T15:33:02.352+08:00, sub_task_instance_id=221}, listMap={}}, executor=192.168.28.62 2022-12-08 15:33:02.637 INFO 42 --- [pool-prometheus-minute-schedule-2,,f6a1aaea99e1] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484840, interval=60 2022-12-08 15:33:02.637 INFO 42 --- [pool-prometheus-minute-schedule-2,,f6a1aaea99e1] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484782, count=0, elapsed=1668814297855 2022-12-08 15:33:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,e907042d7a2c] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484840, interval=60 2022-12-08 15:33:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,e907042d7a2c] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484782, count=0, elapsed=1668814297858 2022-12-08 15:33:02.754 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 223, operation:EXECUTE, state: RUNNING 2022-12-08 15:33:03.069 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,9f89e897de45] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 221, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:33:03.074 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=223, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:33:02.720+08:00, endTime=null} 2022-12-08 15:33:03.578 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:03.587 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:03.827 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:221, status:SUCCESS 2022-12-08 15:33:03.842 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:221, status:SUCCESS 2022-12-08 15:33:03.926 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:33:04.149 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:222, status:SUCCESS 2022-12-08 15:33:04.155 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:222, status:SUCCESS 2022-12-08 15:33:04.346 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:223, status:SUCCESS 2022-12-08 15:33:04.352 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:223, status:SUCCESS 2022-12-08 15:33:04.375 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:04.376 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:04.443 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:224, status:SUCCESS 2022-12-08 15:33:04.453 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:224, status:SUCCESS 2022-12-08 15:33:04.776 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:225, status:SUCCESS 2022-12-08 15:33:04.782 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:225, status:SUCCESS 2022-12-08 15:33:05.728 INFO 42 --- [pool-ocp-schedules-1,,14aea2963870] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:33:06.048 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:06.0, nextRun=2022-12-08 15:33:05.0, currentDate=Thu Dec 08 15:33:06 CST 2022 2022-12-08 15:33:06.049 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:32:06.0, nextRunTime=2022-12-08 15:33:05.0} 2022-12-08 15:33:06.064 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:33:06.065 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:33:06.065 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:33:06.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:33:06.178 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:33:06.174382+08:00, lastProcessTime=2022-12-08T15:32:56.152108+08:00 2022-12-08 15:33:06.189 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 226, operation:EXECUTE, state: RUNNING 2022-12-08 15:33:06.229 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=226, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:33:06.162+08:00, endTime=null} 2022-12-08 15:33:06.318 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:33:06.174382+08:00, resultsCount=0 2022-12-08 15:33:06.318 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:33:06.174382+08:00, resultsCount=0 2022-12-08 15:33:06.318 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:33:06.174382+08:00 2022-12-08 15:33:06.588 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:06.592 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:06.839 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:33:06.844 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:33:06.851 INFO 42 --- [pool-ocp-schedules-19,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:33:07.177 INFO 42 --- [pool-ocp-schedules-19,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:33:07.306 INFO 42 --- [pool-ocp-schedules-19,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:33:07.423 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:07.652 INFO 42 --- [pool-ocp-schedules-19,,] o.s.boot.SpringApplication : Started application in 7.611 seconds (JVM running for 784.499) 2022-12-08 15:33:08.760 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:09.073 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:33:09.454 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:09.593 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:09.597 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:10.190 INFO 42 --- [pool-ocp-schedules-19,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:33:10.190+08:00 2022-12-08 15:33:10.360 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:33:10.487 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:10.487 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:11.025 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:33:11.150 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:11.806 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:11.807 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:12.064 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:33:12.077 INFO 42 --- [pool-ocp-schedules-14,,e8961322cb71] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:33:12.078 INFO 42 --- [pool-ocp-schedules-14,,e8961322cb71] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:33:12.598 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:12.603 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:14.276 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:33:14.527 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:33:14.534 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:33:14.855 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:15.604 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:15.609 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:15.729 INFO 42 --- [pool-ocp-schedules-17,,1eace51e6eef] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:33:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:33:16.155 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:33:16.150525+08:00, lastProcessTime=2022-12-08T15:33:06.174382+08:00 2022-12-08 15:33:16.274 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:33:16.150525+08:00, resultsCount=0 2022-12-08 15:33:16.275 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:33:16.150525+08:00, resultsCount=0 2022-12-08 15:33:16.275 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:33:16.150525+08:00 2022-12-08 15:33:16.795 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:17.137 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:33:17.909 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:17.910 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:18.610 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:18.615 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:19.512 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:20.041 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:20.042 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:20.684 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:20.0, nextRun=2022-12-08 15:33:20.0, currentDate=Thu Dec 08 15:33:20 CST 2022 2022-12-08 15:33:20.685 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:32:20.0, nextRunTime=2022-12-08 15:33:20.0} 2022-12-08 15:33:20.703 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:33:20.704 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:33:20.704 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:33:21.090 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:33:21.172 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:21.521 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 227, operation:EXECUTE, state: RUNNING 2022-12-08 15:33:21.616 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:21.620 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:21.833 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=227, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:33:21.500+08:00, endTime=null} 2022-12-08 15:33:22.106 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:33:22.358 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:33:22.383 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:33:22.395 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:33:22.672 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:33:23.098 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:23.423 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:227, status:SUCCESS 2022-12-08 15:33:23.431 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:227, status:SUCCESS 2022-12-08 15:33:23.923 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:33:24.112 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:24.317 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:33:24.372 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:33:24.621 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:24.626 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:25.282 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:26.0, nextRun=2022-12-08 15:33:25.0, currentDate=Thu Dec 08 15:33:25 CST 2022 2022-12-08 15:33:25.283 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:32:26.0, nextRunTime=2022-12-08 15:33:25.0} 2022-12-08 15:33:25.325 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:33:25.326 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:33:25.326 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:33:25.415 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:33:25.731 INFO 42 --- [pool-ocp-schedules-13,,98e7e9bbf36b] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:33:25.954 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 228, operation:EXECUTE, state: RUNNING 2022-12-08 15:33:26.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:33:26.126 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=228, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:33:25.939+08:00, endTime=null} 2022-12-08 15:33:26.156 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:33:26.150943+08:00, lastProcessTime=2022-12-08T15:33:16.150525+08:00 2022-12-08 15:33:26.279 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:33:26.150943+08:00, resultsCount=0 2022-12-08 15:33:26.280 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:33:26.150943+08:00, resultsCount=0 2022-12-08 15:33:26.280 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:33:26.150943+08:00 2022-12-08 15:33:26.353 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:26.354 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:27.220 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:27.220 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:27.258 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:228, status:SUCCESS 2022-12-08 15:33:27.267 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:228, status:SUCCESS 2022-12-08 15:33:27.627 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:27.632 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:29.522 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:33:29.527 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:33:29.599 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:29.606 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:30.322 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:30.633 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:30.638 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:30.645 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:33:30.779 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:31.0, nextRun=2022-12-08 15:33:30.0, currentDate=Thu Dec 08 15:33:30 CST 2022 2022-12-08 15:33:30.780 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:32:31.0, nextRunTime=2022-12-08 15:33:30.0} 2022-12-08 15:33:30.804 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:33:30.922 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:33:01.0, nextRun=2022-12-08 15:33:30.0, currentDate=Thu Dec 08 15:33:30 CST 2022 2022-12-08 15:33:30.923 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:33:01.0, nextRunTime=2022-12-08 15:33:30.0} 2022-12-08 15:33:30.946 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:33:30.947 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:33:30.947 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:33:31.133 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:33:31.201 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:31.270 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 229, operation:EXECUTE, state: RUNNING 2022-12-08 15:33:31.298 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=229, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:33:31.256+08:00, endTime=null} 2022-12-08 15:33:31.867 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:229, status:SUCCESS 2022-12-08 15:33:31.873 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:229, status:SUCCESS 2022-12-08 15:33:32.149 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:33:32.221 INFO 42 --- [pool-ocp-schedules-17,,ffa1fbbe345f] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:33:32.221 INFO 42 --- [pool-ocp-schedules-17,,ffa1fbbe345f] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:33:32.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:32.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:33.366 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:33.367 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:33.639 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:33.644 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:34.347 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:33:35.732 INFO 42 --- [pool-ocp-schedules-18,,a35c133a69d6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:33:36.073 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:33:36.078 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:33:36.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:33:36.162 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:33:36.157487+08:00, lastProcessTime=2022-12-08T15:33:26.150943+08:00 2022-12-08 15:33:36.290 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:33:36.157487+08:00, resultsCount=0 2022-12-08 15:33:36.290 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:33:36.157487+08:00, resultsCount=0 2022-12-08 15:33:36.291 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:33:36.157487+08:00 2022-12-08 15:33:36.425 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:36.645 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:36.651 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:39.061 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:39.277 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:33:39.564 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:39.565 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:39.631 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:39.652 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:39.658 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:40.319 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:33:40.333 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=13ms, period=120000ms 2022-12-08 15:33:40.444 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:33:41.176 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:33:41.358 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:42.252 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:33:42.270 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:42.271 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:42.659 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:42.663 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:44.419 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:33:44.661 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:33:44.667 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:33:45.339 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:45.471 INFO 42 --- [pool-ocp-schedules-8,,1539063fb52d] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:33:45.498 INFO 42 --- [pool-ocp-schedules-8,,1539063fb52d] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:33:45.664 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:45.666 INFO 42 --- [pool-ocp-schedules-19,,d1d04c18eb96] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:33:45.669 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:45.719 INFO 42 --- [pool-ocp-schedules-1,,f911ddf29ea9] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:33:45.720 INFO 42 --- [pool-ocp-schedules-1,,f911ddf29ea9] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:33:45.733 INFO 42 --- [pool-ocp-schedules-11,,467bfc770f11] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:33:45.834 INFO 42 --- [pool-ocp-schedules-4,,92d40d51fbe1] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:33:45.846 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:46.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:33:46.150 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:33:46.146778+08:00, lastProcessTime=2022-12-08T15:33:36.157487+08:00 2022-12-08 15:33:46.241 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:33:46.247 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:33:46.146778+08:00, resultsCount=0 2022-12-08 15:33:46.247 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:33:46.146778+08:00, resultsCount=0 2022-12-08 15:33:46.248 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:33:46.146778+08:00 2022-12-08 15:33:47.710 INFO 42 --- [pool-ocp-schedules-16,,6e498b6f7122] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:33:47.711 INFO 42 --- [pool-ocp-schedules-17,,4b50a3a513d5] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:33:48.322 INFO 42 --- [pool-ocp-schedules-6,,fe2f441dbd44] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:33:48.416 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:48.416 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:48.616 INFO 42 --- [pool-ocp-schedules-11,,22bd3c516c50] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:33:48.617 INFO 42 --- [pool-ocp-schedules-11,,22bd3c516c50] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:33:48.617 INFO 42 --- [pool-ocp-schedules-11,,22bd3c516c50] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:33:48.670 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:48.674 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:48.900 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:48.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:49.690 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:51.358 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:33:51.383 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:33:51.388 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:33:51.416 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:33:51.471 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:51.675 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:51.680 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:52.035 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:52.270 INFO 42 --- [pool-ocp-schedules-9,,2fdd27a39f7d] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:33:52.271 INFO 42 --- [pool-ocp-schedules-9,,2fdd27a39f7d] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:33:52.291 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:33:52.482 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:33:52.673 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:33:52.751 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:33:54.181 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:33:54.225 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:30:23+08:00, updateTime=2022-12-08T15:33:23+08:00, expireTime=null, isLeader=false} 2022-12-08 15:33:54.237 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:33:54.466 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:33:54.531 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:54.532 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:54.680 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:54.685 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:55.216 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:33:55.216 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:33:55.681 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:33:55.735 INFO 42 --- [pool-ocp-schedules-12,,8ab7a0e95ed8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:33:56.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:33:56.152 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:33:56.148510+08:00, lastProcessTime=2022-12-08T15:33:46.146778+08:00 2022-12-08 15:33:56.272 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:33:56.148510+08:00, resultsCount=0 2022-12-08 15:33:56.272 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:33:56.148510+08:00, resultsCount=0 2022-12-08 15:33:56.273 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:33:56.148510+08:00 2022-12-08 15:33:57.624 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:33:57.629 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:33:57.686 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:33:57.691 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:33:58.349 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:33:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,586eab1debb3] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:33:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,586eab1debb3] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:33:59.742 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:00.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:32:00.0, nextRun=2022-12-08 15:34:00.0, currentDate=Thu Dec 08 15:34:00 CST 2022 2022-12-08 15:34:00.644 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:32:00.0, nextRunTime=2022-12-08 15:34:00.0} 2022-12-08 15:34:00.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:00.688 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:34:00.691 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:00.695 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:00.789 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:33:01.0, nextRun=2022-12-08 15:34:00.0, currentDate=Thu Dec 08 15:34:00 CST 2022 2022-12-08 15:34:00.790 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:33:01.0, nextRunTime=2022-12-08 15:34:00.0} 2022-12-08 15:34:00.807 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:34:00.807 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:34:00.807 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:34:00.860 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:33:01.0, nextRun=2022-12-08 15:34:00.0, currentDate=Thu Dec 08 15:34:00 CST 2022 2022-12-08 15:34:00.861 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:33:01.0, nextRunTime=2022-12-08 15:34:00.0} 2022-12-08 15:34:00.887 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:34:00.888 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:34:00.888 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:34:00.956 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:33:01.0, nextRun=2022-12-08 15:34:00.0, currentDate=Thu Dec 08 15:34:00 CST 2022 2022-12-08 15:34:00.956 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:33:01.0, nextRunTime=2022-12-08 15:34:00.0} 2022-12-08 15:34:00.979 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:34:00.979 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:34:00.980 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:34:01.033 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:33:31.0, nextRun=2022-12-08 15:34:00.0, currentDate=Thu Dec 08 15:34:01 CST 2022 2022-12-08 15:34:01.033 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:33:31.0, nextRunTime=2022-12-08 15:34:00.0} 2022-12-08 15:34:01.050 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:34:01.051 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:34:01.051 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:34:01.121 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:33:02.0, nextRun=2022-12-08 15:34:00.0, currentDate=Thu Dec 08 15:34:01 CST 2022 2022-12-08 15:34:01.122 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:33:02.0, nextRunTime=2022-12-08 15:34:00.0} 2022-12-08 15:34:01.138 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:34:01.138 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:34:01.138 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:34:01.231 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:34:01.417 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:34:01.452 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:01.580 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:01.581 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:01.744 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 230, operation:EXECUTE, state: RUNNING 2022-12-08 15:34:01.921 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=230, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:34:01.732+08:00, endTime=null} 2022-12-08 15:34:01.993 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 231, operation:EXECUTE, state: RUNNING 2022-12-08 15:34:02.052 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=231, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:34:01.978+08:00, endTime=null} 2022-12-08 15:34:02.121 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 232, operation:EXECUTE, state: RUNNING 2022-12-08 15:34:02.324 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:34:02.407 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=232, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:34:02.107+08:00, endTime=null} 2022-12-08 15:34:02.482 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 233, operation:EXECUTE, state: RUNNING 2022-12-08 15:34:02.541 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=233, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:34:02.468+08:00, endTime=null} 2022-12-08 15:34:02.613 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 234, operation:EXECUTE, state: RUNNING 2022-12-08 15:34:02.622 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,5b849bffb844] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=232, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=232, task_operation=execute, latest_execution_start_time=2022-12-08T15:34:02.106+08:00, sub_task_instance_id=232}, listMap={}}, executor=192.168.28.62 2022-12-08 15:34:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,9e6435a1a408] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484900, interval=60 2022-12-08 15:34:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,9e6435a1a408] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484842, count=0, elapsed=1668814357794 2022-12-08 15:34:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,d35bc80a1559] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484900, interval=60 2022-12-08 15:34:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,d35bc80a1559] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484842, count=0, elapsed=1668814357798 2022-12-08 15:34:02.667 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=234, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:34:02.598+08:00, endTime=null} 2022-12-08 15:34:02.741 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,5b849bffb844] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 232, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:34:03.146 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:230, status:SUCCESS 2022-12-08 15:34:03.152 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:230, status:SUCCESS 2022-12-08 15:34:03.235 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:231, status:SUCCESS 2022-12-08 15:34:03.242 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:231, status:SUCCESS 2022-12-08 15:34:03.456 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:232, status:SUCCESS 2022-12-08 15:34:03.462 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:232, status:SUCCESS 2022-12-08 15:34:03.606 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:233, status:SUCCESS 2022-12-08 15:34:03.613 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:233, status:SUCCESS 2022-12-08 15:34:03.696 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:03.701 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:03.713 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:234, status:SUCCESS 2022-12-08 15:34:03.719 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:234, status:SUCCESS 2022-12-08 15:34:03.764 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:03.764 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:04.512 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:34:05.380 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:33:06.0, nextRun=2022-12-08 15:34:05.0, currentDate=Thu Dec 08 15:34:05 CST 2022 2022-12-08 15:34:05.381 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:33:06.0, nextRunTime=2022-12-08 15:34:05.0} 2022-12-08 15:34:05.412 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:34:05.413 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:34:05.413 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:34:05.736 INFO 42 --- [pool-ocp-schedules-17,,74d39648e682] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:34:05.764 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 235, operation:EXECUTE, state: RUNNING 2022-12-08 15:34:05.789 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=235, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:34:05.753+08:00, endTime=null} 2022-12-08 15:34:06.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:34:06.153 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:34:06.149674+08:00, lastProcessTime=2022-12-08T15:33:56.148510+08:00 2022-12-08 15:34:06.278 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:34:06.149674+08:00, resultsCount=0 2022-12-08 15:34:06.279 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:34:06.149674+08:00, resultsCount=0 2022-12-08 15:34:06.279 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:34:06.149674+08:00 2022-12-08 15:34:06.453 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:34:06.457 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:34:06.532 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:235, status:SUCCESS 2022-12-08 15:34:06.540 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:235, status:SUCCESS 2022-12-08 15:34:06.701 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:06.705 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:06.817 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:07.768 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:08.062 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:34:09.706 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:09.715 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:09.769 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:09.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:09.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:10.721 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:34:10.863 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:10.864 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:11.447 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:34:11.483 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:12.310 INFO 42 --- [pool-ocp-schedules-6,,8d179648a5c2] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:34:12.310 INFO 42 --- [pool-ocp-schedules-6,,8d179648a5c2] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:34:12.401 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:34:12.716 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:12.721 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:13.332 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:34:13.337 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:34:13.928 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:14.560 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:34:15.722 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:15.727 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:15.737 INFO 42 --- [pool-ocp-schedules-19,,959700c88970] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:34:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:34:16.158 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:34:16.153570+08:00, lastProcessTime=2022-12-08T15:34:06.149674+08:00 2022-12-08 15:34:16.293 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:34:16.153570+08:00, resultsCount=0 2022-12-08 15:34:16.293 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:34:16.153570+08:00, resultsCount=0 2022-12-08 15:34:16.293 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:34:16.153570+08:00 2022-12-08 15:34:16.304 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:16.448 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:34:16.975 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:16.975 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:18.728 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:18.733 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:19.357 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:19.358 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:19.992 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:20.278 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:33:21.0, nextRun=2022-12-08 15:34:20.0, currentDate=Thu Dec 08 15:34:20 CST 2022 2022-12-08 15:34:20.279 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:33:21.0, nextRunTime=2022-12-08 15:34:20.0} 2022-12-08 15:34:20.296 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:34:20.297 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:34:20.297 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:34:21.065 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 236, operation:EXECUTE, state: RUNNING 2022-12-08 15:34:21.127 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=236, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:34:21.046+08:00, endTime=null} 2022-12-08 15:34:21.215 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:30:20.769, end=2022-12-08T15:32:21.141} 2022-12-08 15:34:21.242 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:34:21.484 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:34:21.525 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:21.656 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:34:21.662 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:34:21.733 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:21.741 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:22.349 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:236, status:SUCCESS 2022-12-08 15:34:22.356 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:236, status:SUCCESS 2022-12-08 15:34:22.417 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:22.424 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:34:22.711 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:34:22.977 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:34:23.288 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:23.776 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:34:24.257 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:34:24.740 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:34:24.742 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:24.747 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:25.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:25.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:25.738 INFO 42 --- [pool-ocp-schedules-4,,cd581bf6fbcc] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:34:25.807 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:34:26.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:34:26.153 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:34:26.149917+08:00, lastProcessTime=2022-12-08T15:34:16.153570+08:00 2022-12-08 15:34:26.222 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:33:25.0, nextRun=2022-12-08 15:34:25.0, currentDate=Thu Dec 08 15:34:26 CST 2022 2022-12-08 15:34:26.223 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:33:25.0, nextRunTime=2022-12-08 15:34:25.0} 2022-12-08 15:34:26.256 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:34:26.149917+08:00, resultsCount=0 2022-12-08 15:34:26.256 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:34:26.149917+08:00, resultsCount=0 2022-12-08 15:34:26.257 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:34:26.149917+08:00 2022-12-08 15:34:26.287 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:34:26.288 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:34:26.288 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:34:26.378 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:26.378 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:27.270 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 237, operation:EXECUTE, state: RUNNING 2022-12-08 15:34:27.358 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=237, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:34:27.253+08:00, endTime=null} 2022-12-08 15:34:27.747 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:27.752 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:28.451 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:237, status:SUCCESS 2022-12-08 15:34:28.474 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:237, status:SUCCESS 2022-12-08 15:34:29.125 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:34:29.129 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:34:30.017 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:30.051 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:30.752 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:30.756 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:30.836 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:33:31.0, nextRun=2022-12-08 15:34:30.0, currentDate=Thu Dec 08 15:34:30 CST 2022 2022-12-08 15:34:30.837 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:33:31.0, nextRunTime=2022-12-08 15:34:30.0} 2022-12-08 15:34:30.862 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:34:30.957 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:01.0, nextRun=2022-12-08 15:34:30.0, currentDate=Thu Dec 08 15:34:30 CST 2022 2022-12-08 15:34:30.960 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:34:01.0, nextRunTime=2022-12-08 15:34:30.0} 2022-12-08 15:34:30.979 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:34:30.980 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:34:30.980 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:34:31.502 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 238, operation:EXECUTE, state: RUNNING 2022-12-08 15:34:31.522 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:34:31.583 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:31.584 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=238, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:34:31.488+08:00, endTime=null} 2022-12-08 15:34:31.584 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:31.764 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:34:31.982 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:238, status:SUCCESS 2022-12-08 15:34:31.988 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:238, status:SUCCESS 2022-12-08 15:34:32.361 INFO 42 --- [pool-ocp-schedules-1,,3c65a0520436] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:34:32.362 INFO 42 --- [pool-ocp-schedules-1,,3c65a0520436] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:34:32.455 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:34:33.217 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:33.218 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:33.757 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:33.761 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:34.683 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:34.684 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:34.837 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:34:35.740 INFO 42 --- [pool-ocp-schedules-18,,0c00eeacca46] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:34:36.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:34:36.157 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:34:36.154385+08:00, lastProcessTime=2022-12-08T15:34:26.149917+08:00 2022-12-08 15:34:36.256 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:34:36.154385+08:00, resultsCount=0 2022-12-08 15:34:36.257 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:34:36.154385+08:00, resultsCount=0 2022-12-08 15:34:36.257 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:34:36.154385+08:00 2022-12-08 15:34:36.762 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:36.766 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:36.977 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:34:36.982 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:34:37.778 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:39.434 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:39.606 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:34:39.767 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:39.770 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:40.204 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:40.852 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:34:40.948 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:40.949 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:41.584 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:34:41.642 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:42.501 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:34:42.541 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:42.542 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:42.771 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:42.776 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:44.837 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:34:44.843 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:34:44.891 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:34:45.482 INFO 42 --- [pool-ocp-schedules-7,,80d964e55246] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:34:45.523 INFO 42 --- [pool-ocp-schedules-7,,80d964e55246] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:34:45.667 INFO 42 --- [pool-ocp-schedules-6,,5de1bb763a5e] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:34:45.724 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:45.741 INFO 42 --- [pool-ocp-schedules-11,,da5c1d86b256] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:34:45.776 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:45.782 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:45.858 INFO 42 --- [pool-ocp-schedules-13,,ea15c9a59610] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:34:46.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:34:46.152 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:34:46.149262+08:00, lastProcessTime=2022-12-08T15:34:36.154385+08:00 2022-12-08 15:34:46.281 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:34:46.149262+08:00, resultsCount=0 2022-12-08 15:34:46.282 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:34:46.149262+08:00, resultsCount=0 2022-12-08 15:34:46.282 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:34:46.149262+08:00 2022-12-08 15:34:47.168 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:47.434 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:34:47.905 INFO 42 --- [pool-ocp-schedules-10,,bbaf20f15693] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:34:47.905 INFO 42 --- [pool-ocp-schedules-5,,f445714528c3] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:34:48.449 INFO 42 --- [pool-ocp-schedules-20,,cfb1aeec646e] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:34:48.710 INFO 42 --- [pool-ocp-schedules-3,,75d044c2fc99] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:34:48.711 INFO 42 --- [pool-ocp-schedules-3,,75d044c2fc99] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:34:48.711 INFO 42 --- [pool-ocp-schedules-3,,75d044c2fc99] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:34:48.783 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:48.787 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:48.827 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:48.827 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:50.260 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:50.261 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:50.340 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:51.611 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:34:51.690 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:34:51.788 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:51.794 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:52.442 INFO 42 --- [pool-ocp-schedules-19,,b7e94b2633a0] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:34:52.443 INFO 42 --- [pool-ocp-schedules-19,,b7e94b2633a0] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:34:52.652 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:34:52.665 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:34:52.670 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:34:52.764 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:34:53.015 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:34:53.100 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:31:22+08:00, updateTime=2022-12-08T15:34:22+08:00, expireTime=null, isLeader=false} 2022-12-08 15:34:53.108 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:34:53.322 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:54.335 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:34:54.794 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:54.800 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:55.034 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:34:55.336 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:34:55.436 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:34:55.742 INFO 42 --- [pool-ocp-schedules-3,,1acbe86b92b9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:34:55.985 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:34:56.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:34:56.150 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:34:56.143204+08:00, lastProcessTime=2022-12-08T15:34:46.149262+08:00 2022-12-08 15:34:56.251 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:34:56.143204+08:00, resultsCount=0 2022-12-08 15:34:56.251 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:34:56.143204+08:00, resultsCount=0 2022-12-08 15:34:56.251 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:34:56.143204+08:00 2022-12-08 15:34:56.399 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:56.400 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:57.801 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:34:57.807 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:34:58.333 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:34:58.335 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:34:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,8c38b2fefa45] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:34:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,8c38b2fefa45] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:35:00.118 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:02.0, nextRun=2022-12-08 15:35:00.0, currentDate=Thu Dec 08 15:35:00 CST 2022 2022-12-08 15:35:00.119 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 15:30:02.0, nextRunTime=2022-12-08 15:35:00.0} 2022-12-08 15:35:00.137 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 15:35:00.138 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:00.138 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:00.382 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:00.457 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:02.0, nextRun=2022-12-08 15:35:00.0, currentDate=Thu Dec 08 15:35:00 CST 2022 2022-12-08 15:35:00.458 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:30:02.0, nextRunTime=2022-12-08 15:35:00.0} 2022-12-08 15:35:00.494 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 15:35:00.494 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 15:35:00.808 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:00.812 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:00.827 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:01.0, nextRun=2022-12-08 15:35:00.0, currentDate=Thu Dec 08 15:35:00 CST 2022 2022-12-08 15:35:00.827 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:34:01.0, nextRunTime=2022-12-08 15:35:00.0} 2022-12-08 15:35:00.844 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:35:00.844 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:00.844 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:00.862 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:35:00.867 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:35:01.224 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:01.0, nextRun=2022-12-08 15:35:00.0, currentDate=Thu Dec 08 15:35:01 CST 2022 2022-12-08 15:35:01.225 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:34:01.0, nextRunTime=2022-12-08 15:35:00.0} 2022-12-08 15:35:01.247 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:35:01.248 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:01.248 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:01.281 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 240, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:01.421 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:01.0, nextRun=2022-12-08 15:35:00.0, currentDate=Thu Dec 08 15:35:01 CST 2022 2022-12-08 15:35:01.422 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:34:01.0, nextRunTime=2022-12-08 15:35:00.0} 2022-12-08 15:35:01.426 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=240, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:35:01.268+08:00, endTime=null} 2022-12-08 15:35:01.445 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:35:01.446 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:01.446 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:01.483 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:01.502 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 239, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:01.586 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:31.0, nextRun=2022-12-08 15:35:00.0, currentDate=Thu Dec 08 15:35:01 CST 2022 2022-12-08 15:35:01.586 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:34:31.0, nextRunTime=2022-12-08 15:35:00.0} 2022-12-08 15:35:01.602 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:35:01.603 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:01.603 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:01.623 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=239, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T15:35:01.490+08:00, endTime=null} 2022-12-08 15:35:01.665 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:03.0, nextRun=2022-12-08 15:35:00.0, currentDate=Thu Dec 08 15:35:01 CST 2022 2022-12-08 15:35:01.666 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:30:03.0, nextRunTime=2022-12-08 15:35:00.0} 2022-12-08 15:35:01.682 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 15:35:01.683 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:01.683 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:01.689 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:35:02.018 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:02.029 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:01.0, nextRun=2022-12-08 15:35:00.0, currentDate=Thu Dec 08 15:35:02 CST 2022 2022-12-08 15:35:02.029 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:34:01.0, nextRunTime=2022-12-08 15:35:00.0} 2022-12-08 15:35:02.051 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:35:02.052 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:02.052 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:02.253 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:239, status:SUCCESS 2022-12-08 15:35:02.260 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:239, status:SUCCESS 2022-12-08 15:35:02.359 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:240, status:SUCCESS 2022-12-08 15:35:02.365 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:240, status:SUCCESS 2022-12-08 15:35:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,d9f8a9774ee8] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484960, interval=60 2022-12-08 15:35:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,d9f8a9774ee8] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484902, count=0, elapsed=1668814417733 2022-12-08 15:35:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,0dcbbca8fe50] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670484960, interval=60 2022-12-08 15:35:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,0dcbbca8fe50] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484902, count=0, elapsed=1668814417738 2022-12-08 15:35:02.703 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:35:02.715 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 241, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:02.891 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=241, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:35:02.695+08:00, endTime=null} 2022-12-08 15:35:02.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:03.018 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 242, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:03.176 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=242, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:35:02.997+08:00, endTime=null} 2022-12-08 15:35:03.276 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 243, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:03.354 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:35:03.375 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=243, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:35:03.261+08:00, endTime=null} 2022-12-08 15:35:03.465 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 244, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:03.584 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=244, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T15:35:03.450+08:00, endTime=null} 2022-12-08 15:35:03.626 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,193fb93e8f2b] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=243, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=243, task_operation=execute, latest_execution_start_time=2022-12-08T15:35:03.260+08:00, sub_task_instance_id=243}, listMap={}}, executor=192.168.28.62 2022-12-08 15:35:03.627 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,193fb93e8f2b] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:35:03.642 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,193fb93e8f2b] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:35:03.652 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 245, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:03.722 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,193fb93e8f2b] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 243, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:35:03.724 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=245, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:35:03.639+08:00, endTime=null} 2022-12-08 15:35:03.813 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:03.817 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:04.132 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:241, status:SUCCESS 2022-12-08 15:35:04.167 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:241, status:SUCCESS 2022-12-08 15:35:04.432 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:242, status:SUCCESS 2022-12-08 15:35:04.439 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:242, status:SUCCESS 2022-12-08 15:35:04.553 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:243, status:SUCCESS 2022-12-08 15:35:04.559 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:243, status:SUCCESS 2022-12-08 15:35:04.628 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:04.628 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:04.658 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:244, status:SUCCESS 2022-12-08 15:35:04.664 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:244, status:SUCCESS 2022-12-08 15:35:05.010 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:245, status:SUCCESS 2022-12-08 15:35:05.017 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:245, status:SUCCESS 2022-12-08 15:35:05.533 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:35:05.743 INFO 42 --- [pool-ocp-schedules-4,,0ad84d72ca98] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:35:06.070 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:06.071 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:06.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:35:06.150 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:35:06.146696+08:00, lastProcessTime=2022-12-08T15:34:56.143204+08:00 2022-12-08 15:35:06.261 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:35:06.146696+08:00, resultsCount=0 2022-12-08 15:35:06.262 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:35:06.146696+08:00, resultsCount=0 2022-12-08 15:35:06.262 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:35:06.146696+08:00 2022-12-08 15:35:06.460 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:05.0, nextRun=2022-12-08 15:35:05.0, currentDate=Thu Dec 08 15:35:06 CST 2022 2022-12-08 15:35:06.462 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:34:05.0, nextRunTime=2022-12-08 15:35:05.0} 2022-12-08 15:35:06.482 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:35:06.482 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:06.483 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:06.818 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:06.818 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 246, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:06.822 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:06.884 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=246, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:35:06.807+08:00, endTime=null} 2022-12-08 15:35:08.086 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:246, status:SUCCESS 2022-12-08 15:35:08.093 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:246, status:SUCCESS 2022-12-08 15:35:08.682 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:35:08.687 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:35:09.125 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:09.823 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:09.827 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:10.800 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:10.931 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:11.192 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:35:11.381 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:35:12.019 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:35:12.217 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:12.354 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:12.355 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:12.523 INFO 42 --- [pool-ocp-schedules-20,,148535d31b34] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:35:12.524 INFO 42 --- [pool-ocp-schedules-20,,148535d31b34] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:35:12.828 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:12.833 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:12.879 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:35:14.331 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:14.332 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:15.745 INFO 42 --- [pool-ocp-schedules-18,,11a0e6b15e56] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:35:15.756 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:35:15.834 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:15.838 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:35:16.148 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:35:16.144978+08:00, lastProcessTime=2022-12-08T15:35:06.146696+08:00 2022-12-08 15:35:16.290 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:35:16.144978+08:00, resultsCount=0 2022-12-08 15:35:16.290 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:35:16.144978+08:00, resultsCount=0 2022-12-08 15:35:16.290 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:35:16.144978+08:00 2022-12-08 15:35:16.649 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:35:16.655 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:35:17.435 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:18.647 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:18.839 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:18.844 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:18.874 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:35:20.534 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:20.535 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:21.164 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:20.0, nextRun=2022-12-08 15:35:20.0, currentDate=Thu Dec 08 15:35:21 CST 2022 2022-12-08 15:35:21.165 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:34:20.0, nextRunTime=2022-12-08 15:35:20.0} 2022-12-08 15:35:21.183 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:35:21.184 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:21.184 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:21.192 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:21.813 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:21.814 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:21.845 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:21.850 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:22.153 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 247, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:22.218 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:35:22.260 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=247, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:35:22.136+08:00, endTime=null} 2022-12-08 15:35:22.336 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:22.814 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:35:23.107 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:35:23.376 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:35:23.743 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:247, status:SUCCESS 2022-12-08 15:35:23.750 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:247, status:SUCCESS 2022-12-08 15:35:24.089 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:35:24.095 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:35:24.402 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:35:24.851 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:24.856 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:24.940 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:25.246 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:26.0, nextRun=2022-12-08 15:35:25.0, currentDate=Thu Dec 08 15:35:25 CST 2022 2022-12-08 15:35:25.247 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:34:26.0, nextRunTime=2022-12-08 15:35:25.0} 2022-12-08 15:35:25.292 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:35:25.292 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:25.293 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:25.746 INFO 42 --- [pool-ocp-schedules-12,,29f154ac1701] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:35:25.792 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:35:26.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:35:26.176 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:35:26.171433+08:00, lastProcessTime=2022-12-08T15:35:16.144978+08:00 2022-12-08 15:35:26.300 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:35:26.171433+08:00, resultsCount=0 2022-12-08 15:35:26.300 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:35:26.171433+08:00, resultsCount=0 2022-12-08 15:35:26.301 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:35:26.171433+08:00 2022-12-08 15:35:26.319 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:35:26.416 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 248, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:26.697 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=248, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:35:26.400+08:00, endTime=null} 2022-12-08 15:35:26.849 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:27.374 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:35:27.680 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:248, status:SUCCESS 2022-12-08 15:35:27.687 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:248, status:SUCCESS 2022-12-08 15:35:27.857 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:27.862 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:28.022 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:28.022 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:30.331 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:30.331 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:30.862 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:30.867 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:31.225 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:31.0, nextRun=2022-12-08 15:35:30.0, currentDate=Thu Dec 08 15:35:31 CST 2022 2022-12-08 15:35:31.226 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:34:31.0, nextRunTime=2022-12-08 15:35:30.0} 2022-12-08 15:35:31.229 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:31.247 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:35:31.340 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:02.0, nextRun=2022-12-08 15:35:30.0, currentDate=Thu Dec 08 15:35:31 CST 2022 2022-12-08 15:35:31.341 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:35:02.0, nextRunTime=2022-12-08 15:35:30.0} 2022-12-08 15:35:31.356 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:35:31.357 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:35:31.357 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:35:31.825 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 249, operation:EXECUTE, state: RUNNING 2022-12-08 15:35:31.952 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=249, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:35:31.813+08:00, endTime=null} 2022-12-08 15:35:32.314 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:35:32.530 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:32.780 INFO 42 --- [pool-ocp-schedules-10,,83118ec9f943] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:35:32.780 INFO 42 --- [pool-ocp-schedules-10,,83118ec9f943] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:35:32.830 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:35:32.836 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:35:33.207 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:249, status:SUCCESS 2022-12-08 15:35:33.213 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:249, status:SUCCESS 2022-12-08 15:35:33.376 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:35:33.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:33.867 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:33.872 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:34.210 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:34.472 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:35:35.747 INFO 42 --- [pool-ocp-schedules-18,,563e93d2a53a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:35:36.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:35:36.144 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:35:36.153 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:35:36.149596+08:00, lastProcessTime=2022-12-08T15:35:26.171433+08:00 2022-12-08 15:35:36.271 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:35:36.149596+08:00, resultsCount=0 2022-12-08 15:35:36.272 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:35:36.149596+08:00, resultsCount=0 2022-12-08 15:35:36.272 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:35:36.149596+08:00 2022-12-08 15:35:36.704 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:36.704 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:36.873 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:36.878 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:37.273 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:37.274 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:39.775 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:35:39.781 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:35:39.879 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:39.883 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:40.190 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:35:40.207 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=17ms, period=120000ms 2022-12-08 15:35:40.527 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:41.261 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:41.479 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:35:42.524 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:35:42.845 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:42.859 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:42.883 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:42.888 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:43.055 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:35:43.535 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:35:43.782 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:43.783 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:45.456 INFO 42 --- [pool-ocp-schedules-17,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 15:35:45.471 INFO 42 --- [pool-ocp-schedules-20,,10355fbbbd81] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:35:45.518 INFO 42 --- [pool-ocp-schedules-20,,10355fbbbd81] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:35:45.669 INFO 42 --- [pool-ocp-schedules-13,,abc14e600d0d] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:35:45.721 INFO 42 --- [pool-ocp-schedules-18,,34f63133d725] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:35:45.722 INFO 42 --- [pool-ocp-schedules-18,,34f63133d725] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:35:45.749 INFO 42 --- [pool-ocp-schedules-14,,c3e0e1ace0fb] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:35:45.780 INFO 42 --- [pool-ocp-schedules-19,,a53a159f59a1] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 15:35:45.864 INFO 42 --- [pool-ocp-schedules-1,,5da809339f8c] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:35:45.889 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:45.893 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:46.027 INFO 42 --- [pool-ocp-schedules-10,,ec2726dfca2a] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 15:35:46.053 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:46.053 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:46.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:35:46.161 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:35:46.157080+08:00, lastProcessTime=2022-12-08T15:35:36.149596+08:00 2022-12-08 15:35:46.201 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:35:46.269 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:35:46.157080+08:00, resultsCount=0 2022-12-08 15:35:46.270 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:35:46.157080+08:00, resultsCount=0 2022-12-08 15:35:46.270 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:35:46.157080+08:00 2022-12-08 15:35:47.967 INFO 42 --- [pool-ocp-schedules-1,,bda37a6c497a] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:35:48.057 INFO 42 --- [pool-ocp-schedules-11,,676d0c99e7fa] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:35:48.376 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:35:48.382 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:35:48.640 INFO 42 --- [pool-ocp-schedules-19,,f405d0652008] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:35:48.889 INFO 42 --- [pool-ocp-schedules-18,,0aedef16c678] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:35:48.890 INFO 42 --- [pool-ocp-schedules-18,,0aedef16c678] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:35:48.890 INFO 42 --- [pool-ocp-schedules-18,,0aedef16c678] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:35:48.894 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:48.902 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:49.352 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:50.003 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:50.524 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:35:51.394 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:51.903 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:51.908 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:52.514 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:52.514 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:52.860 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:35:52.893 INFO 42 --- [pool-ocp-schedules-16,,f6fe9411be02] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:35:52.894 INFO 42 --- [pool-ocp-schedules-16,,f6fe9411be02] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:35:53.002 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:35:53.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:53.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:35:53.178 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:31:52+08:00, updateTime=2022-12-08T15:35:22+08:00, expireTime=null, isLeader=false} 2022-12-08 15:35:53.186 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:35:53.300 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:35:53.603 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:35:53.771 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:35:54.450 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:35:54.909 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:54.915 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:55.750 INFO 42 --- [pool-ocp-schedules-12,,d60b5bbed44a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:35:56.054 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:35:56.062 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:35:56.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:35:56.154 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:35:56.151476+08:00, lastProcessTime=2022-12-08T15:35:46.157080+08:00 2022-12-08 15:35:56.259 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:35:56.151476+08:00, resultsCount=0 2022-12-08 15:35:56.259 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:35:56.151476+08:00, resultsCount=0 2022-12-08 15:35:56.260 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:35:56.151476+08:00 2022-12-08 15:35:56.345 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:35:56.412 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:56.532 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:35:57.916 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:35:57.921 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:35:58.647 INFO 42 --- [pool-prometheus-cache-monitor1,,3a01d6977d3a] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:35:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,3a01d6977d3a] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:35:59.018 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:35:59.469 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:35:59.787 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:35:59.787 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:00.000 INFO 42 --- [pool-ocp-schedules-2,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:36:00.922 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:00.926 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:01.288 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:34:01.0, nextRun=2022-12-08 15:36:00.0, currentDate=Thu Dec 08 15:36:01 CST 2022 2022-12-08 15:36:01.288 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:34:01.0, nextRunTime=2022-12-08 15:36:00.0} 2022-12-08 15:36:01.309 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:36:01.431 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:01.0, nextRun=2022-12-08 15:36:00.0, currentDate=Thu Dec 08 15:36:01 CST 2022 2022-12-08 15:36:01.431 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:35:01.0, nextRunTime=2022-12-08 15:36:00.0} 2022-12-08 15:36:01.448 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:36:01.449 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:36:01.449 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:36:01.551 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:01.0, nextRun=2022-12-08 15:36:00.0, currentDate=Thu Dec 08 15:36:01 CST 2022 2022-12-08 15:36:01.551 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:35:01.0, nextRunTime=2022-12-08 15:36:00.0} 2022-12-08 15:36:01.575 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:36:01.576 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:36:01.576 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:36:01.651 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:01.0, nextRun=2022-12-08 15:36:00.0, currentDate=Thu Dec 08 15:36:01 CST 2022 2022-12-08 15:36:01.651 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:35:01.0, nextRunTime=2022-12-08 15:36:00.0} 2022-12-08 15:36:01.689 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:36:01.690 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:36:01.690 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:36:01.753 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:31.0, nextRun=2022-12-08 15:36:00.0, currentDate=Thu Dec 08 15:36:01 CST 2022 2022-12-08 15:36:01.754 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:35:31.0, nextRunTime=2022-12-08 15:36:00.0} 2022-12-08 15:36:01.770 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:36:01.771 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:36:01.771 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:36:01.824 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:01.849 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:02.0, nextRun=2022-12-08 15:36:00.0, currentDate=Thu Dec 08 15:36:01 CST 2022 2022-12-08 15:36:01.850 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:35:02.0, nextRunTime=2022-12-08 15:36:00.0} 2022-12-08 15:36:01.866 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:36:01.866 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:36:01.866 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:36:02.226 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:02.226 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:02.391 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 250, operation:EXECUTE, state: RUNNING 2022-12-08 15:36:02.441 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=250, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:36:02.377+08:00, endTime=null} 2022-12-08 15:36:02.513 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 251, operation:EXECUTE, state: RUNNING 2022-12-08 15:36:02.629 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=251, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:36:02.501+08:00, endTime=null} 2022-12-08 15:36:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,164a5e3e76de] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485020, interval=60 2022-12-08 15:36:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,164a5e3e76de] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484962, count=0, elapsed=1668814477673 2022-12-08 15:36:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,0b359cb6b29c] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485020, interval=60 2022-12-08 15:36:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,0b359cb6b29c] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670484962, count=0, elapsed=1668814477678 2022-12-08 15:36:02.713 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 252, operation:EXECUTE, state: RUNNING 2022-12-08 15:36:02.776 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=252, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:36:02.699+08:00, endTime=null} 2022-12-08 15:36:02.849 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 253, operation:EXECUTE, state: RUNNING 2022-12-08 15:36:02.927 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=253, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:36:02.836+08:00, endTime=null} 2022-12-08 15:36:03.002 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:36:03.013 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,fca01cc50dc2] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=252, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=252, task_operation=execute, latest_execution_start_time=2022-12-08T15:36:02.698+08:00, sub_task_instance_id=252}, listMap={}}, executor=192.168.28.62 2022-12-08 15:36:03.038 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 254, operation:EXECUTE, state: RUNNING 2022-12-08 15:36:03.229 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=254, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:36:03.017+08:00, endTime=null} 2022-12-08 15:36:03.237 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,fca01cc50dc2] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 252, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:36:03.366 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:03.865 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:36:03.927 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:04.199 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:04.684 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:250, status:SUCCESS 2022-12-08 15:36:04.690 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:250, status:SUCCESS 2022-12-08 15:36:05.195 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:251, status:SUCCESS 2022-12-08 15:36:05.205 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:251, status:SUCCESS 2022-12-08 15:36:05.231 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:36:05.241 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:36:05.378 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:06.0, nextRun=2022-12-08 15:36:05.0, currentDate=Thu Dec 08 15:36:05 CST 2022 2022-12-08 15:36:05.379 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:35:06.0, nextRunTime=2022-12-08 15:36:05.0} 2022-12-08 15:36:05.386 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:05.409 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:36:05.409 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:36:05.410 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:36:05.420 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:252, status:SUCCESS 2022-12-08 15:36:05.428 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:252, status:SUCCESS 2022-12-08 15:36:05.464 INFO 42 --- [pool-ocp-schedules-2,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:36:05.623 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:253, status:SUCCESS 2022-12-08 15:36:05.632 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:253, status:SUCCESS 2022-12-08 15:36:05.743 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:254, status:SUCCESS 2022-12-08 15:36:05.749 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:254, status:SUCCESS 2022-12-08 15:36:05.752 INFO 42 --- [pool-ocp-schedules-17,,1507db657a31] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:36:05.878 INFO 42 --- [pool-ocp-schedules-2,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:36:06.070 INFO 42 --- [pool-ocp-schedules-2,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:36:06.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:36:06.160 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:36:06.155020+08:00, lastProcessTime=2022-12-08T15:35:56.151476+08:00 2022-12-08 15:36:06.336 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:36:06.155020+08:00, resultsCount=0 2022-12-08 15:36:06.336 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:36:06.155020+08:00, resultsCount=0 2022-12-08 15:36:06.337 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:36:06.155020+08:00 2022-12-08 15:36:06.421 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 255, operation:EXECUTE, state: RUNNING 2022-12-08 15:36:06.427 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:36:06.460 INFO 42 --- [pool-ocp-schedules-2,,] o.s.boot.SpringApplication : Started application in 6.415 seconds (JVM running for 963.306) 2022-12-08 15:36:06.498 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:36:06.529 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=255, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:36:06.353+08:00, endTime=null} 2022-12-08 15:36:07.171 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:255, status:SUCCESS 2022-12-08 15:36:07.177 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:255, status:SUCCESS 2022-12-08 15:36:07.200 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:07.204 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:07.995 INFO 42 --- [pool-ocp-schedules-2,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:36:07.995+08:00 2022-12-08 15:36:08.611 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:08.611 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:09.162 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:09.162 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:10.205 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:10.214 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:11.711 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:36:11.768 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:36:11.773 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:36:11.857 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:12.024 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:12.502 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:13.053 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:36:13.182 INFO 42 --- [pool-ocp-schedules-2,,0ea93af9b357] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:36:13.183 INFO 42 --- [pool-ocp-schedules-2,,0ea93af9b357] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:36:13.215 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:13.220 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:13.222 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:36:13.449 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:14.500 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:36:15.285 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:15.285 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:15.752 INFO 42 --- [pool-ocp-schedules-19,,25492db85aff] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:36:15.906 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:15.907 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:16.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:36:16.151 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:36:16.148697+08:00, lastProcessTime=2022-12-08T15:36:06.155020+08:00 2022-12-08 15:36:16.221 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:16.225 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:16.278 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:36:16.148697+08:00, resultsCount=0 2022-12-08 15:36:16.279 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:36:16.148697+08:00, resultsCount=0 2022-12-08 15:36:16.279 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:36:16.148697+08:00 2022-12-08 15:36:16.709 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:36:18.326 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:36:18.334 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:36:18.685 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T15:30:18.498, end=2022-12-08T15:35:18.65} 2022-12-08 15:36:18.716 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:36:18.765 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T15:30:18.498, end=2022-12-08T15:35:18.663} 2022-12-08 15:36:18.798 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:36:18.988 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:19.226 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:19.231 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:20.997 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:21.0, nextRun=2022-12-08 15:36:20.0, currentDate=Thu Dec 08 15:36:20 CST 2022 2022-12-08 15:36:20.998 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:35:21.0, nextRunTime=2022-12-08 15:36:20.0} 2022-12-08 15:36:21.023 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:36:21.023 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:36:21.024 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:36:21.536 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:32:21.141, end=2022-12-08T15:34:21.476} 2022-12-08 15:36:21.549 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:36:21.770 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 256, operation:EXECUTE, state: RUNNING 2022-12-08 15:36:21.867 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=256, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:36:21.755+08:00, endTime=null} 2022-12-08 15:36:22.025 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:22.232 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:22.238 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:23.301 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:36:23.438 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:36:23.604 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:23.668 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:256, status:SUCCESS 2022-12-08 15:36:23.675 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:256, status:SUCCESS 2022-12-08 15:36:23.758 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:36:24.585 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:36:24.816 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:36:25.239 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:25.244 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:25.573 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:25.0, nextRun=2022-12-08 15:36:25.0, currentDate=Thu Dec 08 15:36:25 CST 2022 2022-12-08 15:36:25.574 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:35:25.0, nextRunTime=2022-12-08 15:36:25.0} 2022-12-08 15:36:25.623 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:36:25.624 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:36:25.624 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:36:25.754 INFO 42 --- [pool-ocp-schedules-8,,04e49d04ea9a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:36:25.988 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 257, operation:EXECUTE, state: RUNNING 2022-12-08 15:36:26.040 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=257, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:36:25.975+08:00, endTime=null} 2022-12-08 15:36:26.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:36:26.154 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:36:26.150453+08:00, lastProcessTime=2022-12-08T15:36:16.148697+08:00 2022-12-08 15:36:26.264 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:36:26.150453+08:00, resultsCount=0 2022-12-08 15:36:26.264 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:36:26.150453+08:00, resultsCount=0 2022-12-08 15:36:26.265 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:36:26.150453+08:00 2022-12-08 15:36:26.736 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:36:26.768 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:36:28.191 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:257, status:SUCCESS 2022-12-08 15:36:28.197 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:257, status:SUCCESS 2022-12-08 15:36:28.245 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:28.251 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:28.986 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:36:30.191 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:31.0, nextRun=2022-12-08 15:36:30.0, currentDate=Thu Dec 08 15:36:30 CST 2022 2022-12-08 15:36:30.192 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:35:31.0, nextRunTime=2022-12-08 15:36:30.0} 2022-12-08 15:36:30.213 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:36:30.331 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:02.0, nextRun=2022-12-08 15:36:30.0, currentDate=Thu Dec 08 15:36:30 CST 2022 2022-12-08 15:36:30.332 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:36:02.0, nextRunTime=2022-12-08 15:36:30.0} 2022-12-08 15:36:30.348 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:36:30.348 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:36:30.349 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:36:31.170 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 258, operation:EXECUTE, state: RUNNING 2022-12-08 15:36:31.252 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:31.257 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:31.544 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=258, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:36:31.157+08:00, endTime=null} 2022-12-08 15:36:32.106 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:32.388 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:258, status:SUCCESS 2022-12-08 15:36:32.396 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:258, status:SUCCESS 2022-12-08 15:36:33.289 INFO 42 --- [pool-ocp-schedules-16,,edc903ec1feb] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:36:33.290 INFO 42 --- [pool-ocp-schedules-16,,edc903ec1feb] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:36:33.526 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:36:33.823 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:34.258 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:34.262 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:34.584 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:36:34.589 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:36:34.765 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:34.816 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:36:35.075 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:35.314 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:36:35.755 INFO 42 --- [pool-ocp-schedules-5,,b8acde856c84] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:36:36.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:36:36.151 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:36:36.147512+08:00, lastProcessTime=2022-12-08T15:36:26.150453+08:00 2022-12-08 15:36:36.256 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:36:36.147512+08:00, resultsCount=0 2022-12-08 15:36:36.256 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:36:36.147512+08:00, resultsCount=0 2022-12-08 15:36:36.256 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:36:36.147512+08:00 2022-12-08 15:36:36.992 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:36:37.264 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:37.271 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:37.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:37.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:38.303 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:38.303 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:40.273 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:40.282 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:40.619 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:36:40.625 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:36:41.215 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:41.472 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:41.812 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:36:42.181 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:36:42.259 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:43.283 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:43.288 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:43.823 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:36:44.221 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:44.451 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:44.452 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:44.580 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:44.581 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:45.154 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:36:45.471 INFO 42 --- [pool-ocp-schedules-6,,21b10df02fba] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:36:45.509 INFO 42 --- [pool-ocp-schedules-6,,21b10df02fba] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:36:45.670 INFO 42 --- [pool-ocp-schedules-19,,56dfdd780c20] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:36:45.756 INFO 42 --- [pool-ocp-schedules-7,,64382bb10312] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:36:45.869 INFO 42 --- [pool-ocp-schedules-2,,ac28d218ccce] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:36:46.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:36:46.152 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:36:46.146551+08:00, lastProcessTime=2022-12-08T15:36:36.147512+08:00 2022-12-08 15:36:46.275 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:36:46.146551+08:00, resultsCount=0 2022-12-08 15:36:46.276 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:36:46.146551+08:00, resultsCount=0 2022-12-08 15:36:46.276 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:36:46.146551+08:00 2022-12-08 15:36:46.289 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:46.293 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:47.057 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:36:47.245 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:36:47.250 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:36:47.584 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:47.698 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:47.993 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:36:48.089 INFO 42 --- [pool-ocp-schedules-6,,82e9362ee97f] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:36:48.234 INFO 42 --- [pool-ocp-schedules-7,,318584813eb5] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:36:48.867 INFO 42 --- [pool-ocp-schedules-10,,64a2bf6d6a4d] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:36:49.219 INFO 42 --- [pool-ocp-schedules-17,,d3bef3ce0ab4] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:36:49.220 INFO 42 --- [pool-ocp-schedules-17,,d3bef3ce0ab4] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:36:49.220 INFO 42 --- [pool-ocp-schedules-17,,d3bef3ce0ab4] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:36:49.294 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:49.301 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:50.707 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:50.708 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:50.912 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:50.913 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:52.302 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:52.307 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:52.329 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:53.400 INFO 42 --- [pool-ocp-schedules-16,,f5b0e3eecfbf] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:36:53.401 INFO 42 --- [pool-ocp-schedules-16,,f5b0e3eecfbf] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:36:53.439 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:36:53.448 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:36:53.454 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:36:53.756 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:53.822 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:36:53.952 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:36:54.174 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:36:54.280 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:36:54.586 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:36:54.927 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:36:55.307 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:55.310 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:36:55.312 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:55.758 INFO 42 --- [pool-ocp-schedules-16,,9e79d121a518] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:36:56.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:36:56.159 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:36:56.156262+08:00, lastProcessTime=2022-12-08T15:36:46.146551+08:00 2022-12-08 15:36:56.274 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:36:56.156262+08:00, resultsCount=0 2022-12-08 15:36:56.275 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:36:56.156262+08:00, resultsCount=0 2022-12-08 15:36:56.275 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:36:56.156262+08:00 2022-12-08 15:36:56.925 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:56.925 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:57.224 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:36:57.259 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:36:57.445 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:36:57.445 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:36:58.313 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:36:58.321 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:36:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,f698279e81ba] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:36:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,f698279e81ba] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:36:59.900 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:36:59.905 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:37:00.242 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:00.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:01.0, nextRun=2022-12-08 15:37:00.0, currentDate=Thu Dec 08 15:37:00 CST 2022 2022-12-08 15:37:00.245 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:36:01.0, nextRunTime=2022-12-08 15:37:00.0} 2022-12-08 15:37:00.269 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:37:00.270 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:37:00.271 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:37:00.513 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:00.955 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:02.0, nextRun=2022-12-08 15:37:00.0, currentDate=Thu Dec 08 15:37:00 CST 2022 2022-12-08 15:37:00.956 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:36:02.0, nextRunTime=2022-12-08 15:37:00.0} 2022-12-08 15:37:00.982 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:37:00.983 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:37:00.983 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:37:01.011 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 259, operation:EXECUTE, state: RUNNING 2022-12-08 15:37:01.097 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:37:01.279 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:02.0, nextRun=2022-12-08 15:37:00.0, currentDate=Thu Dec 08 15:37:01 CST 2022 2022-12-08 15:37:01.280 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:36:02.0, nextRunTime=2022-12-08 15:37:00.0} 2022-12-08 15:37:01.283 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=259, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:37:00.997+08:00, endTime=null} 2022-12-08 15:37:01.308 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:37:01.309 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:37:01.309 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:37:01.321 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:01.326 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:01.544 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:30.0, nextRun=2022-12-08 15:37:00.0, currentDate=Thu Dec 08 15:37:01 CST 2022 2022-12-08 15:37:01.545 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:36:30.0, nextRunTime=2022-12-08 15:37:00.0} 2022-12-08 15:37:01.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:37:01.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:37:01.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:37:01.680 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:02.0, nextRun=2022-12-08 15:37:00.0, currentDate=Thu Dec 08 15:37:01 CST 2022 2022-12-08 15:37:01.681 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:36:02.0, nextRunTime=2022-12-08 15:37:00.0} 2022-12-08 15:37:01.697 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:37:01.697 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:37:01.697 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:37:02.369 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 260, operation:EXECUTE, state: RUNNING 2022-12-08 15:37:02.404 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=260, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:37:02.352+08:00, endTime=null} 2022-12-08 15:37:02.409 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:02.490 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 261, operation:EXECUTE, state: RUNNING 2022-12-08 15:37:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,b7ab46716e22] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485080, interval=60 2022-12-08 15:37:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,b7ab46716e22] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485022, count=0, elapsed=1668814537613 2022-12-08 15:37:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,3f7feb0187a0] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485080, interval=60 2022-12-08 15:37:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,3f7feb0187a0] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485022, count=0, elapsed=1668814537618 2022-12-08 15:37:02.782 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=261, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:37:02.478+08:00, endTime=null} 2022-12-08 15:37:02.859 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 262, operation:EXECUTE, state: RUNNING 2022-12-08 15:37:02.961 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:259, status:SUCCESS 2022-12-08 15:37:02.968 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=262, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:37:02.842+08:00, endTime=null} 2022-12-08 15:37:02.979 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:259, status:SUCCESS 2022-12-08 15:37:03.096 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 263, operation:EXECUTE, state: RUNNING 2022-12-08 15:37:03.204 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=263, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:37:03.079+08:00, endTime=null} 2022-12-08 15:37:03.286 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,e98163913781] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=262, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=262, task_operation=execute, latest_execution_start_time=2022-12-08T15:37:02.840+08:00, sub_task_instance_id=262}, listMap={}}, executor=192.168.28.62 2022-12-08 15:37:03.287 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,e98163913781] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:37:03.293 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:260, status:SUCCESS 2022-12-08 15:37:03.302 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,e98163913781] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:37:03.302 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:260, status:SUCCESS 2022-12-08 15:37:03.318 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:03.318 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:03.573 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,e98163913781] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 262, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:37:03.700 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:261, status:SUCCESS 2022-12-08 15:37:03.709 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:261, status:SUCCESS 2022-12-08 15:37:03.964 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:03.964 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:04.085 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:37:04.255 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:262, status:SUCCESS 2022-12-08 15:37:04.261 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:262, status:SUCCESS 2022-12-08 15:37:04.327 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:04.331 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:04.432 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:04.792 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:263, status:SUCCESS 2022-12-08 15:37:04.799 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:263, status:SUCCESS 2022-12-08 15:37:05.224 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:05.0, nextRun=2022-12-08 15:37:05.0, currentDate=Thu Dec 08 15:37:05 CST 2022 2022-12-08 15:37:05.224 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:36:05.0, nextRunTime=2022-12-08 15:37:05.0} 2022-12-08 15:37:05.243 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:37:05.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:37:05.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:37:05.376 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:37:05.759 INFO 42 --- [pool-ocp-schedules-19,,d4d2861fa324] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:37:06.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:37:06.150 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:37:06.147052+08:00, lastProcessTime=2022-12-08T15:36:56.156262+08:00 2022-12-08 15:37:06.280 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:37:06.147052+08:00, resultsCount=0 2022-12-08 15:37:06.280 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:37:06.147052+08:00, resultsCount=0 2022-12-08 15:37:06.281 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:37:06.147052+08:00 2022-12-08 15:37:06.327 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 264, operation:EXECUTE, state: RUNNING 2022-12-08 15:37:06.433 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=264, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:37:06.314+08:00, endTime=null} 2022-12-08 15:37:06.499 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:37:06.505 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:37:06.689 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:07.247 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:07.332 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:07.336 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:07.391 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:37:07.629 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:37:08.178 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:264, status:SUCCESS 2022-12-08 15:37:08.185 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:264, status:SUCCESS 2022-12-08 15:37:09.749 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:09.750 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:10.337 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:10.341 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:10.504 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:10.504 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:12.387 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:37:12.472 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:13.213 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:37:13.224 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:37:13.342 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:13.349 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:13.461 INFO 42 --- [pool-ocp-schedules-16,,b4431212bc26] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:37:13.462 INFO 42 --- [pool-ocp-schedules-16,,b4431212bc26] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:37:13.574 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:14.432 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:37:14.755 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:15.563 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:37:15.761 INFO 42 --- [pool-ocp-schedules-19,,adddeb7809fb] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:37:15.944 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:37:16.153 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:37:16.150050+08:00, lastProcessTime=2022-12-08T15:37:06.147052+08:00 2022-12-08 15:37:16.259 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:37:16.150050+08:00, resultsCount=0 2022-12-08 15:37:16.259 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:37:16.150050+08:00, resultsCount=0 2022-12-08 15:37:16.260 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:37:16.150050+08:00 2022-12-08 15:37:16.350 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:16.359 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:16.417 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:37:16.616 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:16.616 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:17.921 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:37:19.016 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:19.016 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:19.360 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:19.363 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:21.204 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:21.0, nextRun=2022-12-08 15:37:20.0, currentDate=Thu Dec 08 15:37:21 CST 2022 2022-12-08 15:37:21.205 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:36:21.0, nextRunTime=2022-12-08 15:37:20.0} 2022-12-08 15:37:21.222 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:37:21.223 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:37:21.223 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:37:21.700 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 265, operation:EXECUTE, state: RUNNING 2022-12-08 15:37:21.952 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:37:21.955 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=265, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:37:21.687+08:00, endTime=null} 2022-12-08 15:37:21.958 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:37:22.099 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:22.364 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:22.369 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:22.563 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:22.835 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:23.135 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:37:23.548 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:37:23.559 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:265, status:SUCCESS 2022-12-08 15:37:23.566 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:265, status:SUCCESS 2022-12-08 15:37:23.952 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:37:24.470 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:37:25.071 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:37:25.138 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:33:54+08:00, updateTime=2022-12-08T15:36:54+08:00, expireTime=null, isLeader=false} 2022-12-08 15:37:25.149 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:37:25.238 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:25.238 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:25.291 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:25.370 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:25.379 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:25.635 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:37:25.700 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:26.0, nextRun=2022-12-08 15:37:25.0, currentDate=Thu Dec 08 15:37:25 CST 2022 2022-12-08 15:37:25.701 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:36:26.0, nextRunTime=2022-12-08 15:37:25.0} 2022-12-08 15:37:25.741 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:37:25.742 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:37:25.742 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:37:25.763 INFO 42 --- [pool-ocp-schedules-10,,835f287088a6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:37:26.069 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 266, operation:EXECUTE, state: RUNNING 2022-12-08 15:37:26.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:37:26.134 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:26.134 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:26.151 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:37:26.148507+08:00, lastProcessTime=2022-12-08T15:37:16.150050+08:00 2022-12-08 15:37:26.254 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:37:26.148507+08:00, resultsCount=0 2022-12-08 15:37:26.257 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:37:26.148507+08:00, resultsCount=0 2022-12-08 15:37:26.258 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:37:26.148507+08:00 2022-12-08 15:37:26.409 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=266, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:37:26.057+08:00, endTime=null} 2022-12-08 15:37:27.151 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:266, status:SUCCESS 2022-12-08 15:37:27.158 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:266, status:SUCCESS 2022-12-08 15:37:27.468 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:37:28.119 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:37:28.380 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:28.386 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:28.440 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:37:28.446 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:37:29.420 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:30.163 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:30.0, nextRun=2022-12-08 15:37:30.0, currentDate=Thu Dec 08 15:37:30 CST 2022 2022-12-08 15:37:30.165 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:36:30.0, nextRunTime=2022-12-08 15:37:30.0} 2022-12-08 15:37:30.190 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:37:30.400 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:37:02.0, nextRun=2022-12-08 15:37:30.0, currentDate=Thu Dec 08 15:37:30 CST 2022 2022-12-08 15:37:30.400 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:37:02.0, nextRunTime=2022-12-08 15:37:30.0} 2022-12-08 15:37:30.435 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:37:30.436 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:37:30.437 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:37:31.387 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:31.392 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:31.456 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:31.535 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 267, operation:EXECUTE, state: RUNNING 2022-12-08 15:37:31.743 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=267, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:37:31.523+08:00, endTime=null} 2022-12-08 15:37:31.762 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:37:32.623 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:267, status:SUCCESS 2022-12-08 15:37:32.630 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:267, status:SUCCESS 2022-12-08 15:37:32.635 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:32.739 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:32.739 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:33.668 INFO 42 --- [pool-ocp-schedules-10,,e16797ff4afe] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:37:33.669 INFO 42 --- [pool-ocp-schedules-10,,e16797ff4afe] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:37:34.393 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:34.398 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:34.629 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:37:34.760 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:34.761 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:35.477 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:35.741 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:37:35.764 INFO 42 --- [pool-ocp-schedules-7,,8f6639125af0] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:37:36.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:37:36.154 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:37:36.150859+08:00, lastProcessTime=2022-12-08T15:37:26.148507+08:00 2022-12-08 15:37:36.269 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:37:36.150859+08:00, resultsCount=0 2022-12-08 15:37:36.270 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:37:36.150859+08:00, resultsCount=0 2022-12-08 15:37:36.271 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:37:36.150859+08:00 2022-12-08 15:37:37.073 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:37:37.079 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:37:37.399 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:37.405 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:38.054 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:38.161 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:37:39.124 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:39.274 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:37:40.362 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:37:40.396 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=35ms, period=120000ms 2022-12-08 15:37:40.405 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:40.413 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:41.113 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:41.113 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:42.220 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:42.221 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:42.503 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:37:42.742 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:43.414 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:43.423 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:44.458 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:37:44.465 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:37:44.673 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:37:45.268 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:45.471 INFO 42 --- [pool-ocp-schedules-5,,c046f20bc3f4] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:37:45.507 INFO 42 --- [pool-ocp-schedules-5,,c046f20bc3f4] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:37:45.542 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:45.672 INFO 42 --- [pool-ocp-schedules-9,,065a459c2353] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:37:45.724 INFO 42 --- [pool-ocp-schedules-2,,469f2b86dcdd] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:37:45.724 INFO 42 --- [pool-ocp-schedules-2,,469f2b86dcdd] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:37:45.765 INFO 42 --- [pool-ocp-schedules-6,,7d202f5a5871] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:37:45.905 INFO 42 --- [pool-ocp-schedules-7,,6dbddd93037e] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:37:45.924 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:37:46.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:37:46.158 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:37:46.154454+08:00, lastProcessTime=2022-12-08T15:37:36.150859+08:00 2022-12-08 15:37:46.299 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:37:46.154454+08:00, resultsCount=0 2022-12-08 15:37:46.300 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:37:46.154454+08:00, resultsCount=0 2022-12-08 15:37:46.300 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:37:46.154454+08:00 2022-12-08 15:37:46.424 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:46.436 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:47.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:47.649 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:37:48.213 INFO 42 --- [pool-ocp-schedules-16,,f85903ee70bd] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:37:48.214 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:37:48.322 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:48.323 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:48.367 INFO 42 --- [pool-ocp-schedules-4,,7d0b8beb4197] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:37:48.951 INFO 42 --- [pool-ocp-schedules-18,,fafb2bea3930] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:37:49.437 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:49.442 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:49.469 INFO 42 --- [pool-ocp-schedules-7,,9bf37054d8d0] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:37:49.470 INFO 42 --- [pool-ocp-schedules-7,,9bf37054d8d0] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:37:49.470 INFO 42 --- [pool-ocp-schedules-7,,9bf37054d8d0] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:37:50.622 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:50.622 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:52.443 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:52.448 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:52.778 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:52.826 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:37:52.836 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:37:53.578 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:37:53.679 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:53.715 INFO 42 --- [pool-ocp-schedules-12,,3eee6ecc16d7] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:37:53.716 INFO 42 --- [pool-ocp-schedules-12,,3eee6ecc16d7] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:37:54.096 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:37:54.147 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:34:53+08:00, updateTime=2022-12-08T15:37:23+08:00, expireTime=null, isLeader=false} 2022-12-08 15:37:54.157 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:37:54.468 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:37:54.711 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:37:54.946 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:37:55.292 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:37:55.449 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:55.455 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:55.595 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:37:55.767 INFO 42 --- [pool-ocp-schedules-9,,567933005640] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:37:55.966 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:37:56.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:37:56.157 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:37:56.153232+08:00, lastProcessTime=2022-12-08T15:37:46.154454+08:00 2022-12-08 15:37:56.287 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:37:56.153232+08:00, resultsCount=0 2022-12-08 15:37:56.287 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:37:56.153232+08:00, resultsCount=0 2022-12-08 15:37:56.288 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:37:56.153232+08:00 2022-12-08 15:37:57.090 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:57.091 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:57.556 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:37:57.599 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:37:57.600 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:37:58.352 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:37:58.456 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:37:58.469 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:37:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,88a9a51d56d2] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:37:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,88a9a51d56d2] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:38:00.140 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:38:00.145 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:38:00.644 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:38:01.022 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:36:01.0, nextRun=2022-12-08 15:38:00.0, currentDate=Thu Dec 08 15:38:01 CST 2022 2022-12-08 15:38:01.023 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:36:01.0, nextRunTime=2022-12-08 15:38:00.0} 2022-12-08 15:38:01.045 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:38:01.120 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:37:00.0, nextRun=2022-12-08 15:38:00.0, currentDate=Thu Dec 08 15:38:01 CST 2022 2022-12-08 15:38:01.122 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:37:00.0, nextRunTime=2022-12-08 15:38:00.0} 2022-12-08 15:38:01.151 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:38:01.151 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:38:01.151 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:38:01.203 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:37:01.0, nextRun=2022-12-08 15:38:00.0, currentDate=Thu Dec 08 15:38:01 CST 2022 2022-12-08 15:38:01.204 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:37:01.0, nextRunTime=2022-12-08 15:38:00.0} 2022-12-08 15:38:01.231 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:38:01.231 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:38:01.232 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:38:01.279 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:37:01.0, nextRun=2022-12-08 15:38:00.0, currentDate=Thu Dec 08 15:38:01 CST 2022 2022-12-08 15:38:01.279 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:37:01.0, nextRunTime=2022-12-08 15:38:00.0} 2022-12-08 15:38:01.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:38:01.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:38:01.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:38:01.369 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:37:30.0, nextRun=2022-12-08 15:38:00.0, currentDate=Thu Dec 08 15:38:01 CST 2022 2022-12-08 15:38:01.369 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:37:30.0, nextRunTime=2022-12-08 15:38:00.0} 2022-12-08 15:38:01.386 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:38:01.387 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:38:01.387 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:38:01.461 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:37:02.0, nextRun=2022-12-08 15:38:00.0, currentDate=Thu Dec 08 15:38:01 CST 2022 2022-12-08 15:38:01.462 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:37:02.0, nextRunTime=2022-12-08 15:38:00.0} 2022-12-08 15:38:01.470 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:01.475 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:01.480 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:38:01.481 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:38:01.481 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:38:02.259 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 272, operation:EXECUTE, state: RUNNING 2022-12-08 15:38:02.301 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=272, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:38:02.236+08:00, endTime=null} 2022-12-08 15:38:02.369 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 268, operation:EXECUTE, state: RUNNING 2022-12-08 15:38:02.402 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=268, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:38:02.356+08:00, endTime=null} 2022-12-08 15:38:02.489 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 269, operation:EXECUTE, state: RUNNING 2022-12-08 15:38:02.570 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=269, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:38:02.466+08:00, endTime=null} 2022-12-08 15:38:02.584 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,cac1c2b98fe6] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=268, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=268, task_operation=execute, latest_execution_start_time=2022-12-08T15:38:02.355+08:00, sub_task_instance_id=268}, listMap={}}, executor=192.168.28.62 2022-12-08 15:38:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,de81fbe568c4] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485140, interval=60 2022-12-08 15:38:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,de81fbe568c4] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485082, count=0, elapsed=1668814597554 2022-12-08 15:38:02.645 INFO 42 --- [pool-prometheus-minute-schedule-2,,cceecc6bc127] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485140, interval=60 2022-12-08 15:38:02.645 INFO 42 --- [pool-prometheus-minute-schedule-2,,cceecc6bc127] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485082, count=0, elapsed=1668814597563 2022-12-08 15:38:02.673 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 270, operation:EXECUTE, state: RUNNING 2022-12-08 15:38:02.717 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,cac1c2b98fe6] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 268, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:38:02.725 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=270, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:38:02.653+08:00, endTime=null} 2022-12-08 15:38:02.827 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 271, operation:EXECUTE, state: RUNNING 2022-12-08 15:38:02.857 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:02.900 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=271, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:38:02.806+08:00, endTime=null} 2022-12-08 15:38:03.127 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:268, status:SUCCESS 2022-12-08 15:38:03.134 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:268, status:SUCCESS 2022-12-08 15:38:03.201 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,5ed0387e6e44] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=271, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=271, task_operation=execute, latest_execution_start_time=2022-12-08T15:38:02.804+08:00, sub_task_instance_id=271}, listMap={}}, executor=192.168.28.62 2022-12-08 15:38:03.201 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,5ed0387e6e44] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:38:03.217 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,5ed0387e6e44] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:38:03.300 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:269, status:SUCCESS 2022-12-08 15:38:03.306 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:269, status:SUCCESS 2022-12-08 15:38:03.375 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,5ed0387e6e44] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 271, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:38:03.478 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:270, status:SUCCESS 2022-12-08 15:38:03.483 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:270, status:SUCCESS 2022-12-08 15:38:03.592 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:271, status:SUCCESS 2022-12-08 15:38:03.601 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:271, status:SUCCESS 2022-12-08 15:38:03.685 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:272, status:SUCCESS 2022-12-08 15:38:03.693 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:272, status:SUCCESS 2022-12-08 15:38:04.476 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:04.481 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:04.745 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:38:05.410 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:37:05.0, nextRun=2022-12-08 15:38:05.0, currentDate=Thu Dec 08 15:38:05 CST 2022 2022-12-08 15:38:05.410 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:37:05.0, nextRunTime=2022-12-08 15:38:05.0} 2022-12-08 15:38:05.431 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:38:05.431 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:38:05.432 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:38:05.649 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:05.769 INFO 42 --- [pool-ocp-schedules-1,,4b61b2e869ff] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:38:05.995 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:38:06.027 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 273, operation:EXECUTE, state: RUNNING 2022-12-08 15:38:06.058 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=273, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:38:06.015+08:00, endTime=null} 2022-12-08 15:38:06.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:38:06.156 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:38:06.152962+08:00, lastProcessTime=2022-12-08T15:37:56.153232+08:00 2022-12-08 15:38:06.192 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,5930142b9543] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=273, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=273, task_operation=execute, latest_execution_start_time=2022-12-08T15:38:06.012+08:00, sub_task_instance_id=273}, listMap={}}, executor=192.168.28.62 2022-12-08 15:38:06.275 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,5930142b9543] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 273, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:38:06.286 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:38:06.152962+08:00, resultsCount=0 2022-12-08 15:38:06.287 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:38:06.152962+08:00, resultsCount=0 2022-12-08 15:38:06.288 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:38:06.152962+08:00 2022-12-08 15:38:07.090 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:273, status:SUCCESS 2022-12-08 15:38:07.096 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:273, status:SUCCESS 2022-12-08 15:38:07.483 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:07.487 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:08.423 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:38:10.344 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:38:10.488 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:10.494 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:12.577 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:38:12.918 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:13.494 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:13.500 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:13.832 INFO 42 --- [pool-ocp-schedules-4,,0379234b99f6] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:38:13.832 INFO 42 --- [pool-ocp-schedules-4,,0379234b99f6] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:38:14.788 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:38:15.687 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:15.770 INFO 42 --- [pool-ocp-schedules-3,,7c7e7bb53f50] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:38:15.837 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:38:15.843 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:38:16.033 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:38:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:38:16.153 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:38:16.147019+08:00, lastProcessTime=2022-12-08T15:38:06.152962+08:00 2022-12-08 15:38:16.226 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:38:16.267 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:38:16.147019+08:00, resultsCount=0 2022-12-08 15:38:16.268 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:38:16.147019+08:00, resultsCount=0 2022-12-08 15:38:16.268 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:38:16.147019+08:00 2022-12-08 15:38:16.501 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:16.506 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:18.486 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:38:18.803 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:38:19.509 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:19.711 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:19.730 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:38:20.850 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:37:21.0, nextRun=2022-12-08 15:38:20.0, currentDate=Thu Dec 08 15:38:20 CST 2022 2022-12-08 15:38:20.851 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:37:21.0, nextRunTime=2022-12-08 15:38:20.0} 2022-12-08 15:38:20.878 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:38:20.878 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:38:20.879 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:38:21.310 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 274, operation:EXECUTE, state: RUNNING 2022-12-08 15:38:21.422 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=274, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:38:21.299+08:00, endTime=null} 2022-12-08 15:38:21.664 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,716250681a45] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=274, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=274, task_operation=execute, latest_execution_start_time=2022-12-08T15:38:21.297+08:00, sub_task_instance_id=274}, listMap={}}, executor=192.168.28.62 2022-12-08 15:38:21.812 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:34:21.476, end=2022-12-08T15:36:21.649} 2022-12-08 15:38:21.827 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:38:21.848 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,716250681a45] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 274, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:38:22.712 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:22.717 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:22.723 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:38:22.724 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:38:22.805 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:274, status:SUCCESS 2022-12-08 15:38:22.814 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:274, status:SUCCESS 2022-12-08 15:38:22.980 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:38:22.980 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:38:23.213 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:23.603 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:38:24.183 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:38:25.135 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:38:25.294 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:38:25.299 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:38:25.368 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:38:25.700 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:37:26.0, nextRun=2022-12-08 15:38:25.0, currentDate=Thu Dec 08 15:38:25 CST 2022 2022-12-08 15:38:25.701 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:37:26.0, nextRunTime=2022-12-08 15:38:25.0} 2022-12-08 15:38:25.718 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:25.724 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:25.743 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:38:25.744 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:38:25.744 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:38:25.771 INFO 42 --- [pool-ocp-schedules-14,,1242a40ad3a7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:38:25.790 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:25.857 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:38:26.089 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:38:26.091 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:38:26.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:38:26.149 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:38:26.145601+08:00, lastProcessTime=2022-12-08T15:38:16.147019+08:00 2022-12-08 15:38:26.247 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:38:26.145601+08:00, resultsCount=0 2022-12-08 15:38:26.248 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:38:26.145601+08:00, resultsCount=0 2022-12-08 15:38:26.248 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:38:26.145601+08:00 2022-12-08 15:38:26.571 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 275, operation:EXECUTE, state: RUNNING 2022-12-08 15:38:26.640 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:38:26.699 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=275, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:38:26.556+08:00, endTime=null} 2022-12-08 15:38:27.035 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,c1c848e5a146] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=275, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=275, task_operation=execute, latest_execution_start_time=2022-12-08T15:38:26.555+08:00, sub_task_instance_id=275}, listMap={host_ids=[]}}, executor=192.168.28.62 2022-12-08 15:38:27.253 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,c1c848e5a146] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 275, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:38:27.656 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:38:28.691 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:275, status:SUCCESS 2022-12-08 15:38:28.697 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:275, status:SUCCESS 2022-12-08 15:38:28.725 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:28.729 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:28.833 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:38:28.925 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:38:28.925 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:38:29.637 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:38:29.638 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:38:30.868 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:37:30.0, nextRun=2022-12-08 15:38:30.0, currentDate=Thu Dec 08 15:38:30 CST 2022 2022-12-08 15:38:30.869 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:37:30.0, nextRunTime=2022-12-08 15:38:30.0} 2022-12-08 15:38:30.892 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:38:31.095 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:01.0, nextRun=2022-12-08 15:38:30.0, currentDate=Thu Dec 08 15:38:31 CST 2022 2022-12-08 15:38:31.096 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:38:01.0, nextRunTime=2022-12-08 15:38:30.0} 2022-12-08 15:38:31.114 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:38:31.114 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:38:31.115 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:38:31.730 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:31.735 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:31.844 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 276, operation:EXECUTE, state: RUNNING 2022-12-08 15:38:31.950 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=276, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:38:31.830+08:00, endTime=null} 2022-12-08 15:38:31.960 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:38:31.964 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:38:32.141 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,e14151cf4d42] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=276, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=276, task_operation=execute, latest_execution_start_time=2022-12-08T15:38:31.828+08:00, sub_task_instance_id=276}, listMap={}}, executor=192.168.28.62 2022-12-08 15:38:32.141 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,e14151cf4d42] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:38:32.155 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,e14151cf4d42] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:38:32.261 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,e14151cf4d42] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 276, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:38:32.721 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:38:33.261 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:33.479 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:276, status:SUCCESS 2022-12-08 15:38:33.485 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:276, status:SUCCESS 2022-12-08 15:38:33.932 INFO 42 --- [pool-ocp-schedules-1,,233adfd5baf0] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:38:33.932 INFO 42 --- [pool-ocp-schedules-1,,233adfd5baf0] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:38:34.735 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:34.744 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:35.250 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:38:35.773 INFO 42 --- [pool-ocp-schedules-13,,40217993d6c2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:38:35.827 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:36.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:38:36.157 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:38:36.154316+08:00, lastProcessTime=2022-12-08T15:38:26.145601+08:00 2022-12-08 15:38:36.247 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:38:36.154316+08:00, resultsCount=0 2022-12-08 15:38:36.248 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:38:36.154316+08:00, resultsCount=0 2022-12-08 15:38:36.248 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:38:36.154316+08:00 2022-12-08 15:38:36.624 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:38:37.745 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:37.750 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:39.019 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:38:40.751 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:40.756 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:42.272 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:38:42.844 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:38:43.451 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:43.757 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:43.762 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:45.424 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:38:45.470 INFO 42 --- [pool-ocp-schedules-13,,8d42aeef8909] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:38:45.503 INFO 42 --- [pool-ocp-schedules-13,,8d42aeef8909] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:38:45.673 INFO 42 --- [pool-ocp-schedules-19,,a08edf89c96a] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:38:45.775 INFO 42 --- [pool-ocp-schedules-2,,901f59c9c8c9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:38:45.911 INFO 42 --- [pool-ocp-schedules-20,,e4b40dc86e8a] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:38:45.974 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:46.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:38:46.156 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:38:46.150528+08:00, lastProcessTime=2022-12-08T15:38:36.154316+08:00 2022-12-08 15:38:46.272 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:38:46.150528+08:00, resultsCount=0 2022-12-08 15:38:46.273 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:38:46.150528+08:00, resultsCount=0 2022-12-08 15:38:46.273 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:38:46.150528+08:00 2022-12-08 15:38:46.762 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:38:46.763 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:46.767 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:47.494 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:38:47.500 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:38:48.169 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:38:48.284 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:38:48.570 INFO 42 --- [pool-ocp-schedules-15,,687835870462] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:38:48.661 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:38:49.018 INFO 42 --- [pool-ocp-schedules-5,,fe0867ef6da7] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:38:49.136 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:38:49.237 INFO 42 --- [pool-ocp-schedules-7,,31a74c690ac0] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:38:49.621 INFO 42 --- [pool-ocp-schedules-4,,a7d830f3caa3] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:38:49.622 INFO 42 --- [pool-ocp-schedules-4,,a7d830f3caa3] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:38:49.623 INFO 42 --- [pool-ocp-schedules-4,,a7d830f3caa3] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:38:49.768 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:49.773 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:51.579 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:38:51.579 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:38:51.585 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:38:51.586 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:38:52.774 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:52.779 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:53.763 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:54.021 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:38:54.118 INFO 42 --- [pool-ocp-schedules-16,,7d412a4b8690] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:38:54.119 INFO 42 --- [pool-ocp-schedules-16,,7d412a4b8690] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:38:54.273 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:35:53+08:00, updateTime=2022-12-08T15:38:23+08:00, expireTime=null, isLeader=false} 2022-12-08 15:38:54.283 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:38:54.323 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:38:54.328 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:38:54.441 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:38:54.678 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:38:54.679 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:38:54.969 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:38:55.425 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:38:55.694 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:38:55.776 INFO 42 --- [pool-ocp-schedules-14,,89b5b8123fa6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:38:55.780 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:55.787 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:56.006 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:38:56.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:38:56.153 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:38:56.150134+08:00, lastProcessTime=2022-12-08T15:38:46.150528+08:00 2022-12-08 15:38:56.276 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:38:56.150134+08:00, resultsCount=0 2022-12-08 15:38:56.276 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:38:56.150134+08:00, resultsCount=0 2022-12-08 15:38:56.277 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:38:56.150134+08:00 2022-12-08 15:38:57.017 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:38:57.790 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:38:57.790 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:38:57.791 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:38:57.791 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:38:57.991 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:38:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,ece72578d647] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:38:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,ece72578d647] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:38:58.788 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:38:58.793 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:38:59.305 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:39:00.001 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:39:00.491 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:39:00.500 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:39:00.945 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:01.0, nextRun=2022-12-08 15:39:00.0, currentDate=Thu Dec 08 15:39:00 CST 2022 2022-12-08 15:39:00.946 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:38:01.0, nextRunTime=2022-12-08 15:39:00.0} 2022-12-08 15:39:00.964 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:39:00.965 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:39:00.967 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:39:01.017 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:01.019 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:01.102 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:01.0, nextRun=2022-12-08 15:39:00.0, currentDate=Thu Dec 08 15:39:01 CST 2022 2022-12-08 15:39:01.103 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:38:01.0, nextRunTime=2022-12-08 15:39:00.0} 2022-12-08 15:39:01.128 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:39:01.129 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:39:01.129 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:39:01.266 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:39:01.281 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:01.0, nextRun=2022-12-08 15:39:00.0, currentDate=Thu Dec 08 15:39:01 CST 2022 2022-12-08 15:39:01.282 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:38:01.0, nextRunTime=2022-12-08 15:39:00.0} 2022-12-08 15:39:01.306 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:39:01.307 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:39:01.307 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:39:01.369 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:31.0, nextRun=2022-12-08 15:39:00.0, currentDate=Thu Dec 08 15:39:01 CST 2022 2022-12-08 15:39:01.369 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:38:31.0, nextRunTime=2022-12-08 15:39:00.0} 2022-12-08 15:39:01.372 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 277, operation:EXECUTE, state: RUNNING 2022-12-08 15:39:01.384 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:39:01.385 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:39:01.385 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:39:01.663 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=277, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:39:01.360+08:00, endTime=null} 2022-12-08 15:39:01.720 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 278, operation:EXECUTE, state: RUNNING 2022-12-08 15:39:01.794 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:01.798 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:02.009 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:01.0, nextRun=2022-12-08 15:39:00.0, currentDate=Thu Dec 08 15:39:02 CST 2022 2022-12-08 15:39:02.010 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:38:01.0, nextRunTime=2022-12-08 15:39:00.0} 2022-12-08 15:39:02.036 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:39:02.036 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:39:02.037 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:39:02.117 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=278, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:39:01.710+08:00, endTime=null} 2022-12-08 15:39:02.205 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,b10d1572c843] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=277, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=277, task_operation=execute, latest_execution_start_time=2022-12-08T15:39:01.358+08:00, sub_task_instance_id=277}, listMap={}}, executor=192.168.28.62 2022-12-08 15:39:02.356 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,b10d1572c843] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 277, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:39:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,279f5a340c1d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485200, interval=60 2022-12-08 15:39:02.637 INFO 42 --- [pool-prometheus-minute-schedule-1,,279f5a340c1d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485142, count=0, elapsed=1668814657495 2022-12-08 15:39:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,9d17daca215d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485200, interval=60 2022-12-08 15:39:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,9d17daca215d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485142, count=0, elapsed=1668814657498 2022-12-08 15:39:03.194 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 279, operation:EXECUTE, state: RUNNING 2022-12-08 15:39:03.407 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=279, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:39:03.183+08:00, endTime=null} 2022-12-08 15:39:03.467 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 280, operation:EXECUTE, state: RUNNING 2022-12-08 15:39:03.716 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=280, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:39:03.456+08:00, endTime=null} 2022-12-08 15:39:03.795 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 281, operation:EXECUTE, state: RUNNING 2022-12-08 15:39:03.873 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=281, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:39:03.782+08:00, endTime=null} 2022-12-08 15:39:03.945 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,322e5d91ba85] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=280, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=280, task_operation=execute, latest_execution_start_time=2022-12-08T15:39:03.454+08:00, sub_task_instance_id=280}, listMap={}}, executor=192.168.28.62 2022-12-08 15:39:03.945 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,322e5d91ba85] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2022-12-08 15:39:03.960 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,322e5d91ba85] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2022-12-08 15:39:03.991 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:277, status:SUCCESS 2022-12-08 15:39:03.997 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:277, status:SUCCESS 2022-12-08 15:39:04.021 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:04.072 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,322e5d91ba85] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 280, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:39:04.169 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:04.170 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:04.172 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:04.172 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:04.182 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:278, status:SUCCESS 2022-12-08 15:39:04.189 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:278, status:SUCCESS 2022-12-08 15:39:04.461 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:279, status:SUCCESS 2022-12-08 15:39:04.469 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:279, status:SUCCESS 2022-12-08 15:39:04.639 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:280, status:SUCCESS 2022-12-08 15:39:04.644 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:280, status:SUCCESS 2022-12-08 15:39:04.707 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:281, status:SUCCESS 2022-12-08 15:39:04.712 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:281, status:SUCCESS 2022-12-08 15:39:04.799 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:04.803 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:05.265 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:05.0, nextRun=2022-12-08 15:39:05.0, currentDate=Thu Dec 08 15:39:05 CST 2022 2022-12-08 15:39:05.266 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:38:05.0, nextRunTime=2022-12-08 15:39:05.0} 2022-12-08 15:39:05.286 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:39:05.288 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:39:05.289 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:39:05.778 INFO 42 --- [pool-ocp-schedules-5,,d0ac3a2ca115] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:39:05.847 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:39:05.974 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 282, operation:EXECUTE, state: RUNNING 2022-12-08 15:39:06.007 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=282, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:39:05.947+08:00, endTime=null} 2022-12-08 15:39:06.076 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:06.079 INFO 42 --- [pool-ocp-schedules-15,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:39:06.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:39:06.145 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:39:06.142978+08:00, lastProcessTime=2022-12-08T15:38:56.150134+08:00 2022-12-08 15:39:06.228 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:39:06.142978+08:00, resultsCount=0 2022-12-08 15:39:06.228 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:39:06.142978+08:00, resultsCount=0 2022-12-08 15:39:06.228 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:39:06.142978+08:00 2022-12-08 15:39:06.399 INFO 42 --- [pool-ocp-schedules-15,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:39:06.510 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:39:06.620 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:39:06.625 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:39:06.839 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : Started application in 6.739 seconds (JVM running for 1143.685) 2022-12-08 15:39:07.116 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:39:07.200 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:282, status:SUCCESS 2022-12-08 15:39:07.206 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:282, status:SUCCESS 2022-12-08 15:39:07.373 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:07.380 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:07.728 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:39:07.804 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:07.810 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:09.240 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:39:09.240+08:00 2022-12-08 15:39:09.394 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:39:10.419 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:10.419 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:10.446 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:10.447 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:10.810 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:10.817 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:13.198 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:39:13.322 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:39:13.327 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:39:13.644 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:13.707 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:13.818 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:13.822 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:14.034 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:39:14.163 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:14.224 INFO 42 --- [pool-ocp-schedules-11,,a0b1866e2171] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:39:14.224 INFO 42 --- [pool-ocp-schedules-11,,a0b1866e2171] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:39:15.779 INFO 42 --- [pool-ocp-schedules-14,,5c4eab9a173f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:39:15.903 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:39:16.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:39:16.153 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:39:16.149695+08:00, lastProcessTime=2022-12-08T15:39:06.142978+08:00 2022-12-08 15:39:16.258 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:39:16.149695+08:00, resultsCount=0 2022-12-08 15:39:16.258 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:39:16.149695+08:00, resultsCount=0 2022-12-08 15:39:16.259 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:39:16.149695+08:00 2022-12-08 15:39:16.498 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:16.734 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:16.735 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:16.809 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:16.809 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:16.823 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:16.828 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:17.178 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:39:19.476 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:39:19.481 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:39:19.516 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:39:19.828 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:19.833 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:20.000 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:20.000 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:20.157 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:39:20.716 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:21.0, nextRun=2022-12-08 15:39:20.0, currentDate=Thu Dec 08 15:39:20 CST 2022 2022-12-08 15:39:20.717 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:38:21.0, nextRunTime=2022-12-08 15:39:20.0} 2022-12-08 15:39:20.739 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:39:20.740 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:39:20.740 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:39:21.261 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 283, operation:EXECUTE, state: RUNNING 2022-12-08 15:39:21.481 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=283, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:39:21.233+08:00, endTime=null} 2022-12-08 15:39:22.834 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:22.839 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:22.860 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:283, status:SUCCESS 2022-12-08 15:39:22.866 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:283, status:SUCCESS 2022-12-08 15:39:23.149 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:23.149 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:23.153 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:23.153 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:24.224 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:24.441 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:39:24.532 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:39:25.356 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:26.0, nextRun=2022-12-08 15:39:25.0, currentDate=Thu Dec 08 15:39:25 CST 2022 2022-12-08 15:39:25.357 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:38:26.0, nextRunTime=2022-12-08 15:39:25.0} 2022-12-08 15:39:25.416 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:39:25.417 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:39:25.417 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:39:25.443 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:39:25.449 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:39:25.597 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 284, operation:EXECUTE, state: RUNNING 2022-12-08 15:39:25.694 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:39:25.745 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=284, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:39:25.582+08:00, endTime=null} 2022-12-08 15:39:25.780 INFO 42 --- [pool-ocp-schedules-14,,1980e994fd7d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:39:25.839 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:25.844 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:25.961 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:39:26.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:39:26.151 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:39:26.146081+08:00, lastProcessTime=2022-12-08T15:39:16.149695+08:00 2022-12-08 15:39:26.223 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:26.247 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:26.256 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:39:26.146081+08:00, resultsCount=0 2022-12-08 15:39:26.256 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:39:26.146081+08:00, resultsCount=0 2022-12-08 15:39:26.257 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:39:26.146081+08:00 2022-12-08 15:39:26.604 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:26.736 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:39:27.069 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:284, status:SUCCESS 2022-12-08 15:39:27.075 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:284, status:SUCCESS 2022-12-08 15:39:27.212 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:39:28.340 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:39:28.845 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:28.851 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:29.367 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:29.367 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:29.624 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:39:29.738 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:29.738 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:31.719 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:31.0, nextRun=2022-12-08 15:39:30.0, currentDate=Thu Dec 08 15:39:31 CST 2022 2022-12-08 15:39:31.720 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:38:31.0, nextRunTime=2022-12-08 15:39:30.0} 2022-12-08 15:39:31.743 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:39:31.851 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:31.856 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:32.445 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:39:01.0, nextRun=2022-12-08 15:39:30.0, currentDate=Thu Dec 08 15:39:32 CST 2022 2022-12-08 15:39:32.445 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:39:01.0, nextRunTime=2022-12-08 15:39:30.0} 2022-12-08 15:39:32.460 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:39:32.461 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:39:32.461 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:39:32.923 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:39:32.960 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 285, operation:EXECUTE, state: RUNNING 2022-12-08 15:39:32.968 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:39:33.133 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=285, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:39:32.939+08:00, endTime=null} 2022-12-08 15:39:34.171 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:285, status:SUCCESS 2022-12-08 15:39:34.176 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:285, status:SUCCESS 2022-12-08 15:39:34.326 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:34.333 INFO 42 --- [pool-ocp-schedules-15,,08afa9afb441] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:39:34.334 INFO 42 --- [pool-ocp-schedules-15,,08afa9afb441] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:39:34.857 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:34.863 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:35.781 INFO 42 --- [pool-ocp-schedules-16,,d159fd08c097] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:39:35.856 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:35.992 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:36.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:39:36.173 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:39:36.164513+08:00, lastProcessTime=2022-12-08T15:39:26.146081+08:00 2022-12-08 15:39:36.199 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:39:36.265 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:39:36.282 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:39:36.164513+08:00, resultsCount=0 2022-12-08 15:39:36.282 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:39:36.164513+08:00, resultsCount=0 2022-12-08 15:39:36.283 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:39:36.164513+08:00 2022-12-08 15:39:36.795 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:37.259 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:39:37.864 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:37.869 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:38.962 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:38.962 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:39.062 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:39.063 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:39.723 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:39:40.332 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:39:40.352 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=20ms, period=120000ms 2022-12-08 15:39:40.870 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:40.876 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:41.462 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:39:41.467 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:39:42.055 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:42.134 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:42.577 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:39:43.415 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:39:43.877 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:43.882 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:44.436 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:45.232 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:45.232 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:45.276 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:45.277 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:45.469 INFO 42 --- [pool-ocp-schedules-7,,04ae1f4f5e4b] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:39:45.500 INFO 42 --- [pool-ocp-schedules-7,,04ae1f4f5e4b] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:39:45.674 INFO 42 --- [pool-ocp-schedules-6,,ccebaa5cfe7d] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:39:45.726 INFO 42 --- [pool-ocp-schedules-18,,e0a7820f90e6] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:39:45.726 INFO 42 --- [pool-ocp-schedules-18,,e0a7820f90e6] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:39:45.783 INFO 42 --- [pool-ocp-schedules-1,,7370800d15d7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:39:45.916 INFO 42 --- [pool-ocp-schedules-3,,0d057065c48f] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:39:46.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:39:46.166 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:39:46.162158+08:00, lastProcessTime=2022-12-08T15:39:36.164513+08:00 2022-12-08 15:39:46.298 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:39:46.162158+08:00, resultsCount=0 2022-12-08 15:39:46.298 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:39:46.162158+08:00, resultsCount=0 2022-12-08 15:39:46.298 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:39:46.162158+08:00 2022-12-08 15:39:46.381 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:39:46.820 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:46.882 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:46.887 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:47.397 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:39:47.851 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:39:47.857 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:39:48.397 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:48.403 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:48.644 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:39:48.793 INFO 42 --- [pool-ocp-schedules-9,,b31843eb272b] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:39:49.196 INFO 42 --- [pool-ocp-schedules-1,,0087d2195bb1] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:39:49.322 INFO 42 --- [pool-ocp-schedules-13,,3ad4f1bd0cd6] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:39:49.708 INFO 42 --- [pool-ocp-schedules-5,,6d36aa7cea2e] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:39:49.709 INFO 42 --- [pool-ocp-schedules-5,,6d36aa7cea2e] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:39:49.709 INFO 42 --- [pool-ocp-schedules-5,,6d36aa7cea2e] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:39:49.888 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:49.892 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:50.221 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:39:51.580 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:51.581 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:51.647 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:51.648 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:52.893 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:52.897 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:54.114 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:39:54.119 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:39:54.523 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:39:54.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:54.714 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:39:54.874 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:54.874 INFO 42 --- [pool-ocp-schedules-18,,935c8f28812a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:39:54.874 INFO 42 --- [pool-ocp-schedules-18,,935c8f28812a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:39:55.005 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:39:55.061 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:37:54+08:00, updateTime=2022-12-08T15:39:24+08:00, expireTime=null, isLeader=false} 2022-12-08 15:39:55.068 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:39:55.197 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:39:55.784 INFO 42 --- [pool-ocp-schedules-6,,6fdafe3e90da] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:39:55.863 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:39:55.898 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:55.902 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:39:56.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:39:56.153 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:39:56.149458+08:00, lastProcessTime=2022-12-08T15:39:46.162158+08:00 2022-12-08 15:39:56.269 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:39:56.149458+08:00, resultsCount=0 2022-12-08 15:39:56.271 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:39:56.149458+08:00, resultsCount=0 2022-12-08 15:39:56.272 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:39:56.149458+08:00 2022-12-08 15:39:56.468 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:39:56.991 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:39:57.486 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:39:57.951 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:57.952 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:57.953 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:39:57.954 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:39:58.508 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:39:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,063119157665] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:39:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,063119157665] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:39:58.903 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:39:58.910 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:00.373 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:40:00.661 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:40:00.669 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:40:01.262 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:01.267 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:01.910 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:01.915 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:01.942 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:01.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:01 CST 2022 2022-12-08 15:40:01.943 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=12, name=Refresh agent config, templateName=RefreshAgentConfigSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 15:30:01.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:01.968 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Refresh agent config, nodeCount=1, taskCount=1 2022-12-08 15:40:01.969 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:01.969 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Refresh agent config, taskDefinitionId=12, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:02.006 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:40:02.139 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:38:01.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:02 CST 2022 2022-12-08 15:40:02.139 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:38:01.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:02.164 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:40:02.525 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:30:02.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:02 CST 2022 2022-12-08 15:40:02.526 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=15, name=Sync system event, templateName=SyncSystemEventSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 15:30:02.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:02.544 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync system event 2022-12-08 15:40:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,b5781f621693] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485260, interval=60 2022-12-08 15:40:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,b5781f621693] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485202, count=0, elapsed=1668814717434 2022-12-08 15:40:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,cc9104c7783a] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485260, interval=60 2022-12-08 15:40:02.641 INFO 42 --- [pool-prometheus-minute-schedule-1,,cc9104c7783a] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485202, count=0, elapsed=1668814717439 2022-12-08 15:40:02.657 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 286, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:02.731 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:00.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:02 CST 2022 2022-12-08 15:40:02.732 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 15:35:00.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:02.752 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 15:40:02.752 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:02.753 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:02.895 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=286, name=Refresh all agent config, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.RefreshAllAgentConfigTask, seriesId=0, startTime=2022-12-08T15:40:02.636+08:00, endTime=null} 2022-12-08 15:40:03.072 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:00.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:03 CST 2022 2022-12-08 15:40:03.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:35:00.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:03.114 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 15:40:03.114 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 15:40:03.269 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:39:01.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:03 CST 2022 2022-12-08 15:40:03.270 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:39:01.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:03.287 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:40:03.287 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:03.288 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:03.479 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:39:01.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:03 CST 2022 2022-12-08 15:40:03.480 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:39:01.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:03.503 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:40:03.504 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:03.504 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:03.654 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:39:01.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:03 CST 2022 2022-12-08 15:40:03.655 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:39:01.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:03.684 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:40:03.685 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:03.685 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:03.812 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:286, status:SUCCESS 2022-12-08 15:40:03.818 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:286, status:SUCCESS 2022-12-08 15:40:03.916 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:39:32.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:03 CST 2022 2022-12-08 15:40:03.917 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:39:32.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:03.940 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:40:03.940 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:03.940 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:04.022 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 288, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:04.254 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:35:02.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:04 CST 2022 2022-12-08 15:40:04.255 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:35:02.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:04.274 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 15:40:04.275 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:04.275 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:04.376 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=288, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:40:04.011+08:00, endTime=null} 2022-12-08 15:40:04.467 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 289, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:04.540 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:39:02.0, nextRun=2022-12-08 15:40:00.0, currentDate=Thu Dec 08 15:40:04 CST 2022 2022-12-08 15:40:04.541 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:39:02.0, nextRunTime=2022-12-08 15:40:00.0} 2022-12-08 15:40:04.563 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:40:04.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:04.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:04.609 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=289, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:40:04.435+08:00, endTime=null} 2022-12-08 15:40:04.671 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 290, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:04.842 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=290, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:40:04.658+08:00, endTime=null} 2022-12-08 15:40:04.912 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 287, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:04.916 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:04.922 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:04.940 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,b0d4f1f74f04] c.a.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=289, context=Context{parallelIdx=-1, stringMap={prohibit_rollback=false, task_instance_id=289, task_operation=execute, latest_execution_start_time=2022-12-08T15:40:04.434+08:00, sub_task_instance_id=289}, listMap={}}, executor=192.168.28.62 2022-12-08 15:40:05.000 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:05.000 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:05.005 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:05.005 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:40:05.005 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:05.079 INFO 42 --- [pool-subtask-executor30,6d808bd684a44ecd,b0d4f1f74f04] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 289, operation:EXECUTE, state: SUCCESSFUL 2022-12-08 15:40:05.081 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=287, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T15:40:04.900+08:00, endTime=null} 2022-12-08 15:40:05.521 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:288, status:SUCCESS 2022-12-08 15:40:05.526 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:288, status:SUCCESS 2022-12-08 15:40:05.713 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:289, status:SUCCESS 2022-12-08 15:40:05.719 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:289, status:SUCCESS 2022-12-08 15:40:05.785 INFO 42 --- [pool-ocp-schedules-6,,a24102bb9a82] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:40:05.895 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:290, status:SUCCESS 2022-12-08 15:40:05.902 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:290, status:SUCCESS 2022-12-08 15:40:06.115 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:40:06.148 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 291, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:06.152 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:40:06.149767+08:00, lastProcessTime=2022-12-08T15:39:56.149458+08:00 2022-12-08 15:40:06.191 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:39:05.0, nextRun=2022-12-08 15:40:05.0, currentDate=Thu Dec 08 15:40:06 CST 2022 2022-12-08 15:40:06.192 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:39:05.0, nextRunTime=2022-12-08 15:40:05.0} 2022-12-08 15:40:06.216 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:40:06.217 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:06.217 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:06.241 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:40:06.149767+08:00, resultsCount=0 2022-12-08 15:40:06.242 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:40:06.149767+08:00, resultsCount=0 2022-12-08 15:40:06.242 INFO 42 --- [alarm-task-2,,0b6f31bfaeb7] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:40:06.149767+08:00 2022-12-08 15:40:06.284 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=291, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:40:06.137+08:00, endTime=null} 2022-12-08 15:40:06.364 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 292, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:06.543 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=292, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T15:40:06.353+08:00, endTime=null} 2022-12-08 15:40:06.577 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:40:06.595 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 293, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:06.736 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=293, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:40:06.586+08:00, endTime=null} 2022-12-08 15:40:07.155 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:40:07.267 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:287, status:SUCCESS 2022-12-08 15:40:07.273 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:287, status:SUCCESS 2022-12-08 15:40:07.322 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:40:07.328 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:40:07.398 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:291, status:SUCCESS 2022-12-08 15:40:07.404 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:291, status:SUCCESS 2022-12-08 15:40:07.589 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:292, status:SUCCESS 2022-12-08 15:40:07.595 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:292, status:SUCCESS 2022-12-08 15:40:07.623 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:40:07.777 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:293, status:SUCCESS 2022-12-08 15:40:07.784 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:293, status:SUCCESS 2022-12-08 15:40:07.823 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 294, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:07.923 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:07.928 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:07.945 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=294, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:40:07.808+08:00, endTime=null} 2022-12-08 15:40:08.373 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:08.377 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:08.498 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:40:09.374 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:294, status:SUCCESS 2022-12-08 15:40:09.385 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:294, status:SUCCESS 2022-12-08 15:40:10.615 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:40:10.929 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:13.876 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:40:15.787 INFO 42 --- [pool-ocp-schedules-11,,c0ac6b519de2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:40:15.882 WARN 42 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:16.076 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:16.116 INFO 42 --- [alarm-task-1,,283f39dff65d] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:40:17.886 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 4005 2022-12-08 15:40:17.886 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:40:18.117 WARN 42 --- [alarm-task-1,,283f39dff65d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:18.124 WARN 42 --- [alarm-task-2,,0b6f31bfaeb7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:18.430 WARN 42 --- [pool-ocp-schedules-7,,34779c15cf77] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:18.462 WARN 42 --- [SimpleAsyncTaskExecutor-8974,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:18.490 WARN 42 --- [pool-ocp-schedules-2,,abbf52ad9288] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:19.077 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:19.223 WARN 42 --- [pool-ocp-schedules-13,,66c829f9e524] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:19.887 WARN 42 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:20.121 WARN 42 --- [alarm-task-1,,283f39dff65d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2022-12-08 15:40:20.122 ERROR 42 --- [alarm-task-1,,283f39dff65d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6240 2022-12-08 15:40:20.125 WARN 42 --- [alarm-task-2,,0b6f31bfaeb7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2022-12-08 15:40:20.126 ERROR 42 --- [alarm-task-2,,0b6f31bfaeb7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6247 2022-12-08 15:40:20.464 WARN 42 --- [SimpleAsyncTaskExecutor-8974,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2022-12-08 15:40:20.465 ERROR 42 --- [SimpleAsyncTaskExecutor-8974,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6585 2022-12-08 15:40:20.476 WARN 42 --- [SimpleAsyncTaskExecutor-8994,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:20.503 ERROR 42 --- [SimpleAsyncTaskExecutor-8974,,] .a.i.SimpleAsyncUncaughtExceptionHandler : Unexpected exception occurred invoking async method: public void com.alipay.ocp.service.alarm.schedule.AlarmNotifier.doNotify() org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:448) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:572) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:360) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.core.notification.NotificationFetcher$$EnhancerBySpringCGLIB$$d5f7ca2e.fetchWillBeSentNotification() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmNotifier.doNotify(AlarmNotifier.java:91) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmNotifier$$FastClassBySpringCGLIB$$fcf4f6ff.invoke() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:47) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:274) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:282) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:184) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:402) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6585 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] ... 25 common frames omitted 2022-12-08 15:40:20.589 ERROR 42 --- [pool-ocp-schedules-2,,abbf52ad9288] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.mybatis.spring.MyBatisSystemException: nested exception is org.apache.ibatis.exceptions.PersistenceException: ### Error querying database. Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2007, active 14, maxActive 100, creating 1, createElapseMillis 6621 ### The error may exist in URL [jar:file:/home/admin/ocp-server/lib/ocp-server-4.0.0-20220930.jar!/BOOT-INF/lib/ocp-core-4.0.0-20220930.jar!/sqlmap/meta/OcpHelperDao.xml] ### The error may involve com.alipay.ocp.core.metadb.common.OcpHelperDao.currentTimestamp ### The error occurred while executing a query ### Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2007, active 14, maxActive 100, creating 1, createElapseMillis 6621 at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:92) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.selectOne(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.selectOne(SqlSessionTemplate.java:159) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:87) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy379.currentTimestamp(Unknown Source) ~[na:na] at com.alipay.ocp.service.alarm.service.OcpAlarmSearchService.refreshAlarmHistoryCache(OcpAlarmSearchService.java:264) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmSchedules.refreshAlarmHistoryCache(AlarmSchedules.java:70) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at sun.reflect.GeneratedMethodAccessor639.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) ~[spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.core.thread.TraceDecorator.lambda$decorate$0(TraceDecorator.java:31) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.apache.ibatis.exceptions.PersistenceException: ### Error querying database. Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2007, active 14, maxActive 100, creating 1, createElapseMillis 6621 ### The error may exist in URL [jar:file:/home/admin/ocp-server/lib/ocp-server-4.0.0-20220930.jar!/BOOT-INF/lib/ocp-core-4.0.0-20220930.jar!/sqlmap/meta/OcpHelperDao.xml] ### The error may involve com.alipay.ocp.core.metadb.common.OcpHelperDao.currentTimestamp ### The error occurred while executing a query ### Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2007, active 14, maxActive 100, creating 1, createElapseMillis 6621 at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:149) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:140) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectOne(DefaultSqlSession.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.GeneratedMethodAccessor412.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 21 common frames omitted Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2007, active 14, maxActive 100, creating 1, createElapseMillis 6621 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:82) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.transaction.SpringManagedTransaction.openConnection(SpringManagedTransaction.java:80) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.transaction.SpringManagedTransaction.getConnection(SpringManagedTransaction.java:67) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:337) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:86) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:325) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:156) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:109) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:89) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:147) ~[mybatis-3.5.6.jar!/:3.5.6] ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2007, active 14, maxActive 100, creating 1, createElapseMillis 6621 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:158) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:116) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:79) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 37 common frames omitted 2022-12-08 15:40:20.641 ERROR 42 --- [pool-ocp-schedules-7,,34779c15cf77] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.mybatis.spring.MyBatisSystemException: nested exception is org.apache.ibatis.exceptions.PersistenceException: ### Error querying database. Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6553 ### The error may exist in URL [jar:file:/home/admin/ocp-server/lib/ocp-server-4.0.0-20220930.jar!/BOOT-INF/lib/ocp-core-4.0.0-20220930.jar!/sqlmap/meta/generated/Ocp2AlarmFilterDao.xml] ### The error may involve com.alipay.ocp.core.metadb.generated.mybatis.dao.Ocp2AlarmFilterDao.selectByExample ### The error occurred while executing a query ### Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6553 at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:92) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.selectList(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.selectList(SqlSessionTemplate.java:223) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.executeForMany(MapperMethod.java:147) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:80) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy374.selectByExample(Unknown Source) ~[na:na] at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.sun.proxy.$Proxy375.selectByExample(Unknown Source) ~[na:na] at com.alipay.ocp.service.alarm.service.OcpAlarmFilterService.listByDoExample(OcpAlarmFilterService.java:206) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:200) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.service.OcpAlarmFilterService$$FastClassBySpringCGLIB$$ba56c8f0.invoke() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:685) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.service.OcpAlarmFilterService$$EnhancerBySpringCGLIB$$1c4d9783.listAllActive() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:60) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at sun.reflect.GeneratedMethodAccessor638.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) ~[spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.core.thread.TraceDecorator.lambda$decorate$0(TraceDecorator.java:31) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.apache.ibatis.exceptions.PersistenceException: ### Error querying database. Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6553 ### The error may exist in URL [jar:file:/home/admin/ocp-server/lib/ocp-server-4.0.0-20220930.jar!/BOOT-INF/lib/ocp-core-4.0.0-20220930.jar!/sqlmap/meta/generated/Ocp2AlarmFilterDao.xml] ### The error may involve com.alipay.ocp.core.metadb.generated.mybatis.dao.Ocp2AlarmFilterDao.selectByExample ### The error occurred while executing a query ### Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6553 at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:149) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:140) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.GeneratedMethodAccessor329.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 38 common frames omitted Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6553 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:82) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.transaction.SpringManagedTransaction.openConnection(SpringManagedTransaction.java:80) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.transaction.SpringManagedTransaction.getConnection(SpringManagedTransaction.java:67) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:337) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:86) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:325) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:156) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:109) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:89) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:147) ~[mybatis-3.5.6.jar!/:3.5.6] ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6553 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:158) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:116) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:79) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 53 common frames omitted 2022-12-08 15:40:21.078 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:21.078 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:21.341 ERROR 42 --- [pool-ocp-schedules-13,,66c829f9e524] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.mybatis.spring.MyBatisSystemException: nested exception is org.apache.ibatis.exceptions.PersistenceException: ### Error querying database. Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 7346 ### The error may exist in URL [jar:file:/home/admin/ocp-server/lib/ocp-server-4.0.0-20220930.jar!/BOOT-INF/lib/ocp-core-4.0.0-20220930.jar!/sqlmap/meta/generated/OcpAlarmChannelDao.xml] ### The error may involve com.alipay.ocp.core.metadb.generated.mybatis.dao.OcpAlarmChannelDao.selectByExample ### The error occurred while executing a query ### Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 7346 at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:92) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.selectList(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.selectList(SqlSessionTemplate.java:223) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.executeForMany(MapperMethod.java:147) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:80) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy456.selectByExample(Unknown Source) ~[na:na] at sun.reflect.GeneratedMethodAccessor549.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.sun.proxy.$Proxy457.selectByExample(Unknown Source) ~[na:na] at com.alipay.ocp.service.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:222) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$8feed5bf.invoke() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:685) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$140b750.listAll() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:84) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:75) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at sun.reflect.GeneratedMethodAccessor637.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) ~[spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.core.thread.TraceDecorator.lambda$decorate$0(TraceDecorator.java:31) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.apache.ibatis.exceptions.PersistenceException: ### Error querying database. Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 7346 ### The error may exist in URL [jar:file:/home/admin/ocp-server/lib/ocp-server-4.0.0-20220930.jar!/BOOT-INF/lib/ocp-core-4.0.0-20220930.jar!/sqlmap/meta/generated/OcpAlarmChannelDao.xml] ### The error may involve com.alipay.ocp.core.metadb.generated.mybatis.dao.OcpAlarmChannelDao.selectByExample ### The error occurred while executing a query ### Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 7346 at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:149) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:140) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.GeneratedMethodAccessor329.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 37 common frames omitted Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 7346 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:82) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.transaction.SpringManagedTransaction.openConnection(SpringManagedTransaction.java:80) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.transaction.SpringManagedTransaction.getConnection(SpringManagedTransaction.java:67) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:337) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:86) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:325) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:156) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:109) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:89) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:147) ~[mybatis-3.5.6.jar!/:3.5.6] ... 42 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 7346 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:158) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:116) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:79) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 52 common frames omitted 2022-12-08 15:40:21.889 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 8011 2022-12-08 15:40:21.889 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:40:22.466 WARN 42 --- [SimpleAsyncTaskExecutor-9015,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:22.477 WARN 42 --- [SimpleAsyncTaskExecutor-8994,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2022-12-08 15:40:22.481 ERROR 42 --- [SimpleAsyncTaskExecutor-8994,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 8599 2022-12-08 15:40:22.487 ERROR 42 --- [SimpleAsyncTaskExecutor-8994,,] .a.i.SimpleAsyncUncaughtExceptionHandler : Unexpected exception occurred invoking async method: public void com.alipay.ocp.service.alarm.schedule.AlarmNotifier.doNotify() org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:448) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:572) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:360) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.core.notification.NotificationFetcher$$EnhancerBySpringCGLIB$$d5f7ca2e.fetchWillBeSentNotification() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmNotifier.doNotify(AlarmNotifier.java:91) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmNotifier$$FastClassBySpringCGLIB$$fcf4f6ff.invoke() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:47) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:274) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:282) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:184) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:402) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 8599 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] ... 25 common frames omitted 2022-12-08 15:40:23.079 WARN 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:24.004 WARN 42 --- [pool-9-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:24.469 WARN 42 --- [SimpleAsyncTaskExecutor-9015,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2022-12-08 15:40:24.469 ERROR 42 --- [SimpleAsyncTaskExecutor-9015,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 13, maxActive 100, creating 1, createElapseMillis 10590 2022-12-08 15:40:24.470 WARN 42 --- [SimpleAsyncTaskExecutor-9036,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:24.473 ERROR 42 --- [SimpleAsyncTaskExecutor-9015,,] .a.i.SimpleAsyncUncaughtExceptionHandler : Unexpected exception occurred invoking async method: public void com.alipay.ocp.service.alarm.schedule.AlarmNotifier.doNotify() org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:448) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:572) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:360) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.core.notification.NotificationFetcher$$EnhancerBySpringCGLIB$$d5f7ca2e.fetchWillBeSentNotification() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmNotifier.doNotify(AlarmNotifier.java:91) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmNotifier$$FastClassBySpringCGLIB$$fcf4f6ff.invoke() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:47) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:274) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:282) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:184) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:402) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 13, maxActive 100, creating 1, createElapseMillis 10590 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] ... 25 common frames omitted 2022-12-08 15:40:25.080 WARN 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2022-12-08 15:40:25.081 ERROR 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 13, maxActive 100, creating 1, createElapseMillis 11202 2022-12-08 15:40:25.121 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:448) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:572) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:360) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:139) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:178) ~[spring-data-jpa-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.sun.proxy.$Proxy336.saveAndFlush(Unknown Source) ~[na:na] at com.alipay.ocp.core.sharding.registry.ConsumerRegistry.refreshConsumer(ConsumerRegistry.java:151) ~[ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.Optional.map(Optional.java:215) ~[na:1.8.0_312] at com.alipay.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:89) ~[ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:47) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:274) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:282) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:184) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:402) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 13, maxActive 100, creating 1, createElapseMillis 11202 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] ... 31 common frames omitted 2022-12-08 15:40:25.276 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:25.277 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:25.361 WARN 42 --- [SimpleAsyncTaskExecutor-8932,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:25.788 INFO 42 --- [pool-ocp-schedules-16,,1e5c435875da] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:40:26.005 WARN 42 --- [pool-9-thread-1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2022-12-08 15:40:26.006 ERROR 42 --- [pool-9-thread-1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 13, maxActive 100, creating 1, createElapseMillis 12127 2022-12-08 15:40:26.011 ERROR 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing PLAN_CHANGE_DETECTOR org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:448) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:572) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:360) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$6a70c9aa.getNextExecution() ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:139) ~[ocp-perf-sql-diag-pipeline-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:47) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:274) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:282) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:184) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:402) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 17 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 13, maxActive 100, creating 1, createElapseMillis 12127 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] ... 24 common frames omitted 2022-12-08 15:40:26.074 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:40:26.220 WARN 42 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 4012, SQLState: HY000 2022-12-08 15:40:26.220 WARN 42 --- [pool-subtask-coordinator4,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 4012, SQLState: HY000 2022-12-08 15:40:26.220 ERROR 42 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : (conn=506) Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. 2022-12-08 15:40:26.220 ERROR 42 --- [pool-subtask-coordinator4,,] o.h.engine.jdbc.spi.SqlExceptionHelper : (conn=503) Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. 2022-12-08 15:40:26.222 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:26.222 WARN 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 4012, SQLState: HY000 2022-12-08 15:40:26.225 ERROR 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] o.h.engine.jdbc.spi.SqlExceptionHelper : (conn=663) Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. 2022-12-08 15:40:27.362 WARN 42 --- [SimpleAsyncTaskExecutor-8932,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2022-12-08 15:40:27.363 ERROR 42 --- [SimpleAsyncTaskExecutor-8932,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 13, maxActive 100, creating 1, createElapseMillis 13484 2022-12-08 15:40:27.368 ERROR 42 --- [SimpleAsyncTaskExecutor-8932,,] .a.i.SimpleAsyncUncaughtExceptionHandler : Unexpected exception occurred invoking async method: public void com.alipay.ocp.service.alarm.schedule.AlarmNotifier.doNotify() org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:448) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:572) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:360) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.core.notification.NotificationFetcher$$EnhancerBySpringCGLIB$$d5f7ca2e.fetchWillBeSentNotification() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmNotifier.doNotify(AlarmNotifier.java:91) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmNotifier$$FastClassBySpringCGLIB$$fcf4f6ff.invoke() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:47) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:274) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:282) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:184) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:402) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 13, maxActive 100, creating 1, createElapseMillis 13484 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] ... 25 common frames omitted 2022-12-08 15:40:28.075 WARN 42 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:28.230 WARN 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 15:40:28.494 ERROR 42 --- [pool-ocp-schedules-10,,7e1a97ba9ade] c.a.o.s.a.utils.task.AlarmTaskManager : refresh failed, exception: org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=2097440) Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. ### The error may exist in URL [jar:file:/home/admin/ocp-server/lib/ocp-server-4.0.0-20220930.jar!/BOOT-INF/lib/ocp-core-4.0.0-20220930.jar!/sqlmap/meta/generated/OcpGlobalTaskDao.xml] ### The error may involve com.alipay.ocp.core.metadb.generated.mybatis.dao.OcpGlobalTaskDao.updateByExampleSelective-Inline ### The error occurred while setting parameters ### SQL: update ocp_global_task SET status = ?, executor_name = ?, result = ? WHERE ( status = ? and heartbeat_at < ? ) ### Cause: java.sql.SQLTransientConnectionException: (conn=2097440) Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. ; (conn=2097440) Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again.; nested exception is java.sql.SQLTransientConnectionException: (conn=2097440) Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.update(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.update(SqlSessionTemplate.java:287) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:67) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy452.updateByExampleSelective(Unknown Source) ~[na:na] at sun.reflect.GeneratedMethodAccessor620.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.sun.proxy.$Proxy453.updateByExampleSelective(Unknown Source) ~[na:na] at com.alipay.ocp.service.alarm.service.TaskRepositoryService.markNoHeartbeatToFailed(TaskRepositoryService.java:165) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.service.TaskRepositoryService$$FastClassBySpringCGLIB$$656a326e.invoke() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:685) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.service.TaskRepositoryService$$EnhancerBySpringCGLIB$$92feb2bd.markNoHeartbeatToFailed() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.utils.task.AlarmTaskManager.checkNoHeartbeat(AlarmTaskManager.java:179) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.utils.task.AlarmTaskManager.refresh(AlarmTaskManager.java:52) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmSchedules.refreshAlarmTaskManager(AlarmSchedules.java:85) [ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at sun.reflect.GeneratedMethodAccessor657.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) [spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) [spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.core.thread.TraceDecorator.lambda$decorate$0(TraceDecorator.java:31) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: java.sql.SQLTransientConnectionException: (conn=2097440) Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.2.8.jar!/:1.2.8] at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.GeneratedMethodAccessor576.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 37 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 49 common frames omitted Caused by: java.sql.SQLException: Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 50 common frames omitted 2022-12-08 15:40:29.136 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=cancel_subtask_worker 2022-12-08 15:40:29.137 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2022-12-08 15:40:29.152 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:29.152 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:29.173 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:39:21.0, nextRun=2022-12-08 15:40:20.0, currentDate=Thu Dec 08 15:40:29 CST 2022 2022-12-08 15:40:29.174 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:39:21.0, nextRunTime=2022-12-08 15:40:20.0} 2022-12-08 15:40:29.199 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:40:29.200 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:29.200 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:29.223 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:29.228 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:29.272 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:39:55+08:00, updateTime=2022-12-08T15:39:55+08:00, expireTime=null, isLeader=false} 2022-12-08 15:40:29.343 WARN 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. org.springframework.dao.DataAccessResourceFailureException: could not extract ResultSet; nested exception is org.hibernate.exception.JDBCConnectionException: could not extract ResultSet at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:277) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:255) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:528) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:153) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:149) ~[spring-data-jpa-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.sun.proxy.$Proxy349.findAllIdByState(Unknown Source) ~[na:na] at com.alipay.ocp.core.task.engine.coordinator.worker.RunningTaskWorker.work(RunningTaskWorker.java:67) ~[ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:94) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:66) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.hibernate.exception.JDBCConnectionException: could not extract ResultSet at org.hibernate.exception.internal.SQLExceptionTypeDelegate.convert(SQLExceptionTypeDelegate.java:48) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:67) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.loader.Loader.getResultSet(Loader.java:2303) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2056) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2018) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.loader.Loader.doQuery(Loader.java:948) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:349) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.loader.Loader.doList(Loader.java:2849) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.loader.Loader.doList(Loader.java:2831) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2663) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.loader.Loader.list(Loader.java:2658) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:506) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:219) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1414) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1625) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1593) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.query.Query.getResultList(Query.java:165) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at sun.reflect.GeneratedMethodAccessor372.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:409) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.sun.proxy.$Proxy543.getResultList(Unknown Source) ~[na:na] at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:126) ~[spring-data-jpa-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:88) ~[spring-data-jpa-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:154) ~[spring-data-jpa-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:142) ~[spring-data-jpa-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor$QueryMethodInvoker.invoke(QueryExecutorMethodInterceptor.java:195) ~[spring-data-commons-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:152) ~[spring-data-commons-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:130) ~[spring-data-commons-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:80) ~[spring-data-commons-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:366) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:139) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 17 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=663) Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:126) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:200) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:310) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:239) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:159) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeQuery(JDBC4PreparedStatement.java:173) ~[oceanbase-client-2.2.8.jar!/:na] at com.alibaba.druid.pool.DruidPooledPreparedStatement.executeQuery(DruidPooledPreparedStatement.java:227) ~[druid-1.2.8.jar!/:1.2.8] at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:57) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] ... 52 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:80) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:190) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:171) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:352) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:230) ~[oceanbase-client-2.2.8.jar!/:na] ... 56 common frames omitted Caused by: java.sql.SQLException: Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1990) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1855) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1748) ~[oceanbase-client-2.2.8.jar!/:na] at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:349) ~[oceanbase-client-2.2.8.jar!/:na] ... 57 common frames omitted 2022-12-08 15:40:29.362 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:38:54+08:00, updateTime=2022-12-08T15:39:54+08:00, expireTime=null, isLeader=false} 2022-12-08 15:40:29.380 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:39:25.0, nextRun=2022-12-08 15:40:25.0, currentDate=Thu Dec 08 15:40:29 CST 2022 2022-12-08 15:40:29.381 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:39:25.0, nextRunTime=2022-12-08 15:40:25.0} 2022-12-08 15:40:29.423 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:40:29.424 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:29.424 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:29.610 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:40:29.616 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:40:29.657 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:37:25+08:00, updateTime=2022-12-08T15:39:55+08:00, expireTime=null, isLeader=false} 2022-12-08 15:40:29.824 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:40:29.917 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PERF_SQL_ROLLUP, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:24:49+08:00, updateTime=2022-12-08T15:39:58+08:00, expireTime=null, isLeader=false} 2022-12-08 15:40:30.256 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 295, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:30.278 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:40:30.363 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=295, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:40:30.245+08:00, endTime=null} 2022-12-08 15:40:30.373 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:40:30.382 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:40:30.439 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 296, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:30.452 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:40:30.461 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:40:30.518 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=296, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:40:30.420+08:00, endTime=null} 2022-12-08 15:40:30.555 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:40:30.566 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:40:31.043 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:295, status:SUCCESS 2022-12-08 15:40:31.049 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:295, status:SUCCESS 2022-12-08 15:40:31.087 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:39:32.0, nextRun=2022-12-08 15:40:30.0, currentDate=Thu Dec 08 15:40:31 CST 2022 2022-12-08 15:40:31.087 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:39:32.0, nextRunTime=2022-12-08 15:40:30.0} 2022-12-08 15:40:31.107 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:40:31.410 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:04.0, nextRun=2022-12-08 15:40:30.0, currentDate=Thu Dec 08 15:40:31 CST 2022 2022-12-08 15:40:31.410 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:40:04.0, nextRunTime=2022-12-08 15:40:30.0} 2022-12-08 15:40:31.430 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:40:31.430 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:40:31.430 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:40:31.467 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:296, status:SUCCESS 2022-12-08 15:40:31.474 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:296, status:SUCCESS 2022-12-08 15:40:31.623 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 297, operation:EXECUTE, state: RUNNING 2022-12-08 15:40:31.718 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=297, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:40:31.609+08:00, endTime=null} 2022-12-08 15:40:31.890 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:40:32.229 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:32.233 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:32.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:32.300 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:32.396 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:40:32.838 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:297, status:SUCCESS 2022-12-08 15:40:32.848 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:297, status:SUCCESS 2022-12-08 15:40:32.887 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:40:32.898 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PERF_SQL_ROLLUP, Incorrect result size: expected 1, actual 0 2022-12-08 15:40:35.234 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:35.239 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:35.327 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:35.327 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:35.340 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:35.341 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:35.789 INFO 42 --- [pool-ocp-schedules-13,,2e28b9691a12] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:40:37.628 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:40:37.634 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:40:38.239 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:38.245 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:38.403 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:38.404 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:38.730 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:40:39.280 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:40:39.824 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:40:40.278 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:40:40.448 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:40:41.246 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:41.253 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:41.450 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:41.450 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:41.484 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:41.485 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:41.924 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:40:43.950 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:40:43.956 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:40:44.254 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:44.259 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:44.515 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:44.532 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:45.077 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:40:45.459 INFO 42 --- [pool-ocp-schedules-18,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 15:40:45.472 INFO 42 --- [pool-ocp-schedules-7,,92102c86194d] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:40:45.507 INFO 42 --- [pool-ocp-schedules-7,,92102c86194d] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:40:45.678 INFO 42 --- [pool-ocp-schedules-17,,aa83059382a4] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:40:45.790 INFO 42 --- [pool-ocp-schedules-16,,073d5ed8e4c5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:40:45.814 INFO 42 --- [pool-ocp-schedules-4,,fcf7d45450d1] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 15:40:45.937 INFO 42 --- [pool-ocp-schedules-10,,aa5aa14c0701] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:40:47.260 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:47.265 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:47.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:47.666 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:47.668 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:47.668 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:48.189 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:40:48.561 ERROR 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.utils.task.AlarmTaskManager : ExecutionException: java.util.concurrent.ExecutionException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.get(FutureTask.java:206) ~[na:1.8.0_312] at com.alipay.ocp.service.alarm.utils.task.AlarmTaskManager.removeHasDone(AlarmTaskManager.java:142) [ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.utils.task.AlarmTaskManager.refresh(AlarmTaskManager.java:54) [ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmSchedules.refreshAlarmTaskManager(AlarmSchedules.java:85) [ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at sun.reflect.GeneratedMethodAccessor657.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) [spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) [spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.core.thread.TraceDecorator.lambda$decorate$0(TraceDecorator.java:31) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:448) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:572) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:360) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:139) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:178) ~[spring-data-jpa-2.3.7.RELEASE.jar!/:2.3.7.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.sun.proxy.$Proxy373.findAll(Unknown Source) ~[na:na] at com.alipay.ocp.service.alarm.service.OcpAlarmDetectRuleService.getAllAlarmDetectRules(OcpAlarmDetectRuleService.java:56) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.service.OcpAlarmRuleService.listForDetect(OcpAlarmRuleService.java:310) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.service.OcpAlarmRuleService$$FastClassBySpringCGLIB$$79add9ac.invoke() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:685) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.service.OcpAlarmRuleService$$EnhancerBySpringCGLIB$$47751f37.listForDetect() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.core.task.AlarmDetectTask.detect(AlarmDetectTask.java:88) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.core.task.AlarmDetectTask.lambda$processOnce$0(AlarmDetectTask.java:82) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.common.meter.MeterUtils.time(MeterUtils.java:55) ~[ocp-common-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.core.task.AlarmDetectTask.processOnce(AlarmDetectTask.java:82) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.utils.task.AbstractIntervalTask.call(AbstractIntervalTask.java:41) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.utils.task.AbstractIntervalTask.call(AbstractIntervalTask.java:15) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_312] at com.alipay.ocp.core.thread.TraceDecorator.lambda$decorate$0(TraceDecorator.java:31) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] ... 3 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:47) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:480) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at sun.reflect.GeneratedMethodAccessor259.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:282) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:266) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.vendor.HibernateJpaDialect$HibernateConnectionHandle.doGetConnection(HibernateJpaDialect.java:430) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:174) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:402) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 31 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6240 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] ... 41 common frames omitted 2022-12-08 15:40:48.645 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.service.TaskRepositoryService : endTask success, taskUuid=5d1c7c8a-1780-40fe-8c4f-b46ce797f238, status=FAILED, result=org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection 2022-12-08 15:40:48.646 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.utils.task.AlarmTaskManager : end done status task, taskInfo=TaskInfo(id=1, uuid=5d1c7c8a-1780-40fe-8c4f-b46ce797f238, taskType=AlarmDetect, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T07:02:01.539848Z, startAt=2022-12-08T07:25:45.943Z, endAt=null, heartbeatAt=2022-12-08T07:25:45.943Z, result=executing) 2022-12-08 15:40:48.662 ERROR 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.utils.task.AlarmTaskManager : ExecutionException: java.util.concurrent.ExecutionException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.get(FutureTask.java:206) ~[na:1.8.0_312] at com.alipay.ocp.service.alarm.utils.task.AlarmTaskManager.removeHasDone(AlarmTaskManager.java:142) [ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.utils.task.AlarmTaskManager.refresh(AlarmTaskManager.java:54) [ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmSchedules.refreshAlarmTaskManager(AlarmSchedules.java:85) [ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at sun.reflect.GeneratedMethodAccessor657.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) [spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) [spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.core.thread.TraceDecorator.lambda$decorate$0(TraceDecorator.java:31) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:448) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:572) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:360) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.service.OcpAlarmServiceImpl$$EnhancerBySpringCGLIB$$c4de0bcb.resolveByTimeout() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.core.process.AlarmProcessor.process(AlarmProcessor.java:108) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.common.meter.MeterUtils.time(MeterUtils.java:55) ~[ocp-common-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.core.task.AlarmProcessTask.processOnce(AlarmProcessTask.java:40) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.utils.task.AbstractIntervalTask.call(AbstractIntervalTask.java:41) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.utils.task.AbstractIntervalTask.call(AbstractIntervalTask.java:15) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_312] at com.alipay.ocp.core.thread.TraceDecorator.lambda$decorate$0(TraceDecorator.java:31) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] ... 3 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:47) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:274) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:282) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:184) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:402) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 19 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 14, maxActive 100, creating 1, createElapseMillis 6247 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] ... 26 common frames omitted 2022-12-08 15:40:48.718 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.service.TaskRepositoryService : endTask success, taskUuid=142cf501-1f3a-4dfd-adba-cf2d83e0b467, status=FAILED, result=org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection 2022-12-08 15:40:48.719 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.utils.task.AlarmTaskManager : end done status task, taskInfo=TaskInfo(id=2, uuid=142cf501-1f3a-4dfd-adba-cf2d83e0b467, taskType=AlarmProcess, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T07:02:01.647237Z, startAt=2022-12-08T07:25:45.943Z, endAt=null, heartbeatAt=2022-12-08T07:25:45.943Z, result=executing) 2022-12-08 15:40:48.719 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.utils.task.AlarmTaskManager : remove completed tasks, totalCount=0, doneCount=2 2022-12-08 15:40:48.734 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.service.TaskRepositoryService : fetchNeedExecute, tryAcquireTasksCount=2, fetchedCount=2 2022-12-08 15:40:48.766 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.alarm.core.task.AlarmDetectTask : AlarmDetectTask created 2022-12-08 15:40:48.766 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=1, uuid=5d1c7c8a-1780-40fe-8c4f-b46ce797f238, taskType=AlarmDetect, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T07:02:01.539848Z, startAt=2022-12-08T07:40:48.721Z, endAt=null, heartbeatAt=2022-12-08T07:40:48.721Z, result=executing) 2022-12-08 15:40:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:40:48.831 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100000, channelName=钉钉群消息样例 2022-12-08 15:40:48.831 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=钉钉群消息样例 2022-12-08 15:40:48.843 INFO 42 --- [pool-ocp-schedules-15,,54fcb54ef68b] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:40:48.873 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.c.aggregate.AggregatorFactory : createAggregator, channelId=100001, channelName=自定义脚本通道(待配置样例) 2022-12-08 15:40:48.874 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.u.f.VersionalProductFactory : create done, key=自定义脚本通道(待配置样例) 2022-12-08 15:40:48.874 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.u.f.VersionalProductFactory : refresh done, configCount=2, updatedCount=2, failedToUpdateCount=0 2022-12-08 15:40:48.879 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.core.process.AlarmProcessor : AlarmProcessor init done, lastProcessTime=2022-12-08T15:40:48.876266+08:00 2022-12-08 15:40:48.880 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.core.task.AlarmProcessTask : AlarmProcessTask created 2022-12-08 15:40:48.880 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=2, uuid=142cf501-1f3a-4dfd-adba-cf2d83e0b467, taskType=AlarmProcess, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=192.168.28.62:42, createAt=2022-12-08T07:02:01.647237Z, startAt=2022-12-08T07:40:48.721Z, endAt=null, heartbeatAt=2022-12-08T07:40:48.721Z, result=executing) 2022-12-08 15:40:48.880 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.utils.task.AlarmTaskManager : startNeedExecute, activeCount=0, tryStartCount=2, startedCount=2 2022-12-08 15:40:48.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:40:48.907540+08:00, lastProcessTime=2022-12-08T15:40:48.876266+08:00 2022-12-08 15:40:48.926 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:40:48.927 INFO 42 --- [pool-ocp-schedules-7,,bc46e818332c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:40:49.137 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:40:48.907540+08:00, resultsCount=0 2022-12-08 15:40:49.138 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:40:48.907540+08:00, resultsCount=0 2022-12-08 15:40:49.138 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:40:48.907540+08:00 2022-12-08 15:40:49.261 INFO 42 --- [pool-ocp-schedules-11,,5aa93855fa2e] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:40:49.373 INFO 42 --- [pool-ocp-schedules-16,,87fe795ffb46] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:40:49.463 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:40:49.798 INFO 42 --- [pool-ocp-schedules-8,,a1e609908ce2] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:40:49.801 INFO 42 --- [pool-ocp-schedules-8,,a1e609908ce2] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:40:49.802 INFO 42 --- [pool-ocp-schedules-8,,a1e609908ce2] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:40:49.868 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:40:50.266 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:50.272 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:50.448 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:40:50.495 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:40:50.502 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:40:50.505 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:40:50.747 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:50.750 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:51.138 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:40:51.968 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:40:53.273 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:53.284 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:53.848 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:53.849 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:53.863 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:40:53.864 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:40:55.791 INFO 42 --- [pool-ocp-schedules-2,,0daa7f47bd17] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:40:56.284 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:56.288 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:56.296 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:40:56.301 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:40:57.218 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:57.220 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:40:57.402 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:40:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,a48c47fa0dae] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:40:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,a48c47fa0dae] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:40:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:40:58.813 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:40:58.809234+08:00, lastProcessTime=2022-12-08T15:40:48.907540+08:00 2022-12-08 15:40:58.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:40:58.809234+08:00, resultsCount=0 2022-12-08 15:40:58.923 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:40:58.809234+08:00, resultsCount=0 2022-12-08 15:40:58.923 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:40:58.809234+08:00 2022-12-08 15:40:59.289 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:40:59.294 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:40:59.507 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:40:59.906 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:41:00.317 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:00.318 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:00.319 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:00.319 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:00.452 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:41:00.685 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:01.175 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:41:01.287 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:03.0, nextRun=2022-12-08 15:41:00.0, currentDate=Thu Dec 08 15:41:01 CST 2022 2022-12-08 15:41:01.288 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:40:03.0, nextRunTime=2022-12-08 15:41:00.0} 2022-12-08 15:41:01.305 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:41:01.306 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:41:01.306 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:41:01.334 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:40:30+08:00, updateTime=2022-12-08T15:40:30+08:00, expireTime=null, isLeader=false} 2022-12-08 15:41:01.390 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:40:30+08:00, updateTime=2022-12-08T15:40:30+08:00, expireTime=null, isLeader=false} 2022-12-08 15:41:01.394 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:03.0, nextRun=2022-12-08 15:41:00.0, currentDate=Thu Dec 08 15:41:01 CST 2022 2022-12-08 15:41:01.394 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:40:03.0, nextRunTime=2022-12-08 15:41:00.0} 2022-12-08 15:41:01.401 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:41:01.452 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:41:01.453 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:41:01.453 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:41:01.573 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:41:01.859 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:04.0, nextRun=2022-12-08 15:41:00.0, currentDate=Thu Dec 08 15:41:01 CST 2022 2022-12-08 15:41:01.860 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:40:04.0, nextRunTime=2022-12-08 15:41:00.0} 2022-12-08 15:41:01.891 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:41:01.891 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:41:01.892 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:41:01.927 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:41:01.942 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:41:02.044 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:31.0, nextRun=2022-12-08 15:41:00.0, currentDate=Thu Dec 08 15:41:02 CST 2022 2022-12-08 15:41:02.045 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:40:31.0, nextRunTime=2022-12-08 15:41:00.0} 2022-12-08 15:41:02.062 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:02.070 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:41:02.071 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:41:02.071 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:41:02.167 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 298, operation:EXECUTE, state: RUNNING 2022-12-08 15:41:02.183 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:05.0, nextRun=2022-12-08 15:41:00.0, currentDate=Thu Dec 08 15:41:02 CST 2022 2022-12-08 15:41:02.184 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:40:05.0, nextRunTime=2022-12-08 15:41:00.0} 2022-12-08 15:41:02.218 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:41:02.218 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:41:02.218 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:41:02.258 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=298, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:41:02.152+08:00, endTime=null} 2022-12-08 15:41:02.295 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:02.299 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:02.317 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 299, operation:EXECUTE, state: RUNNING 2022-12-08 15:41:02.419 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=299, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:41:02.306+08:00, endTime=null} 2022-12-08 15:41:02.493 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 300, operation:EXECUTE, state: RUNNING 2022-12-08 15:41:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,4f034b374279] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485320, interval=60 2022-12-08 15:41:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,4f034b374279] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485262, count=0, elapsed=1668814777373 2022-12-08 15:41:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,394854ef7ec6] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485320, interval=60 2022-12-08 15:41:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,394854ef7ec6] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485262, count=0, elapsed=1668814777378 2022-12-08 15:41:02.814 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=300, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:41:02.479+08:00, endTime=null} 2022-12-08 15:41:02.821 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:41:02.827 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:41:03.303 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:41:03.384 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:03.387 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:03.473 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:298, status:SUCCESS 2022-12-08 15:41:03.485 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:298, status:SUCCESS 2022-12-08 15:41:03.545 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:41:03.707 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:299, status:SUCCESS 2022-12-08 15:41:03.713 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:299, status:SUCCESS 2022-12-08 15:41:03.917 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 301, operation:EXECUTE, state: RUNNING 2022-12-08 15:41:03.924 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:300, status:SUCCESS 2022-12-08 15:41:03.931 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:300, status:SUCCESS 2022-12-08 15:41:04.046 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=301, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:41:03.902+08:00, endTime=null} 2022-12-08 15:41:04.132 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 302, operation:EXECUTE, state: RUNNING 2022-12-08 15:41:04.395 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=302, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:41:04.119+08:00, endTime=null} 2022-12-08 15:41:05.038 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:06.0, nextRun=2022-12-08 15:41:05.0, currentDate=Thu Dec 08 15:41:05 CST 2022 2022-12-08 15:41:05.039 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:40:06.0, nextRunTime=2022-12-08 15:41:05.0} 2022-12-08 15:41:05.055 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:41:05.055 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:41:05.056 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:41:05.299 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:05.304 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:05.399 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:301, status:SUCCESS 2022-12-08 15:41:05.408 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:301, status:SUCCESS 2022-12-08 15:41:05.495 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 303, operation:EXECUTE, state: RUNNING 2022-12-08 15:41:05.503 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:302, status:SUCCESS 2022-12-08 15:41:05.512 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:302, status:SUCCESS 2022-12-08 15:41:05.564 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=303, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:41:05.480+08:00, endTime=null} 2022-12-08 15:41:05.793 INFO 42 --- [pool-ocp-schedules-17,,b04dd7492f65] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:41:06.540 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:06.540 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:06.541 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:06.541 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:06.752 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:303, status:SUCCESS 2022-12-08 15:41:06.757 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:303, status:SUCCESS 2022-12-08 15:41:08.305 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:08.310 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:41:08.769 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:41:08.775 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:41:08.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:41:08.797161+08:00, lastProcessTime=2022-12-08T15:40:58.809234+08:00 2022-12-08 15:41:08.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:41:08.797161+08:00, resultsCount=0 2022-12-08 15:41:08.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:41:08.797161+08:00, resultsCount=0 2022-12-08 15:41:08.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:41:08.797161+08:00 2022-12-08 15:41:08.973 INFO 42 --- [pool-ocp-schedules-18,,6c0034aa077b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:41:08.973 INFO 42 --- [pool-ocp-schedules-18,,6c0034aa077b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:41:09.548 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:41:09.597 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:09.619 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:09.864 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:41:10.087 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:41:11.175 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:11.311 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:11.316 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:11.927 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:41:12.088 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:12.668 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:12.668 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:12.706 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:12.706 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:14.316 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:14.321 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:15.018 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:41:15.023 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:41:15.749 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:15.795 INFO 42 --- [pool-ocp-schedules-19,,ec7111aabb39] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:41:15.806 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:16.147 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:41:17.322 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:17.327 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:18.504 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:41:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:41:18.801 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:41:18.798456+08:00, lastProcessTime=2022-12-08T15:41:08.797161+08:00 2022-12-08 15:41:18.838 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:18.839 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:18.865 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:18.865 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:18.925 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:41:18.798456+08:00, resultsCount=0 2022-12-08 15:41:18.925 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:41:18.798456+08:00, resultsCount=0 2022-12-08 15:41:18.926 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:41:18.798456+08:00 2022-12-08 15:41:19.363 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T15:35:18.65, end=2022-12-08T15:40:19.196} 2022-12-08 15:41:19.372 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T15:35:18.663, end=2022-12-08T15:40:19.201} 2022-12-08 15:41:19.391 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:41:19.409 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:41:19.638 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:41:20.262 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:41:20.328 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:20.333 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:21.064 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:29.0, nextRun=2022-12-08 15:41:20.0, currentDate=Thu Dec 08 15:41:21 CST 2022 2022-12-08 15:41:21.065 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:40:29.0, nextRunTime=2022-12-08 15:41:20.0} 2022-12-08 15:41:21.080 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:41:21.081 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:41:21.081 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:41:21.215 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:21.316 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:41:21.323 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:41:21.853 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 304, operation:EXECUTE, state: RUNNING 2022-12-08 15:41:22.025 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:41:22.037 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=304, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:41:21.825+08:00, endTime=null} 2022-12-08 15:41:22.115 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:22.215 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:22.314 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:22.444 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:304, status:SUCCESS 2022-12-08 15:41:22.450 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:304, status:SUCCESS 2022-12-08 15:41:22.638 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:41:23.334 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:23.339 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:25.281 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:25.281 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:25.363 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:25.364 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:25.796 INFO 42 --- [pool-ocp-schedules-16,,df6f0c1ec9ab] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:41:26.307 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:29.0, nextRun=2022-12-08 15:41:25.0, currentDate=Thu Dec 08 15:41:26 CST 2022 2022-12-08 15:41:26.308 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:40:29.0, nextRunTime=2022-12-08 15:41:25.0} 2022-12-08 15:41:26.340 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:26.344 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:26.347 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:41:26.348 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:41:26.348 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:41:27.161 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 305, operation:EXECUTE, state: RUNNING 2022-12-08 15:41:27.193 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=305, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:41:27.149+08:00, endTime=null} 2022-12-08 15:41:27.797 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:41:27.803 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:41:28.316 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:305, status:SUCCESS 2022-12-08 15:41:28.322 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:305, status:SUCCESS 2022-12-08 15:41:28.641 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:28.643 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:41:28.801 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:41:28.797728+08:00, lastProcessTime=2022-12-08T15:41:18.798456+08:00 2022-12-08 15:41:28.882 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:41:28.797728+08:00, resultsCount=0 2022-12-08 15:41:28.882 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:41:28.797728+08:00, resultsCount=0 2022-12-08 15:41:28.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:41:28.797728+08:00 2022-12-08 15:41:28.909 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:41:29.104 INFO 42 --- [pool-ocp-schedules-14,,6f586ea220d8] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:41:29.104 INFO 42 --- [pool-ocp-schedules-14,,6f586ea220d8] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:41:29.345 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:29.351 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:29.677 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:41:30.339 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:41:30.610 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:31.0, nextRun=2022-12-08 15:41:30.0, currentDate=Thu Dec 08 15:41:30 CST 2022 2022-12-08 15:41:30.611 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:40:31.0, nextRunTime=2022-12-08 15:41:30.0} 2022-12-08 15:41:30.634 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:41:30.686 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:41:30.760 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:41:02.0, nextRun=2022-12-08 15:41:30.0, currentDate=Thu Dec 08 15:41:30 CST 2022 2022-12-08 15:41:30.761 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:41:02.0, nextRunTime=2022-12-08 15:41:30.0} 2022-12-08 15:41:30.784 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:41:30.785 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:41:30.785 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:41:31.255 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:31.310 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 306, operation:EXECUTE, state: RUNNING 2022-12-08 15:41:31.364 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=306, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:41:31.299+08:00, endTime=null} 2022-12-08 15:41:31.574 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:41:31.699 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:31.699 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:31.700 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:31.700 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:31.819 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:306, status:SUCCESS 2022-12-08 15:41:31.825 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:306, status:SUCCESS 2022-12-08 15:41:32.054 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:41:32.096 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:41:01+08:00, updateTime=2022-12-08T15:41:01+08:00, expireTime=null, isLeader=false} 2022-12-08 15:41:32.103 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:41:32.138 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:41:32.208 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:32.351 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:32.356 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:33.538 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:41:34.205 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:41:34.211 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:41:34.765 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:34.769 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:35.306 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:41:35.357 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:35.362 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:35.797 INFO 42 --- [pool-ocp-schedules-15,,0b7ef0b679b2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:41:37.849 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:37.849 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:37.850 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:37.850 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:38.364 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:38.368 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:41:38.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:41:38.796193+08:00, lastProcessTime=2022-12-08T15:41:28.797728+08:00 2022-12-08 15:41:38.923 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:41:38.796193+08:00, resultsCount=0 2022-12-08 15:41:38.924 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:41:38.796193+08:00, resultsCount=0 2022-12-08 15:41:38.924 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:41:38.796193+08:00 2022-12-08 15:41:39.721 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:41:40.190 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:41:40.208 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=18ms, period=120000ms 2022-12-08 15:41:40.516 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:41:40.573 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:41:40.579 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:41:41.078 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:41.084 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:41.292 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:41.369 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:41.373 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:41.674 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:41:42.208 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:41:42.272 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:44.167 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:44.168 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:44.182 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:44.183 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:44.373 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:44.378 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:45.470 INFO 42 --- [pool-ocp-schedules-19,,373ff347ef4a] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:41:45.497 INFO 42 --- [pool-ocp-schedules-19,,373ff347ef4a] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:41:45.679 INFO 42 --- [pool-ocp-schedules-14,,1bfaa6a306b6] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:41:45.727 INFO 42 --- [pool-ocp-schedules-1,,a38bbe34ac62] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:41:45.728 INFO 42 --- [pool-ocp-schedules-1,,a38bbe34ac62] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:41:45.798 INFO 42 --- [pool-ocp-schedules-13,,761d369aa3b7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:41:45.941 INFO 42 --- [pool-ocp-schedules-20,,cad3799310f1] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:41:46.912 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:41:46.916 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:41:47.267 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:47.267 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:47.379 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:47.383 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:47.489 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:41:48.606 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:41:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:41:48.805 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:41:48.802227+08:00, lastProcessTime=2022-12-08T15:41:38.796193+08:00 2022-12-08 15:41:48.950 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:41:48.802227+08:00, resultsCount=0 2022-12-08 15:41:48.950 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:41:48.802227+08:00, resultsCount=0 2022-12-08 15:41:48.951 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:41:48.802227+08:00 2022-12-08 15:41:49.268 INFO 42 --- [pool-ocp-schedules-8,,1324e9cc556c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:41:49.268 INFO 42 --- [pool-ocp-schedules-8,,1324e9cc556c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:41:49.271 INFO 42 --- [pool-ocp-schedules-9,,769fcc524fc4] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:41:49.433 INFO 42 --- [pool-ocp-schedules-11,,2c1ceb5cff21] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:41:49.513 INFO 42 --- [pool-ocp-schedules-7,,3f49c34ba71e] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:41:49.880 INFO 42 --- [pool-ocp-schedules-16,,79635c3d4dfb] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:41:49.880 INFO 42 --- [pool-ocp-schedules-16,,79635c3d4dfb] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:41:49.881 INFO 42 --- [pool-ocp-schedules-16,,79635c3d4dfb] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:41:50.125 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:41:50.318 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:50.318 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:50.318 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:50.318 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:50.384 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:50.388 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:50.563 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:41:51.360 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:52.243 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:41:52.314 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:41:52.836 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:41:52.841 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:41:53.369 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:53.388 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:53.395 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:41:53.398 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:53.945 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:41:55.799 INFO 42 --- [pool-ocp-schedules-8,,10646a8cbf76] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:41:56.399 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:56.404 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:56.428 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:56.429 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:56.486 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:41:56.487 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:41:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,b5daeacc0d60] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:41:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,b5daeacc0d60] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:41:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:41:58.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:41:58.795222+08:00, lastProcessTime=2022-12-08T15:41:48.802227+08:00 2022-12-08 15:41:58.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:41:58.795222+08:00, resultsCount=0 2022-12-08 15:41:58.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:41:58.795222+08:00, resultsCount=0 2022-12-08 15:41:58.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:41:58.795222+08:00 2022-12-08 15:41:59.405 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:41:59.410 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:41:59.592 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:41:59.598 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:42:00.000 INFO 42 --- [pool-ocp-schedules-11,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:42:00.161 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:42:00.605 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:42:00.734 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:42:00.758 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:02.0, nextRun=2022-12-08 15:42:00.0, currentDate=Thu Dec 08 15:42:00 CST 2022 2022-12-08 15:42:00.759 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:40:02.0, nextRunTime=2022-12-08 15:42:00.0} 2022-12-08 15:42:00.785 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:42:00.869 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:41:01.0, nextRun=2022-12-08 15:42:00.0, currentDate=Thu Dec 08 15:42:00 CST 2022 2022-12-08 15:42:00.870 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:41:01.0, nextRunTime=2022-12-08 15:42:00.0} 2022-12-08 15:42:00.890 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:42:00.890 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:42:00.891 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:42:01.012 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:41:01.0, nextRun=2022-12-08 15:42:00.0, currentDate=Thu Dec 08 15:42:01 CST 2022 2022-12-08 15:42:01.013 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:41:01.0, nextRunTime=2022-12-08 15:42:00.0} 2022-12-08 15:42:01.040 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:42:01.040 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:42:01.040 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:42:01.102 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:41:02.0, nextRun=2022-12-08 15:42:00.0, currentDate=Thu Dec 08 15:42:01 CST 2022 2022-12-08 15:42:01.103 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:41:02.0, nextRunTime=2022-12-08 15:42:00.0} 2022-12-08 15:42:01.131 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:42:01.132 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:42:01.132 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:42:01.480 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:41:31.0, nextRun=2022-12-08 15:42:00.0, currentDate=Thu Dec 08 15:42:01 CST 2022 2022-12-08 15:42:01.481 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:41:31.0, nextRunTime=2022-12-08 15:42:00.0} 2022-12-08 15:42:01.496 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:42:01.497 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:42:01.497 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:42:01.587 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:01.651 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:41:02.0, nextRun=2022-12-08 15:42:00.0, currentDate=Thu Dec 08 15:42:01 CST 2022 2022-12-08 15:42:01.652 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:41:02.0, nextRunTime=2022-12-08 15:42:00.0} 2022-12-08 15:42:01.671 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:42:01.671 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:42:01.671 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:42:01.675 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:42:01.824 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 307, operation:EXECUTE, state: RUNNING 2022-12-08 15:42:02.026 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=307, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:42:01.810+08:00, endTime=null} 2022-12-08 15:42:02.106 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 308, operation:EXECUTE, state: RUNNING 2022-12-08 15:42:02.138 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:42:02.194 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=308, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:42:02.094+08:00, endTime=null} 2022-12-08 15:42:02.284 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:42:02.296 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 309, operation:EXECUTE, state: RUNNING 2022-12-08 15:42:02.369 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:02.377 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=309, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:42:02.263+08:00, endTime=null} 2022-12-08 15:42:02.413 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:02.420 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:02.492 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 310, operation:EXECUTE, state: RUNNING 2022-12-08 15:42:02.575 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=310, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:42:02.447+08:00, endTime=null} 2022-12-08 15:42:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,a12216edd252] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485380, interval=60 2022-12-08 15:42:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,a12216edd252] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485322, count=0, elapsed=1668814837314 2022-12-08 15:42:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,336ca34f26de] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485380, interval=60 2022-12-08 15:42:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,336ca34f26de] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485322, count=0, elapsed=1668814837318 2022-12-08 15:42:02.688 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 311, operation:EXECUTE, state: RUNNING 2022-12-08 15:42:02.776 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=311, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:42:02.673+08:00, endTime=null} 2022-12-08 15:42:03.387 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:03.405 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:03.724 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:307, status:SUCCESS 2022-12-08 15:42:03.730 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:307, status:SUCCESS 2022-12-08 15:42:03.810 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:42:03.905 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:308, status:SUCCESS 2022-12-08 15:42:03.906 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:42:03.916 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:308, status:SUCCESS 2022-12-08 15:42:04.019 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:309, status:SUCCESS 2022-12-08 15:42:04.024 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:309, status:SUCCESS 2022-12-08 15:42:04.092 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:310, status:SUCCESS 2022-12-08 15:42:04.099 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:310, status:SUCCESS 2022-12-08 15:42:04.190 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:311, status:SUCCESS 2022-12-08 15:42:04.195 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:311, status:SUCCESS 2022-12-08 15:42:05.033 INFO 42 --- [pool-ocp-schedules-11,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:42:05.356 INFO 42 --- [pool-ocp-schedules-11,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:42:05.461 INFO 42 --- [pool-ocp-schedules-11,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:42:05.542 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:05.800 INFO 42 --- [pool-ocp-schedules-13,,30b76146f6f4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:42:05.801 INFO 42 --- [pool-ocp-schedules-11,,] o.s.boot.SpringApplication : Started application in 5.756 seconds (JVM running for 1322.647) 2022-12-08 15:42:06.175 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:41:05.0, nextRun=2022-12-08 15:42:05.0, currentDate=Thu Dec 08 15:42:06 CST 2022 2022-12-08 15:42:06.176 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:41:05.0, nextRunTime=2022-12-08 15:42:05.0} 2022-12-08 15:42:06.191 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:42:06.191 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:42:06.192 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:42:06.809 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:06.809 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:06.809 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:06.809 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:06.911 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 312, operation:EXECUTE, state: RUNNING 2022-12-08 15:42:07.075 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=312, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:42:06.883+08:00, endTime=null} 2022-12-08 15:42:07.616 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:312, status:SUCCESS 2022-12-08 15:42:07.622 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:312, status:SUCCESS 2022-12-08 15:42:07.865 INFO 42 --- [pool-ocp-schedules-11,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:42:07.865+08:00 2022-12-08 15:42:08.549 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:08.557 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:42:08.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:42:08.794348+08:00, lastProcessTime=2022-12-08T15:41:58.795222+08:00 2022-12-08 15:42:08.935 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:42:08.794348+08:00, resultsCount=0 2022-12-08 15:42:08.935 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:42:08.794348+08:00, resultsCount=0 2022-12-08 15:42:08.935 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:42:08.794348+08:00 2022-12-08 15:42:09.091 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:42:09.097 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:42:09.392 INFO 42 --- [pool-ocp-schedules-19,,d1fb1bed225d] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:42:09.393 INFO 42 --- [pool-ocp-schedules-19,,d1fb1bed225d] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:42:10.074 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:10.075 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:10.193 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:42:10.608 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:42:10.687 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:42:11.558 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:11.562 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:11.675 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:12.369 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:42:12.469 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:13.187 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:13.188 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:13.188 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:13.189 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:14.563 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:14.567 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:15.527 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:42:15.533 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:42:15.801 INFO 42 --- [pool-ocp-schedules-12,,4f2f9d547d53] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:42:16.235 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:16.263 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:16.643 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:42:17.568 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:17.573 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:42:18.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:42:18.791874+08:00, lastProcessTime=2022-12-08T15:42:08.794348+08:00 2022-12-08 15:42:18.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:42:18.791874+08:00, resultsCount=0 2022-12-08 15:42:18.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:42:18.791874+08:00, resultsCount=0 2022-12-08 15:42:18.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:42:18.791874+08:00 2022-12-08 15:42:18.969 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:42:19.370 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:19.370 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:19.371 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:19.371 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:20.574 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:20.581 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:20.655 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:42:20.745 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:42:20.974 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:41:21.0, nextRun=2022-12-08 15:42:20.0, currentDate=Thu Dec 08 15:42:20 CST 2022 2022-12-08 15:42:20.975 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:41:21.0, nextRunTime=2022-12-08 15:42:20.0} 2022-12-08 15:42:20.993 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:42:20.993 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:42:20.994 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:42:21.315 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 313, operation:EXECUTE, state: RUNNING 2022-12-08 15:42:21.340 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=313, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:42:21.304+08:00, endTime=null} 2022-12-08 15:42:21.811 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:42:21.817 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:42:21.840 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:22.268 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:313, status:SUCCESS 2022-12-08 15:42:22.275 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:313, status:SUCCESS 2022-12-08 15:42:22.437 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:22.438 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:22.469 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:42:22.523 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:22.624 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:42:23.582 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:23.587 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:25.521 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:25.522 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:25.538 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:25.538 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:25.803 INFO 42 --- [pool-ocp-schedules-14,,b5d08edb4776] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:42:26.565 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:36:21.649, end=2022-12-08T15:40:26.095} 2022-12-08 15:42:26.588 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:26.594 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:26.608 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:42:26.661 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:41:26.0, nextRun=2022-12-08 15:42:25.0, currentDate=Thu Dec 08 15:42:26 CST 2022 2022-12-08 15:42:26.662 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:41:26.0, nextRunTime=2022-12-08 15:42:25.0} 2022-12-08 15:42:26.716 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:42:26.717 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:42:26.717 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:42:27.492 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 314, operation:EXECUTE, state: RUNNING 2022-12-08 15:42:27.537 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=314, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:42:27.478+08:00, endTime=null} 2022-12-08 15:42:27.861 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:42:27.865 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:42:28.401 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:314, status:SUCCESS 2022-12-08 15:42:28.409 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:314, status:SUCCESS 2022-12-08 15:42:28.597 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:28.626 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:28.705 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:42:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:42:28.803 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:42:28.800406+08:00, lastProcessTime=2022-12-08T15:42:18.791874+08:00 2022-12-08 15:42:28.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:42:28.800406+08:00, resultsCount=0 2022-12-08 15:42:28.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:42:28.800406+08:00, resultsCount=0 2022-12-08 15:42:28.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:42:28.800406+08:00 2022-12-08 15:42:29.486 INFO 42 --- [pool-ocp-schedules-6,,5cd6ef5373c8] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:42:29.487 INFO 42 --- [pool-ocp-schedules-6,,5cd6ef5373c8] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:42:29.595 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:29.598 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:30.748 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:42:30.774 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:42:31.063 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:42:31.279 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:41:31.0, nextRun=2022-12-08 15:42:30.0, currentDate=Thu Dec 08 15:42:31 CST 2022 2022-12-08 15:42:31.280 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:41:31.0, nextRunTime=2022-12-08 15:42:30.0} 2022-12-08 15:42:31.316 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:42:31.449 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:01.0, nextRun=2022-12-08 15:42:30.0, currentDate=Thu Dec 08 15:42:31 CST 2022 2022-12-08 15:42:31.449 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:42:01.0, nextRunTime=2022-12-08 15:42:30.0} 2022-12-08 15:42:31.466 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:42:31.466 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:42:31.466 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:42:31.652 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:31.653 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:31.660 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 315, operation:EXECUTE, state: RUNNING 2022-12-08 15:42:31.676 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:31.676 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:31.736 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=315, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:42:31.648+08:00, endTime=null} 2022-12-08 15:42:31.752 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:42:32.094 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:32.263 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:42:32.341 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:315, status:SUCCESS 2022-12-08 15:42:32.348 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:315, status:SUCCESS 2022-12-08 15:42:32.524 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:42:32.599 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:32.604 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:32.613 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:33.996 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:42:34.002 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:42:34.087 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:42:34.741 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:34.783 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:35.109 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:42:35.605 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:35.611 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:35.804 INFO 42 --- [pool-ocp-schedules-14,,390cfcee1ad8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:42:37.783 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:37.783 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:37.822 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:37.822 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:38.611 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:38.617 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:42:38.801 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:42:38.794898+08:00, lastProcessTime=2022-12-08T15:42:28.800406+08:00 2022-12-08 15:42:38.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:42:38.794898+08:00, resultsCount=0 2022-12-08 15:42:38.903 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:42:38.794898+08:00, resultsCount=0 2022-12-08 15:42:38.903 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:42:38.794898+08:00 2022-12-08 15:42:40.422 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:42:40.427 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:42:40.837 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:41.029 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:42:41.184 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:41.185 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:42:41.580 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:42:41.618 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:41.622 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:42.136 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:42.613 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:42:42.814 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:44.178 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:44.178 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:44.365 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:44.366 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:44.623 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:44.628 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:45.476 INFO 42 --- [pool-ocp-schedules-17,,1637ab3bc073] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:42:45.509 INFO 42 --- [pool-ocp-schedules-17,,1637ab3bc073] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:42:45.680 INFO 42 --- [pool-ocp-schedules-3,,a65b5234c50a] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:42:45.806 INFO 42 --- [pool-ocp-schedules-13,,627ff710426a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:42:45.947 INFO 42 --- [pool-ocp-schedules-11,,3974d91ec93f] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:42:47.145 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:42:47.153 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:42:47.373 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:47.432 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:47.629 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:47.633 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:47.799 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:42:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:42:48.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:42:48.794575+08:00, lastProcessTime=2022-12-08T15:42:38.794898+08:00 2022-12-08 15:42:48.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:42:48.794575+08:00, resultsCount=0 2022-12-08 15:42:48.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:42:48.794575+08:00, resultsCount=0 2022-12-08 15:42:48.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:42:48.794575+08:00 2022-12-08 15:42:49.149 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:42:49.392 INFO 42 --- [pool-ocp-schedules-13,,83175183018b] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:42:49.653 INFO 42 --- [pool-ocp-schedules-1,,eb4a9f968a34] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:42:49.681 INFO 42 --- [pool-ocp-schedules-5,,44264c251bdd] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:42:49.682 INFO 42 --- [pool-ocp-schedules-5,,44264c251bdd] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:42:49.697 INFO 42 --- [pool-ocp-schedules-8,,ca5f18d4a0ec] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:42:49.952 INFO 42 --- [pool-ocp-schedules-20,,50c7813c7364] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:42:49.953 INFO 42 --- [pool-ocp-schedules-20,,50c7813c7364] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:42:49.953 INFO 42 --- [pool-ocp-schedules-20,,50c7813c7364] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:42:50.443 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:50.444 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:50.487 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:42:50.487 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:42:50.634 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:50.638 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:51.263 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:42:51.351 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:42:52.174 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:52.814 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:42:52.998 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:42:53.512 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:42:53.518 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:42:53.630 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:42:53.639 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:53.644 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:55.807 INFO 42 --- [pool-ocp-schedules-4,,63471f82d139] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:42:56.645 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:56.650 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:42:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,492eedf33c70] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:42:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,492eedf33c70] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:42:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:42:58.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:42:58.794387+08:00, lastProcessTime=2022-12-08T15:42:48.794575+08:00 2022-12-08 15:42:58.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:42:58.794387+08:00, resultsCount=0 2022-12-08 15:42:58.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:42:58.794387+08:00, resultsCount=0 2022-12-08 15:42:58.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:42:58.794387+08:00 2022-12-08 15:42:59.651 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:42:59.655 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:01.063 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:43:01.109 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:01.0, nextRun=2022-12-08 15:43:00.0, currentDate=Thu Dec 08 15:43:01 CST 2022 2022-12-08 15:43:01.110 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:42:01.0, nextRunTime=2022-12-08 15:43:00.0} 2022-12-08 15:43:01.131 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:43:01.131 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:43:01.132 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:43:01.304 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:40:30+08:00, updateTime=2022-12-08T15:42:30+08:00, expireTime=null, isLeader=false} 2022-12-08 15:43:01.312 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:43:01.353 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:01.0, nextRun=2022-12-08 15:43:00.0, currentDate=Thu Dec 08 15:43:01 CST 2022 2022-12-08 15:43:01.353 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:42:01.0, nextRunTime=2022-12-08 15:43:00.0} 2022-12-08 15:43:01.377 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:43:01.378 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:43:01.378 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:43:01.394 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:43:01.450 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 316, operation:EXECUTE, state: RUNNING 2022-12-08 15:43:01.498 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:01.0, nextRun=2022-12-08 15:43:00.0, currentDate=Thu Dec 08 15:43:01 CST 2022 2022-12-08 15:43:01.499 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:42:01.0, nextRunTime=2022-12-08 15:43:00.0} 2022-12-08 15:43:01.525 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:43:01.530 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:43:01.530 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:43:01.530 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:43:01.565 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=316, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:43:01.434+08:00, endTime=null} 2022-12-08 15:43:01.620 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:31.0, nextRun=2022-12-08 15:43:00.0, currentDate=Thu Dec 08 15:43:01 CST 2022 2022-12-08 15:43:01.621 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:42:31.0, nextRunTime=2022-12-08 15:43:00.0} 2022-12-08 15:43:01.644 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:43:01.645 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:43:01.645 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:43:01.782 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:02.0, nextRun=2022-12-08 15:43:00.0, currentDate=Thu Dec 08 15:43:01 CST 2022 2022-12-08 15:43:01.783 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:42:02.0, nextRunTime=2022-12-08 15:43:00.0} 2022-12-08 15:43:01.804 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:43:01.804 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:43:01.805 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:43:01.816 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:43:02.144 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:316, status:SUCCESS 2022-12-08 15:43:02.151 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:316, status:SUCCESS 2022-12-08 15:43:02.219 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:02.290 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:43:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,22fd4116d7c2] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485440, interval=60 2022-12-08 15:43:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,22fd4116d7c2] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485382, count=0, elapsed=1668814897254 2022-12-08 15:43:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,9785f760afd8] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485440, interval=60 2022-12-08 15:43:02.641 INFO 42 --- [pool-prometheus-minute-schedule-2,,9785f760afd8] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485382, count=0, elapsed=1668814897259 2022-12-08 15:43:02.649 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 320, operation:EXECUTE, state: RUNNING 2022-12-08 15:43:02.656 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:02.660 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:02.908 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=320, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:43:02.636+08:00, endTime=null} 2022-12-08 15:43:02.998 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:43:03.031 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 317, operation:EXECUTE, state: RUNNING 2022-12-08 15:43:03.111 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:03.152 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=317, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:43:02.993+08:00, endTime=null} 2022-12-08 15:43:03.275 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 318, operation:EXECUTE, state: RUNNING 2022-12-08 15:43:03.336 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=318, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:43:03.263+08:00, endTime=null} 2022-12-08 15:43:03.401 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 319, operation:EXECUTE, state: RUNNING 2022-12-08 15:43:03.443 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=319, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:43:03.388+08:00, endTime=null} 2022-12-08 15:43:03.546 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:320, status:SUCCESS 2022-12-08 15:43:03.552 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:320, status:SUCCESS 2022-12-08 15:43:03.710 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:43:04.213 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:43:04.993 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:317, status:SUCCESS 2022-12-08 15:43:05.000 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:317, status:SUCCESS 2022-12-08 15:43:05.115 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:318, status:SUCCESS 2022-12-08 15:43:05.121 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:318, status:SUCCESS 2022-12-08 15:43:05.197 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:319, status:SUCCESS 2022-12-08 15:43:05.204 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:319, status:SUCCESS 2022-12-08 15:43:05.661 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:05.666 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:05.808 INFO 42 --- [pool-ocp-schedules-5,,03e85922c767] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:43:06.225 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:06.0, nextRun=2022-12-08 15:43:05.0, currentDate=Thu Dec 08 15:43:06 CST 2022 2022-12-08 15:43:06.226 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:42:06.0, nextRunTime=2022-12-08 15:43:05.0} 2022-12-08 15:43:06.250 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:43:06.250 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:43:06.251 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:43:06.566 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 321, operation:EXECUTE, state: RUNNING 2022-12-08 15:43:06.675 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=321, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:43:06.548+08:00, endTime=null} 2022-12-08 15:43:08.101 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:321, status:SUCCESS 2022-12-08 15:43:08.108 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:321, status:SUCCESS 2022-12-08 15:43:08.666 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:08.671 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:43:08.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:43:08.790178+08:00, lastProcessTime=2022-12-08T15:42:58.794387+08:00 2022-12-08 15:43:08.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:43:08.790178+08:00, resultsCount=0 2022-12-08 15:43:08.885 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:43:08.790178+08:00, resultsCount=0 2022-12-08 15:43:08.885 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:43:08.790178+08:00 2022-12-08 15:43:09.274 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:43:09.281 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:43:09.375 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:09.375 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:09.762 INFO 42 --- [pool-ocp-schedules-10,,2de2725ad8e7] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:43:09.762 INFO 42 --- [pool-ocp-schedules-10,,2de2725ad8e7] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:43:09.889 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:43:11.498 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:43:11.595 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:43:11.672 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:11.676 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:12.255 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:12.459 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:12.459 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:12.460 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:12.460 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:13.111 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:43:13.183 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:14.677 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:14.683 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:15.158 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:43:15.164 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:43:15.548 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:15.548 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:15.738 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:43:15.809 INFO 42 --- [pool-ocp-schedules-8,,761e8d3e48c6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:43:17.683 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:17.688 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:18.631 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:18.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:18.640 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:18.640 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:43:18.801 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:43:18.797937+08:00, lastProcessTime=2022-12-08T15:43:08.790178+08:00 2022-12-08 15:43:18.931 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:43:18.797937+08:00, resultsCount=0 2022-12-08 15:43:18.932 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:43:18.797937+08:00, resultsCount=0 2022-12-08 15:43:18.932 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:43:18.797937+08:00 2022-12-08 15:43:19.280 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:43:20.270 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:21.0, nextRun=2022-12-08 15:43:20.0, currentDate=Thu Dec 08 15:43:20 CST 2022 2022-12-08 15:43:20.271 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:42:21.0, nextRunTime=2022-12-08 15:43:20.0} 2022-12-08 15:43:20.290 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:43:20.290 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:43:20.291 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:43:20.689 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:20.694 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:20.909 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 322, operation:EXECUTE, state: RUNNING 2022-12-08 15:43:20.987 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:43:20.989 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=322, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:43:20.896+08:00, endTime=null} 2022-12-08 15:43:20.991 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:43:21.534 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:43:21.724 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:21.726 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:21.834 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:43:22.074 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:43:22.474 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:22.521 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:322, status:SUCCESS 2022-12-08 15:43:22.528 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:322, status:SUCCESS 2022-12-08 15:43:23.161 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:43:23.349 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:23.695 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:23.699 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:24.817 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:24.818 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:24.818 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:24.818 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:25.810 INFO 42 --- [pool-ocp-schedules-13,,0d13226fbce1] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:43:26.271 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:27.0, nextRun=2022-12-08 15:43:25.0, currentDate=Thu Dec 08 15:43:26 CST 2022 2022-12-08 15:43:26.272 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:42:27.0, nextRunTime=2022-12-08 15:43:25.0} 2022-12-08 15:43:26.308 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:43:26.309 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:43:26.309 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:43:26.700 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:26.705 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:27.132 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 323, operation:EXECUTE, state: RUNNING 2022-12-08 15:43:27.535 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=323, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:43:27.119+08:00, endTime=null} 2022-12-08 15:43:27.581 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:43:27.588 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:43:27.900 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:27.905 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:28.263 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:43:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:43:28.808 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:43:28.800904+08:00, lastProcessTime=2022-12-08T15:43:18.797937+08:00 2022-12-08 15:43:28.945 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:43:28.800904+08:00, resultsCount=0 2022-12-08 15:43:28.946 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:43:28.800904+08:00, resultsCount=0 2022-12-08 15:43:28.946 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:43:28.800904+08:00 2022-12-08 15:43:29.706 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:29.711 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:29.740 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:323, status:SUCCESS 2022-12-08 15:43:29.746 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:323, status:SUCCESS 2022-12-08 15:43:29.927 INFO 42 --- [pool-ocp-schedules-9,,e79e8ac0dc25] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:43:29.928 INFO 42 --- [pool-ocp-schedules-9,,e79e8ac0dc25] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:43:31.079 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:31.079 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:31.080 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:31.080 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:31.085 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:31.0, nextRun=2022-12-08 15:43:30.0, currentDate=Thu Dec 08 15:43:31 CST 2022 2022-12-08 15:43:31.085 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:42:31.0, nextRunTime=2022-12-08 15:43:30.0} 2022-12-08 15:43:31.113 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:43:31.298 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:43:02.0, nextRun=2022-12-08 15:43:30.0, currentDate=Thu Dec 08 15:43:31 CST 2022 2022-12-08 15:43:31.299 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:43:02.0, nextRunTime=2022-12-08 15:43:30.0} 2022-12-08 15:43:31.325 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:43:31.325 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:43:31.326 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:43:31.401 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:43:31.600 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:43:31.655 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 324, operation:EXECUTE, state: RUNNING 2022-12-08 15:43:31.876 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:43:32.068 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:43:32.081 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=324, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:43:31.640+08:00, endTime=null} 2022-12-08 15:43:32.202 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:41:01+08:00, updateTime=2022-12-08T15:43:01+08:00, expireTime=null, isLeader=false} 2022-12-08 15:43:32.209 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:43:32.354 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:43:32.528 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:32.712 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:32.723 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:33.349 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:43:33.664 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:33.952 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:324, status:SUCCESS 2022-12-08 15:43:33.957 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:324, status:SUCCESS 2022-12-08 15:43:34.032 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:43:34.038 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:43:34.248 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:34.248 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:34.309 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:43:34.691 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:43:35.724 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:35.730 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:35.811 INFO 42 --- [pool-ocp-schedules-5,,4bce9f4e9026] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:43:37.504 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:37.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:37.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:37.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:38.731 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:38.736 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:43:38.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:43:38.795821+08:00, lastProcessTime=2022-12-08T15:43:28.800904+08:00 2022-12-08 15:43:38.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:43:38.795821+08:00, resultsCount=0 2022-12-08 15:43:38.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:43:38.795821+08:00, resultsCount=0 2022-12-08 15:43:38.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:43:38.795821+08:00 2022-12-08 15:43:40.104 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:43:40.111 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:43:40.303 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:43:40.316 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=13ms, period=120000ms 2022-12-08 15:43:40.865 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:40.865 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:41.005 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:43:41.736 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:41.741 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:41.981 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:43:42.068 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:43:42.665 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:43.665 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:43:43.802 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:44.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:44.005 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:44.006 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:44.006 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:44.742 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:44.747 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:45.471 INFO 42 --- [pool-ocp-schedules-18,,4aeef7b977b6] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:43:45.520 INFO 42 --- [pool-ocp-schedules-18,,4aeef7b977b6] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:43:45.681 INFO 42 --- [pool-ocp-schedules-14,,a91c19c545df] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:43:45.729 INFO 42 --- [pool-ocp-schedules-3,,b596ad782192] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:43:45.730 INFO 42 --- [pool-ocp-schedules-3,,b596ad782192] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:43:45.813 INFO 42 --- [pool-ocp-schedules-19,,2a048644d700] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:43:45.967 INFO 42 --- [pool-ocp-schedules-13,,bf68adeab9f2] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:43:46.389 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:43:46.398 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:43:47.104 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:47.104 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:47.555 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:43:47.748 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:47.755 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:43:48.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:43:48.797507+08:00, lastProcessTime=2022-12-08T15:43:38.795821+08:00 2022-12-08 15:43:48.903 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:43:48.797507+08:00, resultsCount=0 2022-12-08 15:43:48.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:43:48.797507+08:00, resultsCount=0 2022-12-08 15:43:48.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:43:48.797507+08:00 2022-12-08 15:43:49.474 INFO 42 --- [pool-ocp-schedules-20,,36f11edb64b7] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:43:49.493 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:43:49.721 INFO 42 --- [pool-ocp-schedules-14,,c0d41906a54a] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:43:49.745 INFO 42 --- [pool-ocp-schedules-10,,777db9acc91b] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:43:50.147 INFO 42 --- [pool-ocp-schedules-16,,c54cb335e48f] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:43:50.147 INFO 42 --- [pool-ocp-schedules-16,,c54cb335e48f] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:43:50.197 INFO 42 --- [pool-ocp-schedules-7,,5b6b535bf1f9] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:43:50.197 INFO 42 --- [pool-ocp-schedules-7,,5b6b535bf1f9] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:43:50.198 INFO 42 --- [pool-ocp-schedules-7,,5b6b535bf1f9] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:43:50.246 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:50.246 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:50.246 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:50.246 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:50.756 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:50.761 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:52.120 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:43:52.191 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:43:52.743 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:52.820 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:43:52.827 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:43:53.337 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:53.337 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:53.470 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:43:53.707 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:43:53.762 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:53.768 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:53.861 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:43:55.814 INFO 42 --- [pool-ocp-schedules-13,,70cb9b181d0e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:43:56.451 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:56.451 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:56.477 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:43:56.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:43:56.768 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:56.773 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,52da4b76bbed] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:43:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,52da4b76bbed] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:43:58.662 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:43:58.677 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:43:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:43:58.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:43:58.798761+08:00, lastProcessTime=2022-12-08T15:43:48.797507+08:00 2022-12-08 15:43:58.945 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:43:58.798761+08:00, resultsCount=0 2022-12-08 15:43:58.946 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:43:58.798761+08:00, resultsCount=0 2022-12-08 15:43:58.946 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:43:58.798761+08:00 2022-12-08 15:43:59.512 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:59.565 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:43:59.774 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:43:59.779 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:43:59.953 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:44:00.559 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:42:01.0, nextRun=2022-12-08 15:44:00.0, currentDate=Thu Dec 08 15:44:00 CST 2022 2022-12-08 15:44:00.561 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:42:01.0, nextRunTime=2022-12-08 15:44:00.0} 2022-12-08 15:44:00.582 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:44:00.652 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:43:01.0, nextRun=2022-12-08 15:44:00.0, currentDate=Thu Dec 08 15:44:00 CST 2022 2022-12-08 15:44:00.653 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:43:01.0, nextRunTime=2022-12-08 15:44:00.0} 2022-12-08 15:44:00.676 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:44:00.677 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:44:00.677 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:44:00.737 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:43:01.0, nextRun=2022-12-08 15:44:00.0, currentDate=Thu Dec 08 15:44:00 CST 2022 2022-12-08 15:44:00.738 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:43:01.0, nextRunTime=2022-12-08 15:44:00.0} 2022-12-08 15:44:00.762 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:44:00.763 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:44:00.763 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:44:00.817 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:43:01.0, nextRun=2022-12-08 15:44:00.0, currentDate=Thu Dec 08 15:44:00 CST 2022 2022-12-08 15:44:00.817 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:43:01.0, nextRunTime=2022-12-08 15:44:00.0} 2022-12-08 15:44:00.842 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:44:00.843 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:44:00.843 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:44:00.898 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:43:31.0, nextRun=2022-12-08 15:44:00.0, currentDate=Thu Dec 08 15:44:00 CST 2022 2022-12-08 15:44:00.898 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:43:31.0, nextRunTime=2022-12-08 15:44:00.0} 2022-12-08 15:44:00.924 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:44:00.924 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:44:00.924 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:44:00.997 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:43:02.0, nextRun=2022-12-08 15:44:00.0, currentDate=Thu Dec 08 15:44:00 CST 2022 2022-12-08 15:44:00.998 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:43:02.0, nextRunTime=2022-12-08 15:44:00.0} 2022-12-08 15:44:01.016 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:44:01.017 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:44:01.017 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:44:01.551 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 325, operation:EXECUTE, state: RUNNING 2022-12-08 15:44:01.573 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:44:01.591 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=325, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:44:01.538+08:00, endTime=null} 2022-12-08 15:44:01.661 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 326, operation:EXECUTE, state: RUNNING 2022-12-08 15:44:01.700 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=326, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:44:01.649+08:00, endTime=null} 2022-12-08 15:44:01.778 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 327, operation:EXECUTE, state: RUNNING 2022-12-08 15:44:01.821 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=327, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:44:01.766+08:00, endTime=null} 2022-12-08 15:44:01.919 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 328, operation:EXECUTE, state: RUNNING 2022-12-08 15:44:02.158 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:44:02.208 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=328, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:44:01.902+08:00, endTime=null} 2022-12-08 15:44:02.212 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:44:02.296 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 329, operation:EXECUTE, state: RUNNING 2022-12-08 15:44:02.354 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:44:02.393 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=329, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:44:02.281+08:00, endTime=null} 2022-12-08 15:44:02.501 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:44:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,6cca224955e0] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485500, interval=60 2022-12-08 15:44:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,32e3ad0585e0] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485500, interval=60 2022-12-08 15:44:02.654 INFO 42 --- [pool-prometheus-minute-schedule-2,,6cca224955e0] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485442, count=0, elapsed=1668814957212 2022-12-08 15:44:02.655 INFO 42 --- [pool-prometheus-minute-schedule-1,,32e3ad0585e0] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485442, count=0, elapsed=1668814957213 2022-12-08 15:44:02.780 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:02.784 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:02.812 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:02.941 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:02.942 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:02.944 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:02.945 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:02.948 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:325, status:SUCCESS 2022-12-08 15:44:02.958 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:325, status:SUCCESS 2022-12-08 15:44:03.106 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:326, status:SUCCESS 2022-12-08 15:44:03.117 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:326, status:SUCCESS 2022-12-08 15:44:03.219 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:327, status:SUCCESS 2022-12-08 15:44:03.227 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:327, status:SUCCESS 2022-12-08 15:44:03.344 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:328, status:SUCCESS 2022-12-08 15:44:03.356 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:328, status:SUCCESS 2022-12-08 15:44:03.443 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:329, status:SUCCESS 2022-12-08 15:44:03.449 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:329, status:SUCCESS 2022-12-08 15:44:03.742 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:44:04.041 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:04.515 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:44:05.147 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:44:05.153 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:44:05.785 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:05.789 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:05.815 INFO 42 --- [pool-ocp-schedules-5,,f0c0bbf4254a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:44:06.019 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:06.021 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:06.195 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:43:06.0, nextRun=2022-12-08 15:44:05.0, currentDate=Thu Dec 08 15:44:06 CST 2022 2022-12-08 15:44:06.196 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:43:06.0, nextRunTime=2022-12-08 15:44:05.0} 2022-12-08 15:44:06.211 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:44:06.212 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:44:06.212 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:44:06.275 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:44:06.520 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 330, operation:EXECUTE, state: RUNNING 2022-12-08 15:44:06.544 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=330, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:44:06.509+08:00, endTime=null} 2022-12-08 15:44:07.269 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:330, status:SUCCESS 2022-12-08 15:44:07.274 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:330, status:SUCCESS 2022-12-08 15:44:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:44:08.790 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:08.796 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:08.805 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:44:08.802270+08:00, lastProcessTime=2022-12-08T15:43:58.798761+08:00 2022-12-08 15:44:08.924 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:44:08.802270+08:00, resultsCount=0 2022-12-08 15:44:08.924 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:44:08.802270+08:00, resultsCount=0 2022-12-08 15:44:08.925 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:44:08.802270+08:00 2022-12-08 15:44:09.099 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:09.099 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:09.099 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:09.100 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:10.230 INFO 42 --- [pool-ocp-schedules-20,,c03d2c7c6d96] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:44:10.231 INFO 42 --- [pool-ocp-schedules-20,,c03d2c7c6d96] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:44:11.787 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:44:11.792 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:44:11.796 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:11.800 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:12.319 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:12.327 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:12.342 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:44:12.347 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:44:12.869 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:44:12.877 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:13.769 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:44:14.126 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:14.801 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:14.806 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:15.445 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:15.446 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:15.446 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:15.446 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:15.817 INFO 42 --- [pool-ocp-schedules-5,,82ef2c19e5e3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:44:17.807 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:17.813 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:18.170 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:44:18.176 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:44:18.571 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:18.572 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:44:18.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:44:18.795114+08:00, lastProcessTime=2022-12-08T15:44:08.802270+08:00 2022-12-08 15:44:18.820 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:44:18.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:44:18.795114+08:00, resultsCount=0 2022-12-08 15:44:18.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:44:18.795114+08:00, resultsCount=0 2022-12-08 15:44:18.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:44:18.795114+08:00 2022-12-08 15:44:19.566 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:44:20.813 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:20.819 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:20.906 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:43:20.0, nextRun=2022-12-08 15:44:20.0, currentDate=Thu Dec 08 15:44:20 CST 2022 2022-12-08 15:44:20.907 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:43:20.0, nextRunTime=2022-12-08 15:44:20.0} 2022-12-08 15:44:20.924 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:44:20.924 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:44:20.924 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:44:21.812 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:21.813 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:21.816 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:21.816 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 331, operation:EXECUTE, state: RUNNING 2022-12-08 15:44:21.817 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:21.941 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=331, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:44:21.799+08:00, endTime=null} 2022-12-08 15:44:22.435 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:44:22.439 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:44:22.994 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:23.201 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:331, status:SUCCESS 2022-12-08 15:44:23.207 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:331, status:SUCCESS 2022-12-08 15:44:23.819 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:23.823 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:23.842 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:44:24.289 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:44:24.294 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:44:24.328 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:24.948 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:24.949 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:25.420 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:44:25.425 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:43:26.0, nextRun=2022-12-08 15:44:25.0, currentDate=Thu Dec 08 15:44:25 CST 2022 2022-12-08 15:44:25.426 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:43:26.0, nextRunTime=2022-12-08 15:44:25.0} 2022-12-08 15:44:25.475 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:44:25.476 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:44:25.476 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:44:25.818 INFO 42 --- [pool-ocp-schedules-16,,479dafd465ed] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:44:26.049 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 332, operation:EXECUTE, state: RUNNING 2022-12-08 15:44:26.601 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=332, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:44:26.037+08:00, endTime=null} 2022-12-08 15:44:26.824 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:26.828 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:27.153 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:40:26.095, end=2022-12-08T15:42:27.002} 2022-12-08 15:44:27.170 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:44:28.021 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:28.021 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:28.022 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:28.022 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:28.306 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:332, status:SUCCESS 2022-12-08 15:44:28.312 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:332, status:SUCCESS 2022-12-08 15:44:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:44:28.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:44:28.792250+08:00, lastProcessTime=2022-12-08T15:44:18.795114+08:00 2022-12-08 15:44:28.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:44:28.792250+08:00, resultsCount=0 2022-12-08 15:44:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:44:28.792250+08:00, resultsCount=0 2022-12-08 15:44:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:44:28.792250+08:00 2022-12-08 15:44:29.829 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:29.834 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:30.416 INFO 42 --- [pool-ocp-schedules-7,,9c6502fc7610] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:44:30.417 INFO 42 --- [pool-ocp-schedules-7,,9c6502fc7610] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:44:30.739 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:44:30.744 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:44:31.057 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:43:31.0, nextRun=2022-12-08 15:44:30.0, currentDate=Thu Dec 08 15:44:31 CST 2022 2022-12-08 15:44:31.058 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:43:31.0, nextRunTime=2022-12-08 15:44:30.0} 2022-12-08 15:44:31.079 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:44:31.168 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:01.0, nextRun=2022-12-08 15:44:30.0, currentDate=Thu Dec 08 15:44:31 CST 2022 2022-12-08 15:44:31.169 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:44:01.0, nextRunTime=2022-12-08 15:44:30.0} 2022-12-08 15:44:31.171 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:31.172 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:31.189 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:44:31.189 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:44:31.189 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:44:31.531 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:44:31.609 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:44:31.734 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 333, operation:EXECUTE, state: RUNNING 2022-12-08 15:44:31.824 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=333, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:44:31.721+08:00, endTime=null} 2022-12-08 15:44:32.460 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:44:32.566 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:44:32.570 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:44:32.632 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:44:32.834 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:32.841 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:33.100 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:33.359 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:333, status:SUCCESS 2022-12-08 15:44:33.366 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:333, status:SUCCESS 2022-12-08 15:44:33.893 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:44:34.396 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:34.504 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:34.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:34.528 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:34.529 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:34.640 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:44:35.819 INFO 42 --- [pool-ocp-schedules-11,,4d8abf80627a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:44:35.842 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:35.847 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:37.118 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:44:37.123 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:44:37.634 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:37.845 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:38.320 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:44:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:44:38.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:44:38.794652+08:00, lastProcessTime=2022-12-08T15:44:28.792250+08:00 2022-12-08 15:44:38.848 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:38.851 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:38.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:44:38.794652+08:00, resultsCount=0 2022-12-08 15:44:38.898 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:44:38.794652+08:00, resultsCount=0 2022-12-08 15:44:38.898 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:44:38.794652+08:00 2022-12-08 15:44:40.817 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:40.818 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:41.168 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:41.169 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:41.852 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:41.857 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:42.633 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:44:42.651 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:44:43.242 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:43.668 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:44:43.674 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:44:43.944 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:44:44.232 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:44.362 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:44.453 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:44.782 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:44:44.857 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:44.862 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:45.471 INFO 42 --- [pool-ocp-schedules-16,,94725cd3d617] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:44:45.524 INFO 42 --- [pool-ocp-schedules-16,,94725cd3d617] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:44:45.683 INFO 42 --- [pool-ocp-schedules-14,,6a0169e41dd3] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:44:45.821 INFO 42 --- [pool-ocp-schedules-17,,ac119ed4dafa] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:44:45.973 INFO 42 --- [pool-ocp-schedules-2,,e1edef5b2548] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:44:47.521 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:47.521 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:47.522 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:47.522 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:47.863 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:47.868 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:48.769 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:44:48.804 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:44:48.802080+08:00, lastProcessTime=2022-12-08T15:44:38.794652+08:00 2022-12-08 15:44:48.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:44:48.802080+08:00, resultsCount=0 2022-12-08 15:44:48.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:44:48.802080+08:00, resultsCount=0 2022-12-08 15:44:48.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:44:48.802080+08:00 2022-12-08 15:44:49.524 INFO 42 --- [pool-ocp-schedules-7,,234fbefba488] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:44:49.838 INFO 42 --- [pool-ocp-schedules-4,,cad8385cc364] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:44:49.885 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:44:49.886 INFO 42 --- [pool-ocp-schedules-15,,7cdff03f844c] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:44:50.028 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:44:50.034 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:44:50.323 INFO 42 --- [pool-ocp-schedules-9,,1a581b5adb14] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:44:50.324 INFO 42 --- [pool-ocp-schedules-9,,1a581b5adb14] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:44:50.324 INFO 42 --- [pool-ocp-schedules-9,,1a581b5adb14] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:44:50.627 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:50.627 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:50.635 INFO 42 --- [pool-ocp-schedules-1,,365fa888b785] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:44:50.636 INFO 42 --- [pool-ocp-schedules-1,,365fa888b785] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:44:50.869 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:50.874 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:51.166 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:44:52.967 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:44:52.977 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:44:53.427 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:53.689 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:53.690 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:53.689 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:44:53.690 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:44:53.875 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:53.879 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:53.983 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:44:54.507 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:44:55.822 INFO 42 --- [pool-ocp-schedules-20,,1eee7b83cee9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:44:56.394 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:44:56.408 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:44:56.880 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:56.886 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:44:57.305 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:57.305 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:44:57.575 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:44:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,71fc4e2e3506] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:44:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,71fc4e2e3506] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:44:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:44:58.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:44:58.790708+08:00, lastProcessTime=2022-12-08T15:44:48.802080+08:00 2022-12-08 15:44:58.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:44:58.790708+08:00, resultsCount=0 2022-12-08 15:44:58.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:44:58.790708+08:00, resultsCount=0 2022-12-08 15:44:58.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:44:58.790708+08:00 2022-12-08 15:44:59.887 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:44:59.891 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:00.001 INFO 42 --- [pool-ocp-schedules-7,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:45:00.395 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:00.396 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:00.399 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:00.400 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:00.522 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:03.0, nextRun=2022-12-08 15:45:00.0, currentDate=Thu Dec 08 15:45:00 CST 2022 2022-12-08 15:45:00.523 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 15:40:03.0, nextRunTime=2022-12-08 15:45:00.0} 2022-12-08 15:45:00.543 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 15:45:00.543 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:00.544 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:00.628 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:03.0, nextRun=2022-12-08 15:45:00.0, currentDate=Thu Dec 08 15:45:00 CST 2022 2022-12-08 15:45:00.628 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:40:03.0, nextRunTime=2022-12-08 15:45:00.0} 2022-12-08 15:45:00.656 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 15:45:00.656 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 15:45:00.741 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:01.0, nextRun=2022-12-08 15:45:00.0, currentDate=Thu Dec 08 15:45:00 CST 2022 2022-12-08 15:45:00.742 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:44:01.0, nextRunTime=2022-12-08 15:45:00.0} 2022-12-08 15:45:00.770 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:45:00.770 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:00.771 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:00.829 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:01.0, nextRun=2022-12-08 15:45:00.0, currentDate=Thu Dec 08 15:45:00 CST 2022 2022-12-08 15:45:00.831 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:44:01.0, nextRunTime=2022-12-08 15:45:00.0} 2022-12-08 15:45:00.859 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:45:00.860 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:00.860 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:00.934 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:01.0, nextRun=2022-12-08 15:45:00.0, currentDate=Thu Dec 08 15:45:00 CST 2022 2022-12-08 15:45:00.935 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:44:01.0, nextRunTime=2022-12-08 15:45:00.0} 2022-12-08 15:45:00.958 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:45:00.958 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:00.958 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:01.035 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:31.0, nextRun=2022-12-08 15:45:00.0, currentDate=Thu Dec 08 15:45:01 CST 2022 2022-12-08 15:45:01.036 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:44:31.0, nextRunTime=2022-12-08 15:45:00.0} 2022-12-08 15:45:01.055 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:45:01.055 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:01.056 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:01.117 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:04.0, nextRun=2022-12-08 15:45:00.0, currentDate=Thu Dec 08 15:45:01 CST 2022 2022-12-08 15:45:01.118 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:40:04.0, nextRunTime=2022-12-08 15:45:00.0} 2022-12-08 15:45:01.136 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 15:45:01.137 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:01.137 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:01.267 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 336, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:01.481 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=336, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:45:01.255+08:00, endTime=null} 2022-12-08 15:45:01.485 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:01.0, nextRun=2022-12-08 15:45:00.0, currentDate=Thu Dec 08 15:45:01 CST 2022 2022-12-08 15:45:01.485 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:44:01.0, nextRunTime=2022-12-08 15:45:00.0} 2022-12-08 15:45:01.507 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:45:01.507 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:01.507 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:01.552 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 337, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:01.643 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=337, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:45:01.538+08:00, endTime=null} 2022-12-08 15:45:01.712 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 338, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:01.780 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=338, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:45:01.699+08:00, endTime=null} 2022-12-08 15:45:01.817 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:45:01.857 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 334, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:02.260 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=334, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T15:45:01.837+08:00, endTime=null} 2022-12-08 15:45:02.331 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 335, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:02.427 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=335, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:45:02.319+08:00, endTime=null} 2022-12-08 15:45:02.493 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:45:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,5686b338af59] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485560, interval=60 2022-12-08 15:45:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,5686b338af59] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485502, count=0, elapsed=1668815017133 2022-12-08 15:45:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,c5394b09f97b] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485560, interval=60 2022-12-08 15:45:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,c5394b09f97b] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485502, count=0, elapsed=1668815017138 2022-12-08 15:45:02.711 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:45:02.799 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:45:02.806 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:45:02.892 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:02.897 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:02.976 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:334, status:SUCCESS 2022-12-08 15:45:02.984 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:334, status:SUCCESS 2022-12-08 15:45:03.202 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:45:03.204 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:45:03.322 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:335, status:SUCCESS 2022-12-08 15:45:03.328 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:335, status:SUCCESS 2022-12-08 15:45:03.458 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:336, status:SUCCESS 2022-12-08 15:45:03.466 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:336, status:SUCCESS 2022-12-08 15:45:03.487 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:03.488 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:03.529 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 339, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:03.582 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:337, status:SUCCESS 2022-12-08 15:45:03.587 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:337, status:SUCCESS 2022-12-08 15:45:03.608 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=339, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T15:45:03.491+08:00, endTime=null} 2022-12-08 15:45:03.654 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:03.669 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 340, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:03.682 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:338, status:SUCCESS 2022-12-08 15:45:03.688 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:338, status:SUCCESS 2022-12-08 15:45:03.938 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:45:04.000 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=340, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:45:03.657+08:00, endTime=null} 2022-12-08 15:45:04.317 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:45:04.654 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:04.970 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:45:05.472 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:339, status:SUCCESS 2022-12-08 15:45:05.478 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:339, status:SUCCESS 2022-12-08 15:45:05.597 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:340, status:SUCCESS 2022-12-08 15:45:05.603 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:340, status:SUCCESS 2022-12-08 15:45:05.706 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:06.0, nextRun=2022-12-08 15:45:05.0, currentDate=Thu Dec 08 15:45:05 CST 2022 2022-12-08 15:45:05.707 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:44:06.0, nextRunTime=2022-12-08 15:45:05.0} 2022-12-08 15:45:05.720 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:45:05.721 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:05.721 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:05.823 INFO 42 --- [pool-ocp-schedules-3,,b2567691495f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:45:05.898 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:05.914 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:06.079 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 341, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:06.131 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=341, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:45:06.066+08:00, endTime=null} 2022-12-08 15:45:06.274 INFO 42 --- [pool-ocp-schedules-7,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:45:06.614 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:06.615 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:06.616 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:06.617 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:06.713 INFO 42 --- [pool-ocp-schedules-7,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:45:06.826 INFO 42 --- [pool-ocp-schedules-7,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:45:07.109 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:341, status:SUCCESS 2022-12-08 15:45:07.127 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:341, status:SUCCESS 2022-12-08 15:45:07.178 INFO 42 --- [pool-ocp-schedules-7,,] o.s.boot.SpringApplication : Started application in 7.117 seconds (JVM running for 1504.024) 2022-12-08 15:45:08.640 INFO 42 --- [pool-ocp-schedules-7,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:45:08.640+08:00 2022-12-08 15:45:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:45:08.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:45:08.796174+08:00, lastProcessTime=2022-12-08T15:44:58.790708+08:00 2022-12-08 15:45:08.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:45:08.796174+08:00, resultsCount=0 2022-12-08 15:45:08.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:45:08.796174+08:00, resultsCount=0 2022-12-08 15:45:08.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:45:08.796174+08:00 2022-12-08 15:45:08.915 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:08.928 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:09.300 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:45:09.306 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:45:09.675 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:09.675 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:10.008 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:45:10.754 INFO 42 --- [pool-ocp-schedules-19,,6c3553df1d36] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:45:10.755 INFO 42 --- [pool-ocp-schedules-19,,6c3553df1d36] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:45:11.929 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:11.932 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:12.787 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:12.787 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:12.787 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:12.788 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:13.296 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:45:13.300 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:45:13.995 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:14.596 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:45:14.927 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:14.933 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:14.937 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:15.723 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:45:15.729 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:45:15.825 INFO 42 --- [pool-ocp-schedules-8,,84aa13c745b5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:45:15.896 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:15.897 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:16.339 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:45:17.938 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:17.946 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:45:18.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:45:18.796045+08:00, lastProcessTime=2022-12-08T15:45:08.796174+08:00 2022-12-08 15:45:18.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:45:18.796045+08:00, resultsCount=0 2022-12-08 15:45:18.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:45:18.796045+08:00, resultsCount=0 2022-12-08 15:45:18.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:45:18.796045+08:00 2022-12-08 15:45:19.045 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:19.045 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:19.045 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:19.045 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:20.168 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:45:20.947 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:20.952 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:21.217 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:21.0, nextRun=2022-12-08 15:45:20.0, currentDate=Thu Dec 08 15:45:21 CST 2022 2022-12-08 15:45:21.218 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:44:21.0, nextRunTime=2022-12-08 15:45:20.0} 2022-12-08 15:45:21.237 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:45:21.238 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:21.238 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:21.425 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 342, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:21.480 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=342, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:45:21.394+08:00, endTime=null} 2022-12-08 15:45:21.514 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:45:21.520 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:45:22.164 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:22.164 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:22.329 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:342, status:SUCCESS 2022-12-08 15:45:22.335 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:342, status:SUCCESS 2022-12-08 15:45:22.670 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:45:23.366 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:45:23.369 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:45:23.952 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:23.957 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:24.053 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:24.927 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:45:25.023 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:25.222 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:25.223 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:25.247 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:25.248 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:25.520 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:25.0, nextRun=2022-12-08 15:45:25.0, currentDate=Thu Dec 08 15:45:25 CST 2022 2022-12-08 15:45:25.521 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:44:25.0, nextRunTime=2022-12-08 15:45:25.0} 2022-12-08 15:45:25.568 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:45:25.569 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:25.569 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:25.826 INFO 42 --- [pool-ocp-schedules-13,,d5905008d795] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:45:26.630 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 343, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:26.958 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:26.964 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:26.992 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=343, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:45:26.617+08:00, endTime=null} 2022-12-08 15:45:28.278 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:45:28.280 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:45:28.590 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:45:28.784 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:45:28.782352+08:00, lastProcessTime=2022-12-08T15:45:18.796045+08:00 2022-12-08 15:45:28.841 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:45:28.782352+08:00, resultsCount=0 2022-12-08 15:45:28.841 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:45:28.782352+08:00, resultsCount=0 2022-12-08 15:45:28.842 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:45:28.782352+08:00 2022-12-08 15:45:29.719 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:343, status:SUCCESS 2022-12-08 15:45:29.724 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:343, status:SUCCESS 2022-12-08 15:45:29.965 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:29.968 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:31.363 INFO 42 --- [pool-ocp-schedules-12,,51df40d87736] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:45:31.364 INFO 42 --- [pool-ocp-schedules-12,,51df40d87736] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:45:31.475 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:31.0, nextRun=2022-12-08 15:45:30.0, currentDate=Thu Dec 08 15:45:31 CST 2022 2022-12-08 15:45:31.476 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:44:31.0, nextRunTime=2022-12-08 15:45:30.0} 2022-12-08 15:45:31.500 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:45:31.613 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:01.0, nextRun=2022-12-08 15:45:30.0, currentDate=Thu Dec 08 15:45:31 CST 2022 2022-12-08 15:45:31.614 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:45:01.0, nextRunTime=2022-12-08 15:45:30.0} 2022-12-08 15:45:31.636 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:45:31.637 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:45:31.637 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:45:32.212 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 344, operation:EXECUTE, state: RUNNING 2022-12-08 15:45:32.243 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:45:32.493 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:43:01+08:00, updateTime=2022-12-08T15:45:01+08:00, expireTime=null, isLeader=false} 2022-12-08 15:45:32.499 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=344, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:45:32.200+08:00, endTime=null} 2022-12-08 15:45:32.500 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:45:32.701 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:45:32.845 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:45:32.969 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:32.976 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:33.474 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:45:33.475 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:45:34.073 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:344, status:SUCCESS 2022-12-08 15:45:34.081 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:344, status:SUCCESS 2022-12-08 15:45:34.391 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:34.982 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:45:35.087 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:35.225 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:45:35.827 INFO 42 --- [pool-ocp-schedules-12,,73119f2c260a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:45:35.977 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:35.982 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:38.754 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:45:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:45:38.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:45:38.790337+08:00, lastProcessTime=2022-12-08T15:45:28.782352+08:00 2022-12-08 15:45:38.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:45:38.790337+08:00, resultsCount=0 2022-12-08 15:45:38.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:45:38.790337+08:00, resultsCount=0 2022-12-08 15:45:38.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:45:38.790337+08:00 2022-12-08 15:45:38.983 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:38.987 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:40.306 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:45:40.324 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=18ms, period=120000ms 2022-12-08 15:45:41.988 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:41.993 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:43.778 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:45:43.781 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:45:44.002 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:45:44.007 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:45:44.423 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:44.619 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:44.619 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:44.725 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:45:44.994 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:44.999 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:45.026 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:45:45.141 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:45.462 INFO 42 --- [pool-ocp-schedules-4,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 15:45:45.476 INFO 42 --- [pool-ocp-schedules-19,,66042b52cdfd] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:45:45.509 INFO 42 --- [pool-ocp-schedules-19,,66042b52cdfd] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:45:45.684 INFO 42 --- [pool-ocp-schedules-12,,faae483acf22] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:45:45.731 INFO 42 --- [pool-ocp-schedules-8,,5ebbaef1bd7f] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:45:45.732 INFO 42 --- [pool-ocp-schedules-8,,5ebbaef1bd7f] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:45:45.828 INFO 42 --- [pool-ocp-schedules-9,,0a878f6676d8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:45:45.842 INFO 42 --- [pool-ocp-schedules-17,,c7eca21758ac] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 15:45:45.978 INFO 42 --- [pool-ocp-schedules-5,,aa784851f281] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:45:46.086 INFO 42 --- [pool-ocp-schedules-6,,d81c8c890a1e] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 15:45:47.691 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:47.691 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:47.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:47.723 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:48.001 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:48.006 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:45:48.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:45:48.793616+08:00, lastProcessTime=2022-12-08T15:45:38.790337+08:00 2022-12-08 15:45:48.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:45:48.793616+08:00, resultsCount=0 2022-12-08 15:45:48.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:45:48.793616+08:00, resultsCount=0 2022-12-08 15:45:48.888 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:45:48.793616+08:00 2022-12-08 15:45:49.607 INFO 42 --- [pool-ocp-schedules-18,,6910ef8168f8] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:45:49.875 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:45:49.881 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:45:49.907 INFO 42 --- [pool-ocp-schedules-2,,24dedc3a378e] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:45:49.992 INFO 42 --- [pool-ocp-schedules-12,,5fc95e9139f0] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:45:50.305 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:45:50.478 INFO 42 --- [pool-ocp-schedules-20,,5b046f8cc0a1] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:45:50.478 INFO 42 --- [pool-ocp-schedules-20,,5b046f8cc0a1] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:45:50.479 INFO 42 --- [pool-ocp-schedules-20,,5b046f8cc0a1] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:45:50.776 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:50.831 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:51.007 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:51.011 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:51.419 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:45:51.511 INFO 42 --- [pool-ocp-schedules-6,,bc1c2861cb22] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:45:51.512 INFO 42 --- [pool-ocp-schedules-6,,bc1c2861cb22] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:45:53.953 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:45:53.957 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:45:54.012 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:54.016 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:54.404 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:54.405 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:54.425 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:45:54.425 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:45:54.603 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:55.058 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:45:55.521 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:45:55.830 INFO 42 --- [pool-ocp-schedules-17,,534b95f738ca] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:45:56.653 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:45:56.658 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:45:57.017 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:45:57.022 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:45:57.500 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:57.560 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:45:57.936 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:45:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,698b531bac18] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:45:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,698b531bac18] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:45:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:45:58.806 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:45:58.802685+08:00, lastProcessTime=2022-12-08T15:45:48.793616+08:00 2022-12-08 15:45:58.921 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:45:58.802685+08:00, resultsCount=0 2022-12-08 15:45:58.921 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:45:58.802685+08:00, resultsCount=0 2022-12-08 15:45:58.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:45:58.802685+08:00 2022-12-08 15:46:00.023 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:00.028 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:00.800 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:00.801 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:00.859 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:44:01.0, nextRun=2022-12-08 15:46:00.0, currentDate=Thu Dec 08 15:46:00 CST 2022 2022-12-08 15:46:00.859 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:44:01.0, nextRunTime=2022-12-08 15:46:00.0} 2022-12-08 15:46:00.891 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:46:00.919 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:00.919 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:01.008 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:01.0, nextRun=2022-12-08 15:46:00.0, currentDate=Thu Dec 08 15:46:01 CST 2022 2022-12-08 15:46:01.009 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:45:01.0, nextRunTime=2022-12-08 15:46:00.0} 2022-12-08 15:46:01.026 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:46:01.026 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:46:01.026 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:46:01.095 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:01.0, nextRun=2022-12-08 15:46:00.0, currentDate=Thu Dec 08 15:46:01 CST 2022 2022-12-08 15:46:01.095 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:45:01.0, nextRunTime=2022-12-08 15:46:00.0} 2022-12-08 15:46:01.122 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:46:01.122 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:46:01.122 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:46:01.187 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:01.0, nextRun=2022-12-08 15:46:00.0, currentDate=Thu Dec 08 15:46:01 CST 2022 2022-12-08 15:46:01.187 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:45:01.0, nextRunTime=2022-12-08 15:46:00.0} 2022-12-08 15:46:01.211 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:46:01.212 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:46:01.212 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:46:01.320 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:32.0, nextRun=2022-12-08 15:46:00.0, currentDate=Thu Dec 08 15:46:01 CST 2022 2022-12-08 15:46:01.321 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:45:32.0, nextRunTime=2022-12-08 15:46:00.0} 2022-12-08 15:46:01.339 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:46:01.339 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:46:01.340 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:46:01.417 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:01.0, nextRun=2022-12-08 15:46:00.0, currentDate=Thu Dec 08 15:46:01 CST 2022 2022-12-08 15:46:01.418 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:45:01.0, nextRunTime=2022-12-08 15:46:00.0} 2022-12-08 15:46:01.433 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:46:01.434 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:46:01.434 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:46:01.883 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 345, operation:EXECUTE, state: RUNNING 2022-12-08 15:46:02.026 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=345, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:46:01.872+08:00, endTime=null} 2022-12-08 15:46:02.087 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 346, operation:EXECUTE, state: RUNNING 2022-12-08 15:46:02.355 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=346, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:46:02.075+08:00, endTime=null} 2022-12-08 15:46:02.442 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 347, operation:EXECUTE, state: RUNNING 2022-12-08 15:46:02.527 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=347, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:46:02.428+08:00, endTime=null} 2022-12-08 15:46:02.599 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 348, operation:EXECUTE, state: RUNNING 2022-12-08 15:46:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,92832d4ef01a] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485620, interval=60 2022-12-08 15:46:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,92832d4ef01a] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485562, count=0, elapsed=1668815077073 2022-12-08 15:46:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,dad83e81bc79] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485620, interval=60 2022-12-08 15:46:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,dad83e81bc79] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485562, count=0, elapsed=1668815077078 2022-12-08 15:46:02.668 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=348, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:46:02.588+08:00, endTime=null} 2022-12-08 15:46:02.701 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:46:02.743 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 349, operation:EXECUTE, state: RUNNING 2022-12-08 15:46:02.809 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=349, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:46:02.732+08:00, endTime=null} 2022-12-08 15:46:02.846 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:46:02.927 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:345, status:SUCCESS 2022-12-08 15:46:02.934 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:345, status:SUCCESS 2022-12-08 15:46:02.981 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:46:03.029 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:03.078 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:346, status:SUCCESS 2022-12-08 15:46:03.115 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:03.117 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:346, status:SUCCESS 2022-12-08 15:46:03.300 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:46:03.306 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:46:03.339 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:347, status:SUCCESS 2022-12-08 15:46:03.345 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:347, status:SUCCESS 2022-12-08 15:46:03.489 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:348, status:SUCCESS 2022-12-08 15:46:03.497 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:348, status:SUCCESS 2022-12-08 15:46:03.647 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:349, status:SUCCESS 2022-12-08 15:46:03.654 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:349, status:SUCCESS 2022-12-08 15:46:03.858 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:04.011 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:04.061 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:46:04.067 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:46:04.423 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:46:04.674 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:05.125 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:46:05.396 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:46:05.514 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:06.0, nextRun=2022-12-08 15:46:05.0, currentDate=Thu Dec 08 15:46:05 CST 2022 2022-12-08 15:46:05.515 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:45:06.0, nextRunTime=2022-12-08 15:46:05.0} 2022-12-08 15:46:05.537 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:46:05.538 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:46:05.538 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:46:05.730 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:05.831 INFO 42 --- [pool-ocp-schedules-5,,971163d7da68] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:46:05.944 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 350, operation:EXECUTE, state: RUNNING 2022-12-08 15:46:06.012 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=350, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:46:05.932+08:00, endTime=null} 2022-12-08 15:46:06.116 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:06.120 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:06.965 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:06.966 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:07.105 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:07.106 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:07.495 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:350, status:SUCCESS 2022-12-08 15:46:07.501 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:350, status:SUCCESS 2022-12-08 15:46:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:46:08.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:46:08.792549+08:00, lastProcessTime=2022-12-08T15:45:58.802685+08:00 2022-12-08 15:46:08.888 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:46:08.792549+08:00, resultsCount=0 2022-12-08 15:46:08.889 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:46:08.792549+08:00, resultsCount=0 2022-12-08 15:46:08.889 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:46:08.792549+08:00 2022-12-08 15:46:09.121 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:09.128 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:10.053 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:46:10.060 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:46:10.262 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:10.265 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:10.783 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:46:11.553 INFO 42 --- [pool-ocp-schedules-6,,06fd81b5e4e1] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:46:11.553 INFO 42 --- [pool-ocp-schedules-6,,06fd81b5e4e1] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:46:12.129 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:12.133 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:13.363 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:13.363 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:13.363 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:13.364 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:14.180 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:46:14.184 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:46:14.721 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:15.134 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:15.138 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:15.396 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:46:15.780 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:15.832 INFO 42 --- [pool-ocp-schedules-9,,a71e9e3b28f8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:46:16.609 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:46:16.959 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:46:18.139 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:18.144 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:46:18.791 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:46:18.789138+08:00, lastProcessTime=2022-12-08T15:46:08.792549+08:00 2022-12-08 15:46:18.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:46:18.789138+08:00, resultsCount=0 2022-12-08 15:46:18.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:46:18.789138+08:00, resultsCount=0 2022-12-08 15:46:18.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:46:18.789138+08:00 2022-12-08 15:46:19.981 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:19.983 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:19.992 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T15:40:19.201, end=2022-12-08T15:45:19.759} 2022-12-08 15:46:19.993 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T15:40:19.196, end=2022-12-08T15:45:19.759} 2022-12-08 15:46:20.019 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:46:20.019 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:46:20.280 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:21.0, nextRun=2022-12-08 15:46:20.0, currentDate=Thu Dec 08 15:46:20 CST 2022 2022-12-08 15:46:20.281 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:45:21.0, nextRunTime=2022-12-08 15:46:20.0} 2022-12-08 15:46:20.300 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:46:20.300 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:46:20.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:46:20.364 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:46:20.481 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:46:21.144 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:21.152 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:21.283 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 351, operation:EXECUTE, state: RUNNING 2022-12-08 15:46:21.375 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=351, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:46:21.269+08:00, endTime=null} 2022-12-08 15:46:22.379 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:351, status:SUCCESS 2022-12-08 15:46:22.386 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:351, status:SUCCESS 2022-12-08 15:46:23.035 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:23.035 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:23.108 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:23.109 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:24.153 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:24.157 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:24.274 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:46:24.335 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:46:24.926 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:25.138 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:26.0, nextRun=2022-12-08 15:46:25.0, currentDate=Thu Dec 08 15:46:25 CST 2022 2022-12-08 15:46:25.139 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:45:26.0, nextRunTime=2022-12-08 15:46:25.0} 2022-12-08 15:46:25.183 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:46:25.184 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:46:25.184 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:46:25.456 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:46:25.499 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 352, operation:EXECUTE, state: RUNNING 2022-12-08 15:46:25.532 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:46:25.538 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:46:25.833 INFO 42 --- [pool-ocp-schedules-11,,ee9a674bbc48] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:46:25.835 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=352, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:46:25.488+08:00, endTime=null} 2022-12-08 15:46:26.149 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:26.221 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:26.513 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:26.954 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:46:27.158 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:27.163 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:27.310 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:352, status:SUCCESS 2022-12-08 15:46:27.317 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:352, status:SUCCESS 2022-12-08 15:46:27.356 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:42:27.002, end=2022-12-08T15:44:27.316} 2022-12-08 15:46:27.378 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:46:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:46:28.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:46:28.796133+08:00, lastProcessTime=2022-12-08T15:46:18.789138+08:00 2022-12-08 15:46:28.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:46:28.796133+08:00, resultsCount=0 2022-12-08 15:46:28.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:46:28.796133+08:00, resultsCount=0 2022-12-08 15:46:28.921 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:46:28.796133+08:00 2022-12-08 15:46:29.350 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:29.351 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:29.861 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:29.861 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:30.164 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:30.178 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:31.139 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:31.0, nextRun=2022-12-08 15:46:30.0, currentDate=Thu Dec 08 15:46:31 CST 2022 2022-12-08 15:46:31.140 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:45:31.0, nextRunTime=2022-12-08 15:46:30.0} 2022-12-08 15:46:31.163 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:46:31.238 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:01.0, nextRun=2022-12-08 15:46:30.0, currentDate=Thu Dec 08 15:46:31 CST 2022 2022-12-08 15:46:31.238 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:46:01.0, nextRunTime=2022-12-08 15:46:30.0} 2022-12-08 15:46:31.259 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:46:31.259 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:46:31.260 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:46:31.617 INFO 42 --- [pool-ocp-schedules-13,,d5d00cb2383b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:46:31.618 INFO 42 --- [pool-ocp-schedules-13,,d5d00cb2383b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:46:31.966 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 353, operation:EXECUTE, state: RUNNING 2022-12-08 15:46:32.019 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=353, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:46:31.956+08:00, endTime=null} 2022-12-08 15:46:32.289 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:46:32.295 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:46:32.630 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:32.771 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:46:32.910 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:33.066 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:46:33.179 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:33.198 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:33.210 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:46:33.240 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:43:32+08:00, updateTime=2022-12-08T15:46:02+08:00, expireTime=null, isLeader=false} 2022-12-08 15:46:33.535 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:41:32+08:00, updateTime=2022-12-08T15:46:02+08:00, expireTime=null, isLeader=false} 2022-12-08 15:46:33.541 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:46:33.786 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:46:33.794 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:46:33.806 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:353, status:SUCCESS 2022-12-08 15:46:33.812 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:353, status:SUCCESS 2022-12-08 15:46:34.358 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:46:34.412 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:46:34.987 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:35.506 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:46:35.545 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:46:35.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:35.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:35.834 INFO 42 --- [pool-ocp-schedules-8,,f053ecf09898] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:46:36.199 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:36.204 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:36.207 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:36.208 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:36.208 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:46:38.816 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:46:38.812760+08:00, lastProcessTime=2022-12-08T15:46:28.796133+08:00 2022-12-08 15:46:38.915 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:46:38.924 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:46:38.937 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:46:38.812760+08:00, resultsCount=0 2022-12-08 15:46:38.937 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:46:38.812760+08:00, resultsCount=0 2022-12-08 15:46:38.937 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:46:38.812760+08:00 2022-12-08 15:46:39.108 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:39.204 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:39.209 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:39.469 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:39.574 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:46:42.171 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:42.172 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:42.210 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:42.214 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:42.546 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:42.546 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:44.477 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:46:44.481 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:46:44.901 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:46:44.909 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:46:45.215 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:45.217 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:45.219 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:45.338 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:45.471 INFO 42 --- [pool-ocp-schedules-2,,1c31aa807ce4] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:46:45.512 INFO 42 --- [pool-ocp-schedules-2,,1c31aa807ce4] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:46:45.681 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:45.685 INFO 42 --- [pool-ocp-schedules-7,,1f37f19585f4] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:46:45.829 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:46:45.835 INFO 42 --- [pool-ocp-schedules-5,,bab273b36bf9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:46:45.995 INFO 42 --- [pool-ocp-schedules-17,,8a510d5e0b20] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:46:46.017 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:46:46.263 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:48.219 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:48.224 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:48.494 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:48.495 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:48.750 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:48.751 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:46:48.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:46:48.796750+08:00, lastProcessTime=2022-12-08T15:46:38.812760+08:00 2022-12-08 15:46:48.931 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:46:48.796750+08:00, resultsCount=0 2022-12-08 15:46:48.931 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:46:48.796750+08:00, resultsCount=0 2022-12-08 15:46:48.931 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:46:48.796750+08:00 2022-12-08 15:46:49.709 INFO 42 --- [pool-ocp-schedules-18,,02a25c2bccce] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:46:49.996 INFO 42 --- [pool-ocp-schedules-12,,7b62b939887c] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:46:50.060 INFO 42 --- [pool-ocp-schedules-11,,c17390238294] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:46:50.545 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:46:50.566 INFO 42 --- [pool-ocp-schedules-7,,b73140ede738] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:46:50.566 INFO 42 --- [pool-ocp-schedules-7,,b73140ede738] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:46:50.567 INFO 42 --- [pool-ocp-schedules-7,,b73140ede738] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:46:51.225 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:51.233 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:51.402 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:46:51.408 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:46:51.602 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:51.706 INFO 42 --- [pool-ocp-schedules-4,,8ed3a499ca96] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:46:51.706 INFO 42 --- [pool-ocp-schedules-4,,8ed3a499ca96] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:46:51.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:52.001 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:46:54.233 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:54.237 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:54.678 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:54.678 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:54.712 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:46:54.726 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:46:54.904 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:46:54.904 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:46:55.547 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:55.836 INFO 42 --- [pool-ocp-schedules-7,,5a65e3a203a5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:46:55.884 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:46:56.315 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:46:57.238 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:46:57.243 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:46:57.486 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:46:57.493 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:46:57.823 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:58.003 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:46:58.351 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:46:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,29848a1a2dda] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:46:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,29848a1a2dda] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:46:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:46:58.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:46:58.790955+08:00, lastProcessTime=2022-12-08T15:46:48.796750+08:00 2022-12-08 15:46:58.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:46:58.790955+08:00, resultsCount=0 2022-12-08 15:46:58.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:46:58.790955+08:00, resultsCount=0 2022-12-08 15:46:58.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:46:58.790955+08:00 2022-12-08 15:47:00.102 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:01.0, nextRun=2022-12-08 15:47:00.0, currentDate=Thu Dec 08 15:47:00 CST 2022 2022-12-08 15:47:00.106 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:46:01.0, nextRunTime=2022-12-08 15:47:00.0} 2022-12-08 15:47:00.128 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:47:00.129 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:47:00.129 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:47:00.244 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:00.249 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:00.257 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:01.0, nextRun=2022-12-08 15:47:00.0, currentDate=Thu Dec 08 15:47:00 CST 2022 2022-12-08 15:47:00.258 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:46:01.0, nextRunTime=2022-12-08 15:47:00.0} 2022-12-08 15:47:00.290 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:47:00.291 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:47:00.291 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:47:00.351 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:01.0, nextRun=2022-12-08 15:47:00.0, currentDate=Thu Dec 08 15:47:00 CST 2022 2022-12-08 15:47:00.352 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:46:01.0, nextRunTime=2022-12-08 15:47:00.0} 2022-12-08 15:47:00.382 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:47:00.383 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:47:00.383 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:47:00.499 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 354, operation:EXECUTE, state: RUNNING 2022-12-08 15:47:00.505 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:31.0, nextRun=2022-12-08 15:47:00.0, currentDate=Thu Dec 08 15:47:00 CST 2022 2022-12-08 15:47:00.506 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:46:31.0, nextRunTime=2022-12-08 15:47:00.0} 2022-12-08 15:47:00.534 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:47:00.534 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:47:00.535 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:47:00.714 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=354, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:47:00.479+08:00, endTime=null} 2022-12-08 15:47:00.722 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:01.0, nextRun=2022-12-08 15:47:00.0, currentDate=Thu Dec 08 15:47:00 CST 2022 2022-12-08 15:47:00.723 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:46:01.0, nextRunTime=2022-12-08 15:47:00.0} 2022-12-08 15:47:00.738 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:47:00.739 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:47:00.739 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:47:00.773 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 355, operation:EXECUTE, state: RUNNING 2022-12-08 15:47:00.897 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=355, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:47:00.761+08:00, endTime=null} 2022-12-08 15:47:01.291 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:01.291 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:01.338 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:01.338 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:01.966 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 356, operation:EXECUTE, state: RUNNING 2022-12-08 15:47:02.035 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=356, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:47:01.955+08:00, endTime=null} 2022-12-08 15:47:02.069 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:354, status:SUCCESS 2022-12-08 15:47:02.076 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:354, status:SUCCESS 2022-12-08 15:47:02.096 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 357, operation:EXECUTE, state: RUNNING 2022-12-08 15:47:02.135 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=357, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:47:02.085+08:00, endTime=null} 2022-12-08 15:47:02.183 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:355, status:SUCCESS 2022-12-08 15:47:02.188 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:355, status:SUCCESS 2022-12-08 15:47:02.199 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 358, operation:EXECUTE, state: RUNNING 2022-12-08 15:47:02.271 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=358, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:47:02.186+08:00, endTime=null} 2022-12-08 15:47:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,6d89fc1ad751] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485680, interval=60 2022-12-08 15:47:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,6d89fc1ad751] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485622, count=0, elapsed=1668815137014 2022-12-08 15:47:02.641 INFO 42 --- [pool-prometheus-minute-schedule-1,,b99b61cab23c] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485680, interval=60 2022-12-08 15:47:02.642 INFO 42 --- [pool-prometheus-minute-schedule-1,,b99b61cab23c] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485622, count=0, elapsed=1668815137020 2022-12-08 15:47:03.067 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:47:03.142 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:45:32+08:00, updateTime=2022-12-08T15:46:32+08:00, expireTime=null, isLeader=false} 2022-12-08 15:47:03.150 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:47:03.250 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:03.254 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:03.567 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:356, status:SUCCESS 2022-12-08 15:47:03.574 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:356, status:SUCCESS 2022-12-08 15:47:03.588 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:47:03.594 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:47:03.681 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:357, status:SUCCESS 2022-12-08 15:47:03.687 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:357, status:SUCCESS 2022-12-08 15:47:03.784 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:358, status:SUCCESS 2022-12-08 15:47:03.786 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:47:03.791 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:358, status:SUCCESS 2022-12-08 15:47:04.101 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:47:04.409 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:04.440 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:04.556 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:46:33+08:00, updateTime=2022-12-08T15:46:33+08:00, expireTime=null, isLeader=false} 2022-12-08 15:47:04.562 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:47:04.707 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:47:04.803 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:47:04.986 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:47:05.026 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:06.0, nextRun=2022-12-08 15:47:05.0, currentDate=Thu Dec 08 15:47:05 CST 2022 2022-12-08 15:47:05.027 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:46:06.0, nextRunTime=2022-12-08 15:47:05.0} 2022-12-08 15:47:05.043 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:47:05.044 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:47:05.044 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:47:05.575 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 359, operation:EXECUTE, state: RUNNING 2022-12-08 15:47:05.588 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:47:05.766 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=359, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:47:05.561+08:00, endTime=null} 2022-12-08 15:47:05.838 INFO 42 --- [pool-ocp-schedules-7,,449c90b8355f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:47:05.886 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:05.984 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:47:06.255 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:06.260 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:06.435 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:06.821 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:359, status:SUCCESS 2022-12-08 15:47:06.827 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:359, status:SUCCESS 2022-12-08 15:47:07.655 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:07.655 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:07.656 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:07.656 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:47:08.805 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:47:08.802379+08:00, lastProcessTime=2022-12-08T15:46:58.790955+08:00 2022-12-08 15:47:08.917 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:47:08.802379+08:00, resultsCount=0 2022-12-08 15:47:08.917 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:47:08.802379+08:00, resultsCount=0 2022-12-08 15:47:08.917 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:47:08.802379+08:00 2022-12-08 15:47:09.261 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:09.267 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:10.464 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:47:10.470 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:47:10.738 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:10.742 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:11.057 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:47:11.986 INFO 42 --- [pool-ocp-schedules-2,,c0eb804ae4a5] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:47:11.987 INFO 42 --- [pool-ocp-schedules-2,,c0eb804ae4a5] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:47:12.268 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:12.273 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:13.852 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:13.852 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:13.853 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:13.853 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:15.274 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:15.278 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:15.351 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:47:15.510 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:47:15.839 INFO 42 --- [pool-ocp-schedules-3,,939b0969136f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:47:15.984 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:16.073 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:47:16.476 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:16.579 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:47:16.587 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:47:16.908 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:16.909 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:17.175 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:47:18.279 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:18.284 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:47:18.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:47:18.789664+08:00, lastProcessTime=2022-12-08T15:47:08.802379+08:00 2022-12-08 15:47:18.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:47:18.789664+08:00, resultsCount=0 2022-12-08 15:47:18.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:47:18.789664+08:00, resultsCount=0 2022-12-08 15:47:18.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:47:18.789664+08:00 2022-12-08 15:47:20.135 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:20.135 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:20.136 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:20.136 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:20.887 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:47:21.210 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:20.0, nextRun=2022-12-08 15:47:20.0, currentDate=Thu Dec 08 15:47:21 CST 2022 2022-12-08 15:47:21.211 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:46:20.0, nextRunTime=2022-12-08 15:47:20.0} 2022-12-08 15:47:21.229 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:47:21.230 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:47:21.230 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:47:21.285 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:21.290 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:22.022 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 360, operation:EXECUTE, state: RUNNING 2022-12-08 15:47:22.343 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=360, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:47:22.010+08:00, endTime=null} 2022-12-08 15:47:22.578 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:47:22.584 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:47:23.491 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:23.493 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:23.724 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:360, status:SUCCESS 2022-12-08 15:47:23.730 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:360, status:SUCCESS 2022-12-08 15:47:23.772 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:47:24.291 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:24.296 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:25.580 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:47:25.614 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:47:25.640 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:25.0, nextRun=2022-12-08 15:47:25.0, currentDate=Thu Dec 08 15:47:25 CST 2022 2022-12-08 15:47:25.640 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:46:25.0, nextRunTime=2022-12-08 15:47:25.0} 2022-12-08 15:47:25.680 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:47:25.680 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:47:25.681 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:47:25.840 INFO 42 --- [pool-ocp-schedules-17,,b2fb7d140dd3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:47:26.073 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:26.245 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:47:26.468 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 361, operation:EXECUTE, state: RUNNING 2022-12-08 15:47:26.607 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:26.681 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:26.681 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:26.682 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:26.682 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:26.782 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=361, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:47:26.455+08:00, endTime=null} 2022-12-08 15:47:27.297 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:27.301 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:27.647 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:361, status:SUCCESS 2022-12-08 15:47:27.658 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:361, status:SUCCESS 2022-12-08 15:47:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:47:28.801 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:47:28.798611+08:00, lastProcessTime=2022-12-08T15:47:18.789664+08:00 2022-12-08 15:47:28.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:47:28.798611+08:00, resultsCount=0 2022-12-08 15:47:28.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:47:28.798611+08:00, resultsCount=0 2022-12-08 15:47:28.916 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:47:28.798611+08:00 2022-12-08 15:47:29.663 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:47:29.671 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:47:29.850 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:29.850 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:30.101 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:31.0, nextRun=2022-12-08 15:47:30.0, currentDate=Thu Dec 08 15:47:30 CST 2022 2022-12-08 15:47:30.102 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:46:31.0, nextRunTime=2022-12-08 15:47:30.0} 2022-12-08 15:47:30.124 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:47:30.302 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:30.306 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:30.316 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:47:30.494 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:47:01.0, nextRun=2022-12-08 15:47:30.0, currentDate=Thu Dec 08 15:47:30 CST 2022 2022-12-08 15:47:30.495 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:47:01.0, nextRunTime=2022-12-08 15:47:30.0} 2022-12-08 15:47:30.512 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:47:30.513 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:47:30.513 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:47:30.902 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 362, operation:EXECUTE, state: RUNNING 2022-12-08 15:47:31.019 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=362, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:47:30.887+08:00, endTime=null} 2022-12-08 15:47:32.090 INFO 42 --- [pool-ocp-schedules-8,,501b71fc45f7] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:47:32.091 INFO 42 --- [pool-ocp-schedules-8,,501b71fc45f7] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:47:32.775 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:362, status:SUCCESS 2022-12-08 15:47:32.785 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:362, status:SUCCESS 2022-12-08 15:47:32.920 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:32.920 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:32.921 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:32.921 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:33.275 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:47:33.307 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:33.311 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:34.101 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:47:34.407 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:46:33+08:00, updateTime=2022-12-08T15:47:03+08:00, expireTime=null, isLeader=false} 2022-12-08 15:47:34.419 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:47:34.986 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:47:35.648 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:47:35.686 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:47:35.824 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:47:35.831 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:47:35.842 INFO 42 --- [pool-ocp-schedules-9,,6ea2f7ac7737] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:47:35.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:36.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:36.123 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:47:36.279 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:36.312 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:36.316 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:36.326 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:47:36.422 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:47:36.833 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:47:38.807 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:47:38.804475+08:00, lastProcessTime=2022-12-08T15:47:28.798611+08:00 2022-12-08 15:47:38.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:47:38.804475+08:00, resultsCount=0 2022-12-08 15:47:38.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:47:38.804475+08:00, resultsCount=0 2022-12-08 15:47:38.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:47:38.804475+08:00 2022-12-08 15:47:39.296 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:39.296 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:39.297 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:39.297 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:39.317 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:39.321 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:40.191 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:47:40.208 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=17ms, period=120000ms 2022-12-08 15:47:41.589 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:47:41.595 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:47:42.322 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:42.327 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:42.527 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:42.527 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:42.697 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:47:45.328 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:45.334 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:45.473 INFO 42 --- [pool-ocp-schedules-11,,096155264a24] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:47:45.511 INFO 42 --- [pool-ocp-schedules-11,,096155264a24] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:47:45.612 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:45.612 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:45.613 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:45.613 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:45.687 INFO 42 --- [pool-ocp-schedules-20,,930fc0581046] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:47:45.734 INFO 42 --- [pool-ocp-schedules-15,,24619f1208ca] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:47:45.734 INFO 42 --- [pool-ocp-schedules-15,,24619f1208ca] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:47:45.760 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:47:45.766 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:47:45.843 INFO 42 --- [pool-ocp-schedules-4,,f151e42d6f4c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:47:46.000 INFO 42 --- [pool-ocp-schedules-3,,91c835f6c93a] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:47:46.326 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:46.640 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:47:46.898 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:47.979 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:47:47.985 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:47:48.334 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:48.338 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:48.678 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:48.678 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:47:48.791 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:47:48.788841+08:00, lastProcessTime=2022-12-08T15:47:38.804475+08:00 2022-12-08 15:47:48.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:47:48.788841+08:00, resultsCount=0 2022-12-08 15:47:48.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:47:48.788841+08:00, resultsCount=0 2022-12-08 15:47:48.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:47:48.788841+08:00 2022-12-08 15:47:48.919 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:47:50.001 INFO 42 --- [pool-ocp-schedules-7,,2666fdbfdaff] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:47:50.384 INFO 42 --- [pool-ocp-schedules-15,,4c88a304fc3e] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:47:50.748 INFO 42 --- [pool-ocp-schedules-17,,ba26bd58e259] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:47:50.860 INFO 42 --- [pool-ocp-schedules-9,,24f64b710f3f] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:47:50.861 INFO 42 --- [pool-ocp-schedules-9,,24f64b710f3f] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:47:50.861 INFO 42 --- [pool-ocp-schedules-9,,24f64b710f3f] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:47:51.279 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:47:51.339 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:51.344 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:51.915 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:51.916 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:51.916 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:51.917 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:52.141 INFO 42 --- [pool-ocp-schedules-3,,7e30a1d5ce13] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:47:52.142 INFO 42 --- [pool-ocp-schedules-3,,7e30a1d5ce13] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:47:54.344 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:54.349 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:54.405 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:47:54.411 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:47:54.977 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:54.978 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:47:55.673 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:47:55.845 INFO 42 --- [pool-ocp-schedules-1,,3ebdee6ee3b2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:47:55.845 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:47:55.880 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:47:56.640 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:56.929 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:47:57.293 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:47:57.350 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:47:57.355 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:47:58.647 INFO 42 --- [pool-prometheus-cache-monitor1,,702aca598e53] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:47:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,702aca598e53] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:47:58.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:58.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:47:58.671 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:58.671 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:47:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:47:58.808 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:47:58.805091+08:00, lastProcessTime=2022-12-08T15:47:48.788841+08:00 2022-12-08 15:47:58.938 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:47:58.805091+08:00, resultsCount=0 2022-12-08 15:47:58.938 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:47:58.805091+08:00, resultsCount=0 2022-12-08 15:47:58.938 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:47:58.805091+08:00 2022-12-08 15:47:59.403 INFO 42 --- [http-nio-8080-exec-1,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring DispatcherServlet 'dispatcherServlet' 2022-12-08 15:47:59.404 INFO 42 --- [http-nio-8080-exec-1,,] o.s.web.servlet.DispatcherServlet : Initializing Servlet 'dispatcherServlet' 2022-12-08 15:47:59.692 INFO 42 --- [http-nio-8080-exec-1,,] o.s.web.servlet.DispatcherServlet : Completed initialization in 288 ms 2022-12-08 15:48:00.001 INFO 42 --- [pool-ocp-schedules-2,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:48:00.355 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:00.360 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:00.370 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:46:01.0, nextRun=2022-12-08 15:48:00.0, currentDate=Thu Dec 08 15:48:00 CST 2022 2022-12-08 15:48:00.371 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:46:01.0, nextRunTime=2022-12-08 15:48:00.0} 2022-12-08 15:48:00.402 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:48:00.488 INFO 42 --- [http-nio-8080-exec-1,,] c.a.o.s.a.CustomAuthenticationEntryPoint : User not authenticated to / 2022-12-08 15:48:00.681 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:47:00.0, nextRun=2022-12-08 15:48:00.0, currentDate=Thu Dec 08 15:48:00 CST 2022 2022-12-08 15:48:00.682 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:47:00.0, nextRunTime=2022-12-08 15:48:00.0} 2022-12-08 15:48:00.701 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:48:00.702 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:48:00.702 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:48:00.974 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:47:00.0, nextRun=2022-12-08 15:48:00.0, currentDate=Thu Dec 08 15:48:00 CST 2022 2022-12-08 15:48:00.975 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:47:00.0, nextRunTime=2022-12-08 15:48:00.0} 2022-12-08 15:48:00.996 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:48:00.996 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:48:00.996 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:48:01.021 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:48:01.026 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:48:01.123 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:47:00.0, nextRun=2022-12-08 15:48:00.0, currentDate=Thu Dec 08 15:48:01 CST 2022 2022-12-08 15:48:01.123 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:47:00.0, nextRunTime=2022-12-08 15:48:00.0} 2022-12-08 15:48:01.143 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:48:01.143 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:48:01.143 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:48:01.653 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:47:30.0, nextRun=2022-12-08 15:48:00.0, currentDate=Thu Dec 08 15:48:01 CST 2022 2022-12-08 15:48:01.655 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:47:30.0, nextRunTime=2022-12-08 15:48:00.0} 2022-12-08 15:48:01.682 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:48:01.683 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:48:01.683 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:48:01.692 INFO 42 --- [http-nio-8080-exec-1,57fb70a356d543f4,b09c59fcdb8d] c.a.o.server.trace.RequestTracingAspect : API: [GET /login?null, client=192.168.28.1, traceId=57fb70a356d543f4, method=ModelAndView com.alipay.ocp.server.controller.web.WebController.login(), args=] 2022-12-08 15:48:01.741 INFO 42 --- [http-nio-8080-exec-1,57fb70a356d543f4,b09c59fcdb8d] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /login client=192.168.28.1, traceId=57fb70a356d543f4, duration=223 ms] 2022-12-08 15:48:01.770 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 363, operation:EXECUTE, state: RUNNING 2022-12-08 15:48:01.801 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:01.803 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:01.919 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=363, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:48:01.738+08:00, endTime=null} 2022-12-08 15:48:01.930 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:47:01.0, nextRun=2022-12-08 15:48:00.0, currentDate=Thu Dec 08 15:48:01 CST 2022 2022-12-08 15:48:01.931 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:47:01.0, nextRunTime=2022-12-08 15:48:00.0} 2022-12-08 15:48:01.951 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:48:01.952 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:48:01.952 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:48:02.022 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 364, operation:EXECUTE, state: RUNNING 2022-12-08 15:48:02.132 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=364, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:48:02.005+08:00, endTime=null} 2022-12-08 15:48:02.181 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:48:02.226 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 365, operation:EXECUTE, state: RUNNING 2022-12-08 15:48:02.347 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=365, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:48:02.215+08:00, endTime=null} 2022-12-08 15:48:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,a8de3b5623b9] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485740, interval=60 2022-12-08 15:48:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,a8de3b5623b9] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485682, count=0, elapsed=1668815196954 2022-12-08 15:48:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,28d5e7ac0eb1] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485740, interval=60 2022-12-08 15:48:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,28d5e7ac0eb1] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485682, count=0, elapsed=1668815196958 2022-12-08 15:48:03.361 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:03.365 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:03.439 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:48:03.469 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 366, operation:EXECUTE, state: RUNNING 2022-12-08 15:48:03.622 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=366, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:48:03.452+08:00, endTime=null} 2022-12-08 15:48:03.676 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 367, operation:EXECUTE, state: RUNNING 2022-12-08 15:48:03.729 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:363, status:SUCCESS 2022-12-08 15:48:03.733 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:363, status:SUCCESS 2022-12-08 15:48:04.268 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=367, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:48:03.663+08:00, endTime=null} 2022-12-08 15:48:04.311 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:364, status:SUCCESS 2022-12-08 15:48:04.323 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:364, status:SUCCESS 2022-12-08 15:48:04.478 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:48:04.848 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:365, status:SUCCESS 2022-12-08 15:48:04.931 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:05.142 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:04.935 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:05.143 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:05.153 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:365, status:SUCCESS 2022-12-08 15:48:05.269 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:48:05.428 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:47:04+08:00, updateTime=2022-12-08T15:47:34+08:00, expireTime=null, isLeader=false} 2022-12-08 15:48:05.437 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:48:05.462 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:366, status:SUCCESS 2022-12-08 15:48:05.467 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:366, status:SUCCESS 2022-12-08 15:48:05.499 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:47:05.0, nextRun=2022-12-08 15:48:05.0, currentDate=Thu Dec 08 15:48:05 CST 2022 2022-12-08 15:48:05.499 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:47:05.0, nextRunTime=2022-12-08 15:48:05.0} 2022-12-08 15:48:05.531 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:48:05.532 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:48:05.532 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:48:05.752 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:367, status:SUCCESS 2022-12-08 15:48:05.763 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:367, status:SUCCESS 2022-12-08 15:48:05.846 INFO 42 --- [pool-ocp-schedules-11,,c7a87e73124c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:48:05.975 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:48:05.978 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:48:06.071 INFO 42 --- [pool-ocp-schedules-2,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:48:06.357 INFO 42 --- [pool-ocp-schedules-2,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:48:06.366 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:06.372 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:06.417 INFO 42 --- [pool-ocp-schedules-2,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:48:06.499 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=368, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:48:06.363+08:00, endTime=null} 2022-12-08 15:48:06.510 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:48:06.608 INFO 42 --- [pool-ocp-schedules-2,,] o.s.boot.SpringApplication : Started application in 6.557 seconds (JVM running for 1683.454) 2022-12-08 15:48:06.929 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:07.105 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:368, status:SUCCESS 2022-12-08 15:48:07.110 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:368, status:SUCCESS 2022-12-08 15:48:07.293 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:48:07.478 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:48:07.483 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:48:07.757 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:07.946 INFO 42 --- [pool-ocp-schedules-2,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:48:07.946+08:00 2022-12-08 15:48:08.250 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:08.252 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:08.499 INFO 42 --- [http-nio-8080-exec-10,a794c62fd9e0455a,7c979f6346f0] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/mc/info?null, client=192.168.28.1, traceId=a794c62fd9e0455a, method=SuccessResponse com.alipay.ocp.server.controller.OcpMultiClusterInfoController.info(), args=] 2022-12-08 15:48:08.531 INFO 42 --- [http-nio-8080-exec-10,a794c62fd9e0455a,7c979f6346f0] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/mc/info client=192.168.28.1, traceId=a794c62fd9e0455a, duration=37 ms] 2022-12-08 15:48:08.622 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:48:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:48:08.792 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:48:08.789874+08:00, lastProcessTime=2022-12-08T15:47:58.805091+08:00 2022-12-08 15:48:08.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:48:08.789874+08:00, resultsCount=0 2022-12-08 15:48:08.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:48:08.789874+08:00, resultsCount=0 2022-12-08 15:48:08.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:48:08.789874+08:00 2022-12-08 15:48:09.372 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:09.377 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:11.414 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:11.414 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:11.417 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:11.418 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:12.220 INFO 42 --- [pool-ocp-schedules-5,,a128f2b1d40c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:48:12.221 INFO 42 --- [pool-ocp-schedules-5,,a128f2b1d40c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:48:12.377 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:12.382 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:13.993 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:48:14.002 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:48:14.493 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:14.494 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:14.644 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:48:15.382 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:15.389 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:15.847 INFO 42 --- [pool-ocp-schedules-19,,9899ec7b06f0] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:48:16.314 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:48:16.318 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:48:17.081 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:17.457 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:48:17.631 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:17.631 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:17.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:17.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:18.036 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:18.389 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:18.394 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:48:18.806 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:48:18.803084+08:00, lastProcessTime=2022-12-08T15:48:08.789874+08:00 2022-12-08 15:48:18.921 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:48:18.803084+08:00, resultsCount=0 2022-12-08 15:48:18.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:48:18.803084+08:00, resultsCount=0 2022-12-08 15:48:18.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:48:18.803084+08:00 2022-12-08 15:48:19.978 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:48:19.984 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:48:20.837 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:20.837 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:21.306 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:48:21.325 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:47:21.0, nextRun=2022-12-08 15:48:20.0, currentDate=Thu Dec 08 15:48:21 CST 2022 2022-12-08 15:48:21.326 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:47:21.0, nextRunTime=2022-12-08 15:48:20.0} 2022-12-08 15:48:21.344 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:48:21.344 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:48:21.344 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:48:21.395 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:21.399 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:21.568 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:48:21.770 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 369, operation:EXECUTE, state: RUNNING 2022-12-08 15:48:21.840 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=369, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:48:21.756+08:00, endTime=null} 2022-12-08 15:48:22.738 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:369, status:SUCCESS 2022-12-08 15:48:22.747 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:369, status:SUCCESS 2022-12-08 15:48:23.903 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:23.903 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:23.903 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:23.903 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:24.400 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:24.404 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:25.848 INFO 42 --- [pool-ocp-schedules-6,,9c6dd52f3183] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:48:26.145 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:47:26.0, nextRun=2022-12-08 15:48:25.0, currentDate=Thu Dec 08 15:48:26 CST 2022 2022-12-08 15:48:26.146 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:47:26.0, nextRunTime=2022-12-08 15:48:25.0} 2022-12-08 15:48:26.212 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:48:26.213 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:48:26.213 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:48:26.510 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:48:26.532 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:48:26.577 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:48:26.601 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:48:26.982 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 370, operation:EXECUTE, state: RUNNING 2022-12-08 15:48:27.111 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=370, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:48:26.963+08:00, endTime=null} 2022-12-08 15:48:27.268 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:27.283 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:27.405 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:27.408 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:27.457 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:27.999 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:48:28.016 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:48:28.160 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:44:27.316, end=2022-12-08T15:46:27.999} 2022-12-08 15:48:28.179 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:28.197 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:48:28.382 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:370, status:SUCCESS 2022-12-08 15:48:28.399 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:370, status:SUCCESS 2022-12-08 15:48:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:48:28.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:48:28.795165+08:00, lastProcessTime=2022-12-08T15:48:18.803084+08:00 2022-12-08 15:48:28.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:48:28.795165+08:00, resultsCount=0 2022-12-08 15:48:28.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:48:28.795165+08:00, resultsCount=0 2022-12-08 15:48:28.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:48:28.795165+08:00 2022-12-08 15:48:30.409 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:30.414 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:30.932 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:47:30.0, nextRun=2022-12-08 15:48:30.0, currentDate=Thu Dec 08 15:48:30 CST 2022 2022-12-08 15:48:30.933 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:47:30.0, nextRunTime=2022-12-08 15:48:30.0} 2022-12-08 15:48:30.956 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:48:30.992 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:30.992 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:30.993 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:30.993 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:31.075 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:02.0, nextRun=2022-12-08 15:48:30.0, currentDate=Thu Dec 08 15:48:31 CST 2022 2022-12-08 15:48:31.076 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:48:02.0, nextRunTime=2022-12-08 15:48:30.0} 2022-12-08 15:48:31.092 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:48:31.093 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:48:31.093 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:48:31.238 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 371, operation:EXECUTE, state: RUNNING 2022-12-08 15:48:31.330 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=371, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:48:31.225+08:00, endTime=null} 2022-12-08 15:48:32.360 INFO 42 --- [pool-ocp-schedules-5,,7beec3803123] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:48:32.361 INFO 42 --- [pool-ocp-schedules-5,,7beec3803123] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:48:32.530 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:371, status:SUCCESS 2022-12-08 15:48:32.536 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:371, status:SUCCESS 2022-12-08 15:48:33.289 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:48:33.295 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:48:33.415 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:33.419 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:33.618 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:48:34.127 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:34.136 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:34.411 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:48:35.136 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:48:35.184 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:47:34+08:00, updateTime=2022-12-08T15:48:04+08:00, expireTime=null, isLeader=false} 2022-12-08 15:48:35.191 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:48:35.592 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:48:35.849 INFO 42 --- [pool-ocp-schedules-13,,109753273882] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:48:36.420 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:36.424 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:36.618 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:48:36.904 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:48:36.926 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:48:37.387 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:37.387 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:37.396 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:37.397 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:38.016 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:38.229 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:48:38.755 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:48:38.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:48:38.791708+08:00, lastProcessTime=2022-12-08T15:48:28.795165+08:00 2022-12-08 15:48:38.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:48:38.791708+08:00, resultsCount=0 2022-12-08 15:48:38.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:48:38.791708+08:00, resultsCount=0 2022-12-08 15:48:38.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:48:38.791708+08:00 2022-12-08 15:48:39.425 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:39.429 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:39.724 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:48:39.733 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:48:40.459 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:40.488 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:40.853 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:48:42.430 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:42.436 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:43.681 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:43.682 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:43.703 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:43.704 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:45.436 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:45.442 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:45.470 INFO 42 --- [pool-ocp-schedules-13,,4f5790061d41] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:48:45.502 INFO 42 --- [pool-ocp-schedules-13,,4f5790061d41] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:48:45.688 INFO 42 --- [pool-ocp-schedules-16,,fa1d2394204e] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:48:45.850 INFO 42 --- [pool-ocp-schedules-10,,3ddd46513ef6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:48:46.006 INFO 42 --- [pool-ocp-schedules-17,,a949f4bf2313] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:48:46.139 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:48:46.145 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:48:46.941 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:46.979 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:48:46.981 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:46.983 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:48:47.238 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:48:48.230 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:48.442 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:48.447 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:48.756 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:48:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:48:48.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:48:48.790653+08:00, lastProcessTime=2022-12-08T15:48:38.791708+08:00 2022-12-08 15:48:48.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:48:48.790653+08:00, resultsCount=0 2022-12-08 15:48:48.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:48:48.790653+08:00, resultsCount=0 2022-12-08 15:48:48.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:48:48.790653+08:00 2022-12-08 15:48:48.930 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:50.070 INFO 42 --- [pool-ocp-schedules-20,,5af998706cf5] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:48:50.173 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:50.173 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:50.174 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:50.174 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:50.726 INFO 42 --- [pool-ocp-schedules-10,,c8d129749d8e] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:48:50.907 INFO 42 --- [pool-ocp-schedules-7,,223406b3e459] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:48:50.988 INFO 42 --- [pool-ocp-schedules-6,,31047e7cbe87] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:48:50.989 INFO 42 --- [pool-ocp-schedules-6,,31047e7cbe87] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:48:50.989 INFO 42 --- [pool-ocp-schedules-6,,31047e7cbe87] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:48:51.447 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:51.452 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:51.904 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:48:52.422 INFO 42 --- [pool-ocp-schedules-15,,7bfd2d1c7f7b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:48:52.422 INFO 42 --- [pool-ocp-schedules-15,,7bfd2d1c7f7b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:48:52.476 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:48:52.481 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:48:53.736 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:53.737 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:54.085 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:48:54.453 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:54.457 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:55.851 INFO 42 --- [pool-ocp-schedules-10,,bab88a4b4117] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:48:56.809 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:56.810 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:56.835 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:48:56.835 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:48:57.162 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:48:57.165 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:48:57.458 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:48:57.465 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:48:58.320 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,41d41f20fce6] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:48:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,41d41f20fce6] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:48:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:48:58.807 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:48:58.809 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:48:58.805742+08:00, lastProcessTime=2022-12-08T15:48:48.790653+08:00 2022-12-08 15:48:58.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:48:58.805742+08:00, resultsCount=0 2022-12-08 15:48:58.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:48:58.805742+08:00, resultsCount=0 2022-12-08 15:48:58.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:48:58.805742+08:00 2022-12-08 15:48:58.975 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:48:59.365 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:48:59.370 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:48:59.900 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:48:59.932 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:00.054 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:49:00.465 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:00.476 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:00.953 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:01.0, nextRun=2022-12-08 15:49:00.0, currentDate=Thu Dec 08 15:49:00 CST 2022 2022-12-08 15:49:00.954 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:48:01.0, nextRunTime=2022-12-08 15:49:00.0} 2022-12-08 15:49:00.976 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:49:00.977 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:49:00.977 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:49:01.028 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:01.0, nextRun=2022-12-08 15:49:00.0, currentDate=Thu Dec 08 15:49:01 CST 2022 2022-12-08 15:49:01.028 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:48:01.0, nextRunTime=2022-12-08 15:49:00.0} 2022-12-08 15:49:01.056 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:49:01.057 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:49:01.057 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:49:01.120 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:01.0, nextRun=2022-12-08 15:49:00.0, currentDate=Thu Dec 08 15:49:01 CST 2022 2022-12-08 15:49:01.121 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:48:01.0, nextRunTime=2022-12-08 15:49:00.0} 2022-12-08 15:49:01.143 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:49:01.144 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:49:01.144 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:49:01.195 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:31.0, nextRun=2022-12-08 15:49:00.0, currentDate=Thu Dec 08 15:49:01 CST 2022 2022-12-08 15:49:01.195 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:48:31.0, nextRunTime=2022-12-08 15:49:00.0} 2022-12-08 15:49:01.213 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:49:01.214 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:49:01.214 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:49:01.283 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:02.0, nextRun=2022-12-08 15:49:00.0, currentDate=Thu Dec 08 15:49:01 CST 2022 2022-12-08 15:49:01.284 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:48:02.0, nextRunTime=2022-12-08 15:49:00.0} 2022-12-08 15:49:01.305 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:49:01.305 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:49:01.305 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:49:01.796 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 372, operation:EXECUTE, state: RUNNING 2022-12-08 15:49:01.930 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=372, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:49:01.780+08:00, endTime=null} 2022-12-08 15:49:02.012 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 373, operation:EXECUTE, state: RUNNING 2022-12-08 15:49:02.068 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=373, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:49:01.998+08:00, endTime=null} 2022-12-08 15:49:02.146 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 374, operation:EXECUTE, state: RUNNING 2022-12-08 15:49:02.253 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=374, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:49:02.130+08:00, endTime=null} 2022-12-08 15:49:02.319 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 375, operation:EXECUTE, state: RUNNING 2022-12-08 15:49:02.617 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=375, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:49:02.308+08:00, endTime=null} 2022-12-08 15:49:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,68a589020588] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485800, interval=60 2022-12-08 15:49:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,68a589020588] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485742, count=0, elapsed=1668815256894 2022-12-08 15:49:02.641 INFO 42 --- [pool-prometheus-minute-schedule-2,,4cb707ea78ec] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485800, interval=60 2022-12-08 15:49:02.641 INFO 42 --- [pool-prometheus-minute-schedule-2,,4cb707ea78ec] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485742, count=0, elapsed=1668815256899 2022-12-08 15:49:02.715 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 376, operation:EXECUTE, state: RUNNING 2022-12-08 15:49:02.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:02.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:03.006 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:03.006 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:03.080 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=376, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:49:02.690+08:00, endTime=null} 2022-12-08 15:49:03.477 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:03.480 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:03.721 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:49:04.250 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:372, status:SUCCESS 2022-12-08 15:49:04.258 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:372, status:SUCCESS 2022-12-08 15:49:04.575 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:373, status:SUCCESS 2022-12-08 15:49:04.581 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:373, status:SUCCESS 2022-12-08 15:49:04.891 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:374, status:SUCCESS 2022-12-08 15:49:04.897 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:374, status:SUCCESS 2022-12-08 15:49:04.999 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:375, status:SUCCESS 2022-12-08 15:49:05.005 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:375, status:SUCCESS 2022-12-08 15:49:05.080 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:376, status:SUCCESS 2022-12-08 15:49:05.086 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:376, status:SUCCESS 2022-12-08 15:49:05.255 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:49:05.291 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:49:05.304 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:49:05.622 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:49:05.682 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:05.0, nextRun=2022-12-08 15:49:05.0, currentDate=Thu Dec 08 15:49:05 CST 2022 2022-12-08 15:49:05.683 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:48:05.0, nextRunTime=2022-12-08 15:49:05.0} 2022-12-08 15:49:05.700 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:49:05.701 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:49:05.701 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:49:05.852 INFO 42 --- [pool-ocp-schedules-11,,bce6ff0de7ce] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:49:06.179 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 377, operation:EXECUTE, state: RUNNING 2022-12-08 15:49:06.202 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:06.203 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:06.481 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:06.481 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=377, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:49:06.169+08:00, endTime=null} 2022-12-08 15:49:06.484 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:06.550 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:49:07.003 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:49:07.202 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:49:07.225 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:49:08.090 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:377, status:SUCCESS 2022-12-08 15:49:08.097 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:377, status:SUCCESS 2022-12-08 15:49:08.360 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:49:08.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:49:08.795670+08:00, lastProcessTime=2022-12-08T15:48:58.805742+08:00 2022-12-08 15:49:08.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:49:08.795670+08:00, resultsCount=0 2022-12-08 15:49:08.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:49:08.795670+08:00, resultsCount=0 2022-12-08 15:49:08.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:49:08.795670+08:00 2022-12-08 15:49:08.929 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:49:09.356 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:09.485 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:09.489 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:09.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:09.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:09.550 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:09.550 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:12.062 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:49:12.069 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:49:12.490 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:12.494 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:12.621 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:12.621 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:12.743 INFO 42 --- [pool-ocp-schedules-20,,d8463e77bc38] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:49:12.744 INFO 42 --- [pool-ocp-schedules-20,,d8463e77bc38] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:49:13.157 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:49:15.495 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:15.500 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:15.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:15.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:15.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:15.756 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:15.853 INFO 42 --- [pool-ocp-schedules-16,,16cc7e5863c9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:49:17.369 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:49:17.403 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:49:18.330 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:49:18.335 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:49:18.431 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:18.501 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:18.505 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:49:18.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:49:18.799245+08:00, lastProcessTime=2022-12-08T15:49:08.795670+08:00 2022-12-08 15:49:18.900 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:18.900 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:18.931 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:49:18.799245+08:00, resultsCount=0 2022-12-08 15:49:18.932 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:49:18.799245+08:00, resultsCount=0 2022-12-08 15:49:18.932 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:49:18.799245+08:00 2022-12-08 15:49:19.356 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:49:19.420 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:49:19.485 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:21.488 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:21.0, nextRun=2022-12-08 15:49:20.0, currentDate=Thu Dec 08 15:49:21 CST 2022 2022-12-08 15:49:21.489 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:48:21.0, nextRunTime=2022-12-08 15:49:20.0} 2022-12-08 15:49:21.506 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:21.510 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:21.510 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:49:21.511 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:49:21.511 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:49:21.999 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 378, operation:EXECUTE, state: RUNNING 2022-12-08 15:49:22.071 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:49:22.176 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=378, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:49:21.983+08:00, endTime=null} 2022-12-08 15:49:22.364 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:22.364 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:22.375 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:22.376 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:24.202 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:378, status:SUCCESS 2022-12-08 15:49:24.212 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:378, status:SUCCESS 2022-12-08 15:49:24.511 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:24.516 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:24.737 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:49:24.743 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:49:25.293 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:26.0, nextRun=2022-12-08 15:49:25.0, currentDate=Thu Dec 08 15:49:25 CST 2022 2022-12-08 15:49:25.294 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:48:26.0, nextRunTime=2022-12-08 15:49:25.0} 2022-12-08 15:49:25.333 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:49:25.333 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:49:25.334 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:49:25.541 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:25.541 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:25.767 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:49:25.854 INFO 42 --- [pool-ocp-schedules-17,,42484e6e2b8c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:49:26.291 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 379, operation:EXECUTE, state: RUNNING 2022-12-08 15:49:26.478 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=379, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:49:26.279+08:00, endTime=null} 2022-12-08 15:49:27.517 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:27.525 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:27.798 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:49:27.802 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:49:28.485 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:28.607 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:379, status:SUCCESS 2022-12-08 15:49:28.613 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:379, status:SUCCESS 2022-12-08 15:49:28.724 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:28.724 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:28.724 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:28.724 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:49:28.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:49:28.799440+08:00, lastProcessTime=2022-12-08T15:49:18.799245+08:00 2022-12-08 15:49:28.928 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:49:28.799440+08:00, resultsCount=0 2022-12-08 15:49:28.928 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:49:28.799440+08:00, resultsCount=0 2022-12-08 15:49:28.928 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:49:28.799440+08:00 2022-12-08 15:49:29.413 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:49:29.579 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:30.422 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:31.0, nextRun=2022-12-08 15:49:30.0, currentDate=Thu Dec 08 15:49:30 CST 2022 2022-12-08 15:49:30.423 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:48:31.0, nextRunTime=2022-12-08 15:49:30.0} 2022-12-08 15:49:30.463 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:49:30.526 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:30.531 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:30.647 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:49:01.0, nextRun=2022-12-08 15:49:30.0, currentDate=Thu Dec 08 15:49:30 CST 2022 2022-12-08 15:49:30.648 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:49:01.0, nextRunTime=2022-12-08 15:49:30.0} 2022-12-08 15:49:30.667 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:49:30.667 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:49:30.667 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:49:31.109 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:49:31.117 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:49:31.609 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 380, operation:EXECUTE, state: RUNNING 2022-12-08 15:49:31.668 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=380, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:49:31.595+08:00, endTime=null} 2022-12-08 15:49:31.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:31.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:32.246 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:49:32.493 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:380, status:SUCCESS 2022-12-08 15:49:32.499 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:380, status:SUCCESS 2022-12-08 15:49:32.866 INFO 42 --- [pool-ocp-schedules-12,,05fb987eeea0] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:49:32.868 INFO 42 --- [pool-ocp-schedules-12,,05fb987eeea0] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:49:33.532 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:33.537 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:34.083 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:49:34.174 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:47:03+08:00, updateTime=2022-12-08T15:49:03+08:00, expireTime=null, isLeader=false} 2022-12-08 15:49:34.190 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:49:35.159 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:35.159 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:35.159 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:35.159 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:35.323 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:49:35.729 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:49:35.856 INFO 42 --- [pool-ocp-schedules-4,,4b11a4c790ad] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:49:36.538 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:36.543 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:37.415 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:49:37.825 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:49:37.831 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:49:38.003 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:49:38.006 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:49:38.287 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:38.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:38.451 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:49:38.544 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:49:38.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:49:38.791912+08:00, lastProcessTime=2022-12-08T15:49:28.799440+08:00 2022-12-08 15:49:38.886 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:49:38.791912+08:00, resultsCount=0 2022-12-08 15:49:38.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:49:38.791912+08:00, resultsCount=0 2022-12-08 15:49:38.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:49:38.791912+08:00 2022-12-08 15:49:39.544 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:39.549 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:39.579 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:49:39.696 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:40.353 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:49:40.373 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=19ms, period=120000ms 2022-12-08 15:49:41.353 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:41.354 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:41.356 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:41.357 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:42.550 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:42.554 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:43.775 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:49:43.781 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:49:44.453 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:44.454 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:44.867 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:49:45.470 INFO 42 --- [pool-ocp-schedules-11,,e8874079f6f8] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:49:45.504 INFO 42 --- [pool-ocp-schedules-11,,e8874079f6f8] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:49:45.555 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:45.560 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:45.689 INFO 42 --- [pool-ocp-schedules-16,,6cc56e01d87c] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:49:45.736 INFO 42 --- [pool-ocp-schedules-2,,809620e0e3b2] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:49:45.736 INFO 42 --- [pool-ocp-schedules-2,,809620e0e3b2] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:49:45.857 INFO 42 --- [pool-ocp-schedules-14,,f20366d22474] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:49:46.024 INFO 42 --- [pool-ocp-schedules-4,,e62f5f836603] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:49:47.521 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:47.522 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:47.522 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:47.522 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:48.046 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:49:48.092 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:49:48.561 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:48.565 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:48.679 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:49:48.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:49:48.794650+08:00, lastProcessTime=2022-12-08T15:49:38.791912+08:00 2022-12-08 15:49:48.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:49:48.794650+08:00, resultsCount=0 2022-12-08 15:49:48.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:49:48.794650+08:00, resultsCount=0 2022-12-08 15:49:48.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:49:48.794650+08:00 2022-12-08 15:49:49.628 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:49:49.791 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:50.224 INFO 42 --- [pool-ocp-schedules-18,,88f114e47094] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:49:50.378 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:49:50.387 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:49:50.673 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:50.675 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:49:50.812 INFO 42 --- [pool-ocp-schedules-20,,3d709677fd70] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:49:51.197 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:49:51.542 INFO 42 --- [pool-ocp-schedules-7,,94e1f97cfcbc] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:49:51.566 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:51.570 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:51.574 INFO 42 --- [pool-ocp-schedules-5,,049c9ca779db] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:49:51.575 INFO 42 --- [pool-ocp-schedules-5,,049c9ca779db] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:49:51.575 INFO 42 --- [pool-ocp-schedules-5,,049c9ca779db] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:49:51.793 INFO 42 --- [http-nio-8080-exec-6,dacfffa28cfc4414,75adef8aed71] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=dacfffa28cfc4414, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 15:49:51.814 INFO 42 --- [http-nio-8080-exec-6,dacfffa28cfc4414,75adef8aed71] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=dacfffa28cfc4414, duration=25 ms] 2022-12-08 15:49:52.770 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:49:52.931 INFO 42 --- [pool-ocp-schedules-6,,165cae1c9e09] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:49:52.932 INFO 42 --- [pool-ocp-schedules-6,,165cae1c9e09] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:49:53.315 INFO 42 --- [http-nio-8080-exec-5,,] c.a.o.s.i.a.m.ClientLoginAttemptManager : Increase client ip login failed attempts, clientAddress=192.168.28.1, attempts=1 2022-12-08 15:49:53.316 WARN 42 --- [http-nio-8080-exec-5,,] o.s.a.CustomAuthenticationFailureHandler : Authentication failure: ip=192.168.28.1, userId=100, username=admin, message=用户名或者密码错误，请重试。您还剩余5次机会 2022-12-08 15:49:53.786 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:53.787 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:53.789 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:49:53.789 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:49:54.570 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:54.575 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:55.858 INFO 42 --- [pool-ocp-schedules-13,,0a8b28bf5a87] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:49:56.766 INFO 42 --- [http-nio-8080-exec-10,9e3c361c5b14424a,aa7b0f2a07e0] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=9e3c361c5b14424a, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 15:49:56.767 INFO 42 --- [http-nio-8080-exec-10,9e3c361c5b14424a,aa7b0f2a07e0] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=9e3c361c5b14424a, duration=2 ms] 2022-12-08 15:49:56.839 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:49:56.845 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:49:57.273 INFO 42 --- [http-nio-8080-exec-7,,] c.a.o.s.i.a.m.ClientLoginAttemptManager : Increase client ip login failed attempts, clientAddress=192.168.28.1, attempts=2 2022-12-08 15:49:57.273 WARN 42 --- [http-nio-8080-exec-7,,] o.s.a.CustomAuthenticationFailureHandler : Authentication failure: ip=192.168.28.1, userId=100, username=admin, message=用户名或者密码错误，请重试。您还剩余4次机会 2022-12-08 15:49:57.576 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:49:57.581 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:49:58.386 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:49:58.443 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:49:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,fa3af7140fa3] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:49:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,fa3af7140fa3] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:49:58.765 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:49:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:49:58.808 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:49:58.804019+08:00, lastProcessTime=2022-12-08T15:49:48.794650+08:00 2022-12-08 15:49:58.955 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:49:58.804019+08:00, resultsCount=0 2022-12-08 15:49:58.956 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:49:58.804019+08:00, resultsCount=0 2022-12-08 15:49:58.956 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:49:58.804019+08:00 2022-12-08 15:49:59.675 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:49:59.859 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:00.582 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:00.587 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:00.828 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:02.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:00 CST 2022 2022-12-08 15:50:00.829 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=12, name=Refresh agent config, templateName=RefreshAgentConfigSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 15:40:02.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:00.846 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Refresh agent config, nodeCount=1, taskCount=1 2022-12-08 15:50:00.847 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:00.847 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Refresh agent config, taskDefinitionId=12, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:01.305 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:48:00.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:01 CST 2022 2022-12-08 15:50:01.305 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:48:00.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:01.339 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:50:01.380 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 381, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:01.454 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:40:03.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:01 CST 2022 2022-12-08 15:50:01.455 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=15, name=Sync system event, templateName=SyncSystemEventSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 15:40:03.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:01.483 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync system event 2022-12-08 15:50:01.518 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=381, name=Refresh all agent config, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.RefreshAllAgentConfigTask, seriesId=0, startTime=2022-12-08T15:50:01.363+08:00, endTime=null} 2022-12-08 15:50:01.932 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:01.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:01 CST 2022 2022-12-08 15:50:01.933 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 15:45:01.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:01.959 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 15:50:01.960 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:01.960 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:02.071 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:01.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:02 CST 2022 2022-12-08 15:50:02.071 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:45:01.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:02.115 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 15:50:02.116 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 15:50:02.191 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:49:01.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:02 CST 2022 2022-12-08 15:50:02.192 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:49:01.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:02.211 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:50:02.211 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:02.212 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:02.302 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:49:01.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:02 CST 2022 2022-12-08 15:50:02.303 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:49:01.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:02.332 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:50:02.333 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:02.333 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:02.386 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:49:01.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:02 CST 2022 2022-12-08 15:50:02.387 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:49:01.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:02.418 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:50:02.418 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:02.419 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:02.516 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:49:31.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:02 CST 2022 2022-12-08 15:50:02.517 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:49:31.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:02.536 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:50:02.537 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:02.537 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:02.583 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:45:01.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:02 CST 2022 2022-12-08 15:50:02.584 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:45:01.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:02.609 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 15:50:02.609 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:02.609 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:02.616 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 384, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,5013af14775f] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485860, interval=60 2022-12-08 15:50:02.638 INFO 42 --- [pool-prometheus-minute-schedule-2,,5013af14775f] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485802, count=0, elapsed=1668815316836 2022-12-08 15:50:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,1056df29b33a] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485860, interval=60 2022-12-08 15:50:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,1056df29b33a] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485802, count=0, elapsed=1668815316838 2022-12-08 15:50:02.710 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=384, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:50:02.596+08:00, endTime=null} 2022-12-08 15:50:02.714 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:49:01.0, nextRun=2022-12-08 15:50:00.0, currentDate=Thu Dec 08 15:50:02 CST 2022 2022-12-08 15:50:02.715 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:49:01.0, nextRunTime=2022-12-08 15:50:00.0} 2022-12-08 15:50:02.734 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:50:02.734 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:02.734 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:02.776 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 385, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:02.838 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=385, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:50:02.761+08:00, endTime=null} 2022-12-08 15:50:02.939 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 382, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:03.112 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=382, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T15:50:02.915+08:00, endTime=null} 2022-12-08 15:50:03.206 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 383, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:03.292 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=383, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:50:03.188+08:00, endTime=null} 2022-12-08 15:50:03.476 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:381, status:SUCCESS 2022-12-08 15:50:03.487 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:381, status:SUCCESS 2022-12-08 15:50:03.588 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:03.595 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:03.767 INFO 42 --- [http-nio-8080-exec-3,e9af02379f9f45cb,9b3de5692e12] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=e9af02379f9f45cb, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 15:50:03.767 INFO 42 --- [http-nio-8080-exec-3,e9af02379f9f45cb,9b3de5692e12] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=e9af02379f9f45cb, duration=2 ms] 2022-12-08 15:50:03.846 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:384, status:SUCCESS 2022-12-08 15:50:03.852 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:384, status:SUCCESS 2022-12-08 15:50:03.985 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:385, status:SUCCESS 2022-12-08 15:50:03.990 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:385, status:SUCCESS 2022-12-08 15:50:04.282 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:50:04.370 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 386, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:04.439 INFO 42 --- [http-nio-8080-exec-2,,] c.a.o.s.i.a.m.ClientLoginAttemptManager : Increase client ip login failed attempts, clientAddress=192.168.28.1, attempts=3 2022-12-08 15:50:04.439 WARN 42 --- [http-nio-8080-exec-2,,] o.s.a.CustomAuthenticationFailureHandler : Authentication failure: ip=192.168.28.1, userId=100, username=admin, message=用户名或者密码错误，请重试。您还剩余3次机会 2022-12-08 15:50:04.471 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=386, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:50:04.359+08:00, endTime=null} 2022-12-08 15:50:04.527 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 387, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:04.587 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=387, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T15:50:04.515+08:00, endTime=null} 2022-12-08 15:50:04.642 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 388, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:04.982 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=388, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:50:04.633+08:00, endTime=null} 2022-12-08 15:50:05.364 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:50:05.850 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:50:05.860 INFO 42 --- [pool-ocp-schedules-13,,d6b85bf2c2e7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:50:06.013 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:382, status:SUCCESS 2022-12-08 15:50:06.030 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:382, status:SUCCESS 2022-12-08 15:50:06.042 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:49:06.0, nextRun=2022-12-08 15:50:05.0, currentDate=Thu Dec 08 15:50:06 CST 2022 2022-12-08 15:50:06.043 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:49:06.0, nextRunTime=2022-12-08 15:50:05.0} 2022-12-08 15:50:06.061 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:50:06.062 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:06.062 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:06.138 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:383, status:SUCCESS 2022-12-08 15:50:06.145 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:383, status:SUCCESS 2022-12-08 15:50:06.317 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:386, status:SUCCESS 2022-12-08 15:50:06.325 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:386, status:SUCCESS 2022-12-08 15:50:06.457 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:387, status:SUCCESS 2022-12-08 15:50:06.464 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:387, status:SUCCESS 2022-12-08 15:50:06.559 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:388, status:SUCCESS 2022-12-08 15:50:06.566 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:388, status:SUCCESS 2022-12-08 15:50:06.595 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:06.600 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:07.076 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 389, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:07.076 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:50:07.142 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=389, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:50:07.065+08:00, endTime=null} 2022-12-08 15:50:07.788 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:389, status:SUCCESS 2022-12-08 15:50:07.795 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:389, status:SUCCESS 2022-12-08 15:50:07.839 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:50:08.429 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:50:08.681 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:50:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:50:08.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:50:08.795753+08:00, lastProcessTime=2022-12-08T15:49:58.804019+08:00 2022-12-08 15:50:08.893 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:08.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:50:08.795753+08:00, resultsCount=0 2022-12-08 15:50:08.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:50:08.795753+08:00, resultsCount=0 2022-12-08 15:50:08.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:50:08.795753+08:00 2022-12-08 15:50:09.601 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:09.605 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:09.714 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:50:09.899 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:12.210 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:50:12.218 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:50:12.471 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:12.472 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:12.606 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:12.611 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:12.835 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:50:13.138 INFO 42 --- [pool-ocp-schedules-1,,43a2c47025cc] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:50:13.139 INFO 42 --- [pool-ocp-schedules-1,,43a2c47025cc] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:50:15.612 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:15.617 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:15.629 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:15.629 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:15.643 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:15.643 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:15.861 INFO 42 --- [pool-ocp-schedules-9,,eb3791ac676f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:50:18.456 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:50:18.462 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:50:18.496 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:50:18.617 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:18.622 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:18.703 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:18.726 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:50:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:50:18.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:50:18.800007+08:00, lastProcessTime=2022-12-08T15:50:08.795753+08:00 2022-12-08 15:50:18.805 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:18.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:50:18.800007+08:00, resultsCount=0 2022-12-08 15:50:18.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:50:18.800007+08:00, resultsCount=0 2022-12-08 15:50:18.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:50:18.800007+08:00 2022-12-08 15:50:18.987 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:19.128 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:50:19.758 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:50:19.967 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:20.095 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:49:21.0, nextRun=2022-12-08 15:50:20.0, currentDate=Thu Dec 08 15:50:20 CST 2022 2022-12-08 15:50:20.096 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:49:21.0, nextRunTime=2022-12-08 15:50:20.0} 2022-12-08 15:50:20.119 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:50:20.120 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:20.120 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:20.404 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 390, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:20.584 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=390, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:50:20.389+08:00, endTime=null} 2022-12-08 15:50:21.623 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:21.627 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:21.840 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:390, status:SUCCESS 2022-12-08 15:50:21.847 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:390, status:SUCCESS 2022-12-08 15:50:21.916 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:21.917 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:22.011 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:22.011 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:22.951 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:50:24.325 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:50:24.331 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:50:24.628 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:24.632 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:25.043 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:25.104 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:25.410 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:50:25.799 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:49:25.0, nextRun=2022-12-08 15:50:25.0, currentDate=Thu Dec 08 15:50:25 CST 2022 2022-12-08 15:50:25.799 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:49:25.0, nextRunTime=2022-12-08 15:50:25.0} 2022-12-08 15:50:25.864 INFO 42 --- [pool-ocp-schedules-3,,6d69ee02e665] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:50:25.934 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:50:25.934 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:25.935 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:26.745 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 391, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:26.826 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=391, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:50:26.732+08:00, endTime=null} 2022-12-08 15:50:27.633 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:27.640 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:28.137 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:391, status:SUCCESS 2022-12-08 15:50:28.143 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:391, status:SUCCESS 2022-12-08 15:50:28.149 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:28.149 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:28.211 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:28.211 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:28.456 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:46:27.999, end=2022-12-08T15:48:28.366} 2022-12-08 15:50:28.490 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:50:28.607 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:50:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:50:28.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:50:28.793743+08:00, lastProcessTime=2022-12-08T15:50:18.800007+08:00 2022-12-08 15:50:28.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:50:28.793743+08:00, resultsCount=0 2022-12-08 15:50:28.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:50:28.793743+08:00, resultsCount=0 2022-12-08 15:50:28.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:50:28.793743+08:00 2022-12-08 15:50:28.947 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:50:29.169 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:29.791 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:50:30.004 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:30.224 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:49:30.0, nextRun=2022-12-08 15:50:30.0, currentDate=Thu Dec 08 15:50:30 CST 2022 2022-12-08 15:50:30.224 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:49:30.0, nextRunTime=2022-12-08 15:50:30.0} 2022-12-08 15:50:30.245 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:50:30.390 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:03.0, nextRun=2022-12-08 15:50:30.0, currentDate=Thu Dec 08 15:50:30 CST 2022 2022-12-08 15:50:30.391 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:50:03.0, nextRunTime=2022-12-08 15:50:30.0} 2022-12-08 15:50:30.407 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:50:30.408 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:50:30.409 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:50:30.641 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:30.647 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:30.702 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:50:30.708 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:50:30.932 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 392, operation:EXECUTE, state: RUNNING 2022-12-08 15:50:31.005 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=392, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:50:30.922+08:00, endTime=null} 2022-12-08 15:50:31.221 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:31.315 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:31.819 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:50:31.864 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:392, status:SUCCESS 2022-12-08 15:50:31.871 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:392, status:SUCCESS 2022-12-08 15:50:33.192 INFO 42 --- [pool-ocp-schedules-20,,876787adf8c5] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:50:33.192 INFO 42 --- [pool-ocp-schedules-20,,876787adf8c5] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:50:33.647 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:33.652 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:34.437 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:50:34.437 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:34.438 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:34.439 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:34.439 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:35.850 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:50:35.865 INFO 42 --- [pool-ocp-schedules-18,,1cde8cc83c49] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:50:35.995 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:50:36.653 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:36.658 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:37.081 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:50:37.086 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:50:37.506 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:37.513 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:37.725 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:50:37.985 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:50:38.664 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:50:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:50:38.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:50:38.797007+08:00, lastProcessTime=2022-12-08T15:50:28.793743+08:00 2022-12-08 15:50:38.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:50:38.797007+08:00, resultsCount=0 2022-12-08 15:50:38.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:50:38.797007+08:00, resultsCount=0 2022-12-08 15:50:38.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:50:38.797007+08:00 2022-12-08 15:50:39.009 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:50:39.216 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:39.658 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:39.664 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:39.833 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:50:40.040 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:40.639 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:40.639 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:40.640 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:40.640 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:42.665 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:42.672 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:43.021 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:50:43.027 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:50:43.799 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:43.799 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:44.243 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:50:45.467 INFO 42 --- [pool-ocp-schedules-20,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 15:50:45.471 INFO 42 --- [pool-ocp-schedules-5,,1fffce6268fa] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:50:45.522 INFO 42 --- [pool-ocp-schedules-5,,1fffce6268fa] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:50:45.673 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:45.684 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:45.691 INFO 42 --- [pool-ocp-schedules-11,,ede46227e529] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:50:45.866 INFO 42 --- [pool-ocp-schedules-2,,05ab7578636a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:50:45.877 INFO 42 --- [pool-ocp-schedules-6,,228104607b84] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 15:50:46.029 INFO 42 --- [pool-ocp-schedules-15,,15697f90779e] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:50:46.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:46.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:46.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:46.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:48.685 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:48.690 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:48.715 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:50:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:50:48.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:50:48.794242+08:00, lastProcessTime=2022-12-08T15:50:38.797007+08:00 2022-12-08 15:50:48.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:50:48.794242+08:00, resultsCount=0 2022-12-08 15:50:48.898 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:50:48.794242+08:00, resultsCount=0 2022-12-08 15:50:48.898 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:50:48.794242+08:00 2022-12-08 15:50:49.049 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:50:49.264 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:49.505 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:50:49.515 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:50:49.866 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:50:50.291 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:50.316 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:50.319 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:50.406 INFO 42 --- [pool-ocp-schedules-8,,560ba1d2b36e] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:50:50.643 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:50:50.882 INFO 42 --- [pool-ocp-schedules-20,,a0a13722eeb3] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:50:51.691 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:51.816 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:51.934 INFO 42 --- [pool-ocp-schedules-11,,15cbaef3bbe8] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:50:51.965 INFO 42 --- [pool-ocp-schedules-15,,8aa8d06bb9d4] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:50:51.965 INFO 42 --- [pool-ocp-schedules-15,,8aa8d06bb9d4] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:50:51.966 INFO 42 --- [pool-ocp-schedules-15,,8aa8d06bb9d4] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:50:53.039 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:50:53.372 INFO 42 --- [pool-ocp-schedules-4,,02c2aea3331b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:50:53.373 INFO 42 --- [pool-ocp-schedules-4,,02c2aea3331b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:50:53.417 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:53.417 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:53.420 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:53.421 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:54.817 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:54.822 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:55.041 INFO 42 --- [http-nio-8080-exec-8,fea7275a42304609,beb63970f38d] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=fea7275a42304609, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 15:50:55.042 INFO 42 --- [http-nio-8080-exec-8,fea7275a42304609,beb63970f38d] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=fea7275a42304609, duration=2 ms] 2022-12-08 15:50:55.796 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:50:55.803 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:50:55.868 INFO 42 --- [pool-ocp-schedules-19,,26e52e2380bd] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:50:56.309 INFO 42 --- [http-nio-8080-exec-9,,] o.s.a.CustomAuthenticationSuccessHandler : Authentication successful for /api/v2/iam/login 2022-12-08 15:50:56.433 INFO 42 --- [http-nio-8080-exec-9,,] o.s.a.CustomAuthenticationSuccessHandler : Redirecting to saved url: / 2022-12-08 15:50:56.528 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:56.529 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:50:56.915 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:50:57.823 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:50:57.830 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:50:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,136a683bad67] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:50:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,136a683bad67] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:50:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:50:58.783 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:50:58.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:50:58.796196+08:00, lastProcessTime=2022-12-08T15:50:48.794242+08:00 2022-12-08 15:50:58.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:50:58.796196+08:00, resultsCount=0 2022-12-08 15:50:58.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:50:58.796196+08:00, resultsCount=0 2022-12-08 15:50:58.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:50:58.796196+08:00 2022-12-08 15:50:59.084 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:50:59.301 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:50:59.660 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:59.661 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:59.661 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:50:59.661 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:50:59.938 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:51:00.000 INFO 42 --- [pool-ocp-schedules-3,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:51:00.402 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:00.819 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:02.0, nextRun=2022-12-08 15:51:00.0, currentDate=Thu Dec 08 15:51:00 CST 2022 2022-12-08 15:51:00.819 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:50:02.0, nextRunTime=2022-12-08 15:51:00.0} 2022-12-08 15:51:00.831 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:00.834 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:51:00.835 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:51:00.835 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:51:00.841 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:00.879 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:02.0, nextRun=2022-12-08 15:51:00.0, currentDate=Thu Dec 08 15:51:00 CST 2022 2022-12-08 15:51:00.880 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:50:02.0, nextRunTime=2022-12-08 15:51:00.0} 2022-12-08 15:51:00.901 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:51:00.902 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:51:00.902 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:51:00.979 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:02.0, nextRun=2022-12-08 15:51:00.0, currentDate=Thu Dec 08 15:51:00 CST 2022 2022-12-08 15:51:00.980 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:50:02.0, nextRunTime=2022-12-08 15:51:00.0} 2022-12-08 15:51:01.018 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:51:01.018 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:51:01.018 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:51:01.115 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:30.0, nextRun=2022-12-08 15:51:00.0, currentDate=Thu Dec 08 15:51:01 CST 2022 2022-12-08 15:51:01.115 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:50:30.0, nextRunTime=2022-12-08 15:51:00.0} 2022-12-08 15:51:01.131 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:51:01.132 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:51:01.132 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:51:01.196 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:03.0, nextRun=2022-12-08 15:51:00.0, currentDate=Thu Dec 08 15:51:01 CST 2022 2022-12-08 15:51:01.197 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:50:03.0, nextRunTime=2022-12-08 15:51:00.0} 2022-12-08 15:51:01.223 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:51:01.224 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:51:01.224 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:51:01.480 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 393, operation:EXECUTE, state: RUNNING 2022-12-08 15:51:01.527 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=393, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:51:01.456+08:00, endTime=null} 2022-12-08 15:51:01.658 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 394, operation:EXECUTE, state: RUNNING 2022-12-08 15:51:01.704 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=394, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:51:01.636+08:00, endTime=null} 2022-12-08 15:51:01.824 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 395, operation:EXECUTE, state: RUNNING 2022-12-08 15:51:01.938 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=395, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:51:01.796+08:00, endTime=null} 2022-12-08 15:51:02.017 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 396, operation:EXECUTE, state: RUNNING 2022-12-08 15:51:02.139 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=396, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:51:02.002+08:00, endTime=null} 2022-12-08 15:51:02.183 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:51:02.189 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:51:02.220 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 397, operation:EXECUTE, state: RUNNING 2022-12-08 15:51:02.277 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=397, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:51:02.196+08:00, endTime=null} 2022-12-08 15:51:02.634 INFO 42 --- [pool-prometheus-minute-schedule-1,,8155da36c5b4] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485920, interval=60 2022-12-08 15:51:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,8155da36c5b4] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485862, count=0, elapsed=1668815376773 2022-12-08 15:51:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,effa35ace97d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485920, interval=60 2022-12-08 15:51:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,effa35ace97d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485862, count=0, elapsed=1668815376778 2022-12-08 15:51:02.745 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:02.760 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:03.188 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:51:03.374 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:393, status:SUCCESS 2022-12-08 15:51:03.388 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:393, status:SUCCESS 2022-12-08 15:51:03.521 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:394, status:SUCCESS 2022-12-08 15:51:03.953 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:03.958 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:03.960 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:394, status:SUCCESS 2022-12-08 15:51:04.208 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:395, status:SUCCESS 2022-12-08 15:51:04.214 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:395, status:SUCCESS 2022-12-08 15:51:04.360 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:396, status:SUCCESS 2022-12-08 15:51:04.365 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:396, status:SUCCESS 2022-12-08 15:51:04.448 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:397, status:SUCCESS 2022-12-08 15:51:04.456 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:397, status:SUCCESS 2022-12-08 15:51:04.496 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:51:05.655 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:06.0, nextRun=2022-12-08 15:51:05.0, currentDate=Thu Dec 08 15:51:05 CST 2022 2022-12-08 15:51:05.656 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:50:06.0, nextRunTime=2022-12-08 15:51:05.0} 2022-12-08 15:51:05.675 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:51:05.676 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:51:05.677 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:51:05.869 INFO 42 --- [pool-ocp-schedules-15,,ed1fff15bd5d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:51:05.879 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:51:05.965 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:05.965 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:06.029 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:51:06.176 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:06.177 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:06.338 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:48:05+08:00, updateTime=2022-12-08T15:50:35+08:00, expireTime=null, isLeader=false} 2022-12-08 15:51:06.344 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:51:06.419 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 398, operation:EXECUTE, state: RUNNING 2022-12-08 15:51:06.483 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=398, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:51:06.380+08:00, endTime=null} 2022-12-08 15:51:06.959 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:06.963 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:07.052 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:398, status:SUCCESS 2022-12-08 15:51:07.057 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:398, status:SUCCESS 2022-12-08 15:51:07.870 INFO 42 --- [pool-ocp-schedules-3,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:51:08.235 INFO 42 --- [pool-ocp-schedules-3,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:51:08.421 INFO 42 --- [pool-ocp-schedules-3,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:51:08.500 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:51:08.519 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:51:08.730 INFO 42 --- [pool-ocp-schedules-3,,] o.s.boot.SpringApplication : Started application in 8.674 seconds (JVM running for 1865.576) 2022-12-08 15:51:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:51:08.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:51:08.797403+08:00, lastProcessTime=2022-12-08T15:50:58.796196+08:00 2022-12-08 15:51:08.875 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:51:08.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:51:08.797403+08:00, resultsCount=0 2022-12-08 15:51:08.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:51:08.797403+08:00, resultsCount=0 2022-12-08 15:51:08.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:51:08.797403+08:00 2022-12-08 15:51:09.249 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:51:09.350 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:09.352 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:09.413 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:09.847 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:51:09.964 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:09.969 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:10.000 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:51:10.448 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:10.456 INFO 42 --- [pool-ocp-schedules-3,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:51:10.456+08:00 2022-12-08 15:51:12.553 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:12.554 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:12.565 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:12.565 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:12.970 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:12.975 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:13.641 INFO 42 --- [pool-ocp-schedules-14,,213089f49a26] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:51:13.642 INFO 42 --- [pool-ocp-schedules-14,,213089f49a26] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:51:15.082 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:51:15.087 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:51:15.774 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:15.777 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:15.870 INFO 42 --- [pool-ocp-schedules-19,,4ff148601e0c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:51:15.975 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:15.979 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:16.217 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:51:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:51:18.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:51:18.793540+08:00, lastProcessTime=2022-12-08T15:51:08.797403+08:00 2022-12-08 15:51:18.883 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:18.883 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:18.883 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:18.884 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:18.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:51:18.793540+08:00, resultsCount=0 2022-12-08 15:51:18.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:51:18.793540+08:00, resultsCount=0 2022-12-08 15:51:18.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:51:18.793540+08:00 2022-12-08 15:51:18.980 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:18.984 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:19.414 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:51:19.416 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:51:20.094 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:20.0, nextRun=2022-12-08 15:51:20.0, currentDate=Thu Dec 08 15:51:20 CST 2022 2022-12-08 15:51:20.095 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:50:20.0, nextRunTime=2022-12-08 15:51:20.0} 2022-12-08 15:51:20.113 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:51:20.114 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:51:20.114 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:51:20.457 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:20.833 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:51:20.919 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 399, operation:EXECUTE, state: RUNNING 2022-12-08 15:51:21.031 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:21.036 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T15:45:19.759, end=2022-12-08T15:50:20.832} 2022-12-08 15:51:21.041 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T15:45:19.759, end=2022-12-08T15:50:20.832} 2022-12-08 15:51:21.063 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:51:21.065 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:51:21.461 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=399, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:51:20.880+08:00, endTime=null} 2022-12-08 15:51:21.985 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:21.990 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:22.109 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:51:22.115 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:51:23.448 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:51:23.595 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:399, status:SUCCESS 2022-12-08 15:51:23.603 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:399, status:SUCCESS 2022-12-08 15:51:24.991 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:24.995 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:25.164 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:25.164 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:25.480 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:51:25.808 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:26.0, nextRun=2022-12-08 15:51:25.0, currentDate=Thu Dec 08 15:51:25 CST 2022 2022-12-08 15:51:25.809 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:50:26.0, nextRunTime=2022-12-08 15:51:25.0} 2022-12-08 15:51:25.851 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:51:25.852 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:51:25.852 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:51:25.871 INFO 42 --- [pool-ocp-schedules-19,,73d8b15baa40] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:51:26.602 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 400, operation:EXECUTE, state: RUNNING 2022-12-08 15:51:26.960 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=400, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:51:26.590+08:00, endTime=null} 2022-12-08 15:51:27.996 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:28.000 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:28.248 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:28.249 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:28.249 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:28.249 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:28.521 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:400, status:SUCCESS 2022-12-08 15:51:28.527 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:400, status:SUCCESS 2022-12-08 15:51:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:51:28.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:51:28.792618+08:00, lastProcessTime=2022-12-08T15:51:18.793540+08:00 2022-12-08 15:51:28.888 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:51:28.792618+08:00, resultsCount=0 2022-12-08 15:51:28.889 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:51:28.792618+08:00, resultsCount=0 2022-12-08 15:51:28.889 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:51:28.792618+08:00 2022-12-08 15:51:30.457 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:51:30.460 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:51:30.840 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:31.001 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:31.005 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:31.112 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:51:31.119 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:51:31.152 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:30.0, nextRun=2022-12-08 15:51:30.0, currentDate=Thu Dec 08 15:51:31 CST 2022 2022-12-08 15:51:31.152 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:50:30.0, nextRunTime=2022-12-08 15:51:30.0} 2022-12-08 15:51:31.183 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:51:31.206 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:51:31.324 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:31.324 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:31.354 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:51:01.0, nextRun=2022-12-08 15:51:30.0, currentDate=Thu Dec 08 15:51:31 CST 2022 2022-12-08 15:51:31.355 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:51:01.0, nextRunTime=2022-12-08 15:51:30.0} 2022-12-08 15:51:31.375 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:51:31.376 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:51:31.376 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:51:31.838 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:51:31.965 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:32.100 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 401, operation:EXECUTE, state: RUNNING 2022-12-08 15:51:32.143 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=401, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:51:32.089+08:00, endTime=null} 2022-12-08 15:51:33.379 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:401, status:SUCCESS 2022-12-08 15:51:33.385 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:401, status:SUCCESS 2022-12-08 15:51:34.006 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:34.010 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:34.205 INFO 42 --- [pool-ocp-schedules-15,,a0a9d873798c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:51:34.206 INFO 42 --- [pool-ocp-schedules-15,,a0a9d873798c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:51:34.397 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:34.399 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:34.399 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:34.401 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:34.530 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:51:35.873 INFO 42 --- [pool-ocp-schedules-15,,c7a77659306e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:51:35.939 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:51:36.396 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:51:37.011 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:37.015 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:37.069 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:51:37.074 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:51:38.207 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:38.267 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:38.494 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:51:38.681 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:51:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:51:38.807 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:51:38.805266+08:00, lastProcessTime=2022-12-08T15:51:28.792618+08:00 2022-12-08 15:51:38.926 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:51:38.805266+08:00, resultsCount=0 2022-12-08 15:51:38.927 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:51:38.805266+08:00, resultsCount=0 2022-12-08 15:51:38.928 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:51:38.805266+08:00 2022-12-08 15:51:40.015 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:40.020 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:40.282 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:51:40.297 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=15ms, period=120000ms 2022-12-08 15:51:40.840 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:51:40.844 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:51:41.206 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:41.274 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:41.275 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:41.389 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:41.389 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:41.696 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:51:42.093 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:43.021 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:43.026 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:44.030 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:51:44.036 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:51:44.718 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:44.934 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:45.132 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:51:45.470 INFO 42 --- [pool-ocp-schedules-16,,dd3ccabc9895] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:51:45.499 INFO 42 --- [pool-ocp-schedules-16,,dd3ccabc9895] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:51:45.692 INFO 42 --- [pool-ocp-schedules-13,,77aeb9d54e8c] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:51:45.737 INFO 42 --- [pool-ocp-schedules-18,,fd507623ebdc] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:51:45.738 INFO 42 --- [pool-ocp-schedules-18,,fd507623ebdc] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:51:45.876 INFO 42 --- [pool-ocp-schedules-19,,dfd2d55396a1] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:51:46.027 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:46.033 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:46.033 INFO 42 --- [pool-ocp-schedules-2,,f34844e4094d] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:51:47.845 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:47.846 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:48.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:48.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:51:48.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:51:48.797706+08:00, lastProcessTime=2022-12-08T15:51:38.805266+08:00 2022-12-08 15:51:48.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:51:48.797706+08:00, resultsCount=0 2022-12-08 15:51:48.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:51:48.797706+08:00, resultsCount=0 2022-12-08 15:51:48.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:51:48.797706+08:00 2022-12-08 15:51:49.034 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:49.038 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:50.515 INFO 42 --- [pool-ocp-schedules-19,,9bfc0d1fc508] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:51:50.552 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:51:50.559 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:51:50.933 INFO 42 --- [pool-ocp-schedules-7,,0499c6a72051] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:51:50.983 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:51:50.986 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:51:51.125 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:51.125 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:51.673 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:51:51.697 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:51.993 INFO 42 --- [pool-ocp-schedules-18,,5ca90ba8149b] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:51:52.039 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:52.044 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:52.054 INFO 42 --- [pool-ocp-schedules-15,,c73312046879] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:51:52.055 INFO 42 --- [pool-ocp-schedules-15,,c73312046879] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:51:52.055 INFO 42 --- [pool-ocp-schedules-15,,c73312046879] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:51:52.093 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:51:52.131 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:51:53.553 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:51:54.497 INFO 42 --- [pool-ocp-schedules-8,,59e628b37db8] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:51:54.498 INFO 42 --- [pool-ocp-schedules-8,,59e628b37db8] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:51:54.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:54.550 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:54.550 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:51:54.551 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:51:55.045 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:55.049 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:55.877 INFO 42 --- [pool-ocp-schedules-18,,b72856c8d33f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:51:56.945 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:51:56.951 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:51:57.652 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:57.654 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:51:58.050 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:51:58.056 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:51:58.112 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:51:58.647 INFO 42 --- [pool-prometheus-cache-monitor1,,d4ee79e023f4] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:51:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,d4ee79e023f4] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:51:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:51:58.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:51:58.797046+08:00, lastProcessTime=2022-12-08T15:51:48.797706+08:00 2022-12-08 15:51:58.925 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:51:58.797046+08:00, resultsCount=0 2022-12-08 15:51:58.926 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:51:58.797046+08:00, resultsCount=0 2022-12-08 15:51:58.926 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:51:58.797046+08:00 2022-12-08 15:52:00.008 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:01.0, nextRun=2022-12-08 15:52:00.0, currentDate=Thu Dec 08 15:52:00 CST 2022 2022-12-08 15:52:00.009 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:50:01.0, nextRunTime=2022-12-08 15:52:00.0} 2022-12-08 15:52:00.049 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:52:00.145 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:51:01.0, nextRun=2022-12-08 15:52:00.0, currentDate=Thu Dec 08 15:52:00 CST 2022 2022-12-08 15:52:00.145 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:51:01.0, nextRunTime=2022-12-08 15:52:00.0} 2022-12-08 15:52:00.163 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:52:00.164 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:52:00.164 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:52:00.319 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:51:01.0, nextRun=2022-12-08 15:52:00.0, currentDate=Thu Dec 08 15:52:00 CST 2022 2022-12-08 15:52:00.320 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:51:01.0, nextRunTime=2022-12-08 15:52:00.0} 2022-12-08 15:52:00.342 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:52:00.342 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:52:00.342 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:52:00.470 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:51:01.0, nextRun=2022-12-08 15:52:00.0, currentDate=Thu Dec 08 15:52:00 CST 2022 2022-12-08 15:52:00.471 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:51:01.0, nextRunTime=2022-12-08 15:52:00.0} 2022-12-08 15:52:00.495 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:52:00.496 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:52:00.496 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:52:00.550 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 402, operation:EXECUTE, state: RUNNING 2022-12-08 15:52:00.637 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:51:31.0, nextRun=2022-12-08 15:52:00.0, currentDate=Thu Dec 08 15:52:00 CST 2022 2022-12-08 15:52:00.637 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:51:31.0, nextRunTime=2022-12-08 15:52:00.0} 2022-12-08 15:52:00.654 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:52:00.655 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:52:00.655 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:52:00.683 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=402, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:52:00.534+08:00, endTime=null} 2022-12-08 15:52:00.721 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:00.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:00.723 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:00.723 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:00.750 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 403, operation:EXECUTE, state: RUNNING 2022-12-08 15:52:01.029 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:52:01.038 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:52:01.053 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:51:01.0, nextRun=2022-12-08 15:52:00.0, currentDate=Thu Dec 08 15:52:01 CST 2022 2022-12-08 15:52:01.053 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:51:01.0, nextRunTime=2022-12-08 15:52:00.0} 2022-12-08 15:52:01.057 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:01.061 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:01.069 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=403, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:52:00.736+08:00, endTime=null} 2022-12-08 15:52:01.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:52:01.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:52:01.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:52:01.741 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:02.119 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:52:02.152 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 404, operation:EXECUTE, state: RUNNING 2022-12-08 15:52:02.192 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:402, status:SUCCESS 2022-12-08 15:52:02.198 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:402, status:SUCCESS 2022-12-08 15:52:02.282 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=404, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:52:02.141+08:00, endTime=null} 2022-12-08 15:52:02.342 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 405, operation:EXECUTE, state: RUNNING 2022-12-08 15:52:02.344 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:403, status:SUCCESS 2022-12-08 15:52:02.350 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:403, status:SUCCESS 2022-12-08 15:52:02.409 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=405, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:52:02.332+08:00, endTime=null} 2022-12-08 15:52:02.495 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 406, operation:EXECUTE, state: RUNNING 2022-12-08 15:52:02.618 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=406, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:52:02.481+08:00, endTime=null} 2022-12-08 15:52:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,9093f39be4fa] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485980, interval=60 2022-12-08 15:52:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,9093f39be4fa] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485922, count=0, elapsed=1668815436713 2022-12-08 15:52:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,f9b64f01ccb3] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670485980, interval=60 2022-12-08 15:52:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,f9b64f01ccb3] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485922, count=0, elapsed=1668815436718 2022-12-08 15:52:02.653 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:03.424 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:52:03.433 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:52:03.759 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:404, status:SUCCESS 2022-12-08 15:52:03.764 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:404, status:SUCCESS 2022-12-08 15:52:03.855 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:405, status:SUCCESS 2022-12-08 15:52:03.861 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:405, status:SUCCESS 2022-12-08 15:52:04.062 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:04.066 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:04.068 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:04.068 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:406, status:SUCCESS 2022-12-08 15:52:04.069 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:04.073 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:406, status:SUCCESS 2022-12-08 15:52:04.541 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:52:05.272 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:52:05.524 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:49:34+08:00, updateTime=2022-12-08T15:51:34+08:00, expireTime=null, isLeader=false} 2022-12-08 15:52:05.533 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:52:05.878 INFO 42 --- [pool-ocp-schedules-11,,af302ff0f7b7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:52:06.085 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:52:06.095 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:51:06.0, nextRun=2022-12-08 15:52:05.0, currentDate=Thu Dec 08 15:52:06 CST 2022 2022-12-08 15:52:06.096 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:51:06.0, nextRunTime=2022-12-08 15:52:05.0} 2022-12-08 15:52:06.113 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:52:06.113 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:52:06.113 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:52:06.139 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:48:35+08:00, updateTime=2022-12-08T15:51:35+08:00, expireTime=null, isLeader=false} 2022-12-08 15:52:06.146 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:52:06.510 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:52:06.731 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 407, operation:EXECUTE, state: RUNNING 2022-12-08 15:52:06.940 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=407, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:52:06.720+08:00, endTime=null} 2022-12-08 15:52:07.067 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:07.071 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:07.135 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:07.135 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:07.197 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:07.198 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:08.335 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:407, status:SUCCESS 2022-12-08 15:52:08.339 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:407, status:SUCCESS 2022-12-08 15:52:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:52:08.792 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:52:08.789520+08:00, lastProcessTime=2022-12-08T15:51:58.797046+08:00 2022-12-08 15:52:08.868 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:52:08.789520+08:00, resultsCount=0 2022-12-08 15:52:08.868 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:52:08.789520+08:00, resultsCount=0 2022-12-08 15:52:08.868 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:52:08.789520+08:00 2022-12-08 15:52:08.885 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:52:09.734 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:52:09.740 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:52:10.072 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:10.076 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:10.446 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:10.492 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:10.985 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:52:11.338 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:52:11.343 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:52:12.056 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:12.233 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:52:12.725 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:13.077 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:13.081 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:13.571 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:13.571 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:13.819 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:13.819 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:14.610 INFO 42 --- [pool-ocp-schedules-10,,0f28fc3c3d5c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:52:14.610 INFO 42 --- [pool-ocp-schedules-10,,0f28fc3c3d5c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:52:15.879 INFO 42 --- [pool-ocp-schedules-6,,b5465de1a79e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:52:16.082 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:16.086 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:16.172 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:52:16.178 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:52:16.672 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:16.897 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:17.416 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:52:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:52:18.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:52:18.795336+08:00, lastProcessTime=2022-12-08T15:52:08.789520+08:00 2022-12-08 15:52:18.923 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:52:18.795336+08:00, resultsCount=0 2022-12-08 15:52:18.923 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:52:18.795336+08:00, resultsCount=0 2022-12-08 15:52:18.924 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:52:18.795336+08:00 2022-12-08 15:52:19.087 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:19.091 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:19.893 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:19.894 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:19.983 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:19.983 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:20.313 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:51:20.0, nextRun=2022-12-08 15:52:20.0, currentDate=Thu Dec 08 15:52:20 CST 2022 2022-12-08 15:52:20.314 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:51:20.0, nextRunTime=2022-12-08 15:52:20.0} 2022-12-08 15:52:20.332 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:52:20.333 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:52:20.333 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:52:21.191 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 408, operation:EXECUTE, state: RUNNING 2022-12-08 15:52:21.257 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=408, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:52:21.179+08:00, endTime=null} 2022-12-08 15:52:21.387 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:52:21.391 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:52:22.091 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:22.100 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:22.233 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:22.295 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:52:22.573 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:52:22.580 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:52:22.794 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:23.040 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:23.078 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:23.221 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:408, status:SUCCESS 2022-12-08 15:52:23.227 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:408, status:SUCCESS 2022-12-08 15:52:23.379 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:52:23.922 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:52:25.101 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:25.106 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:25.881 INFO 42 --- [pool-ocp-schedules-1,,ef378e332bc2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:52:26.212 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:51:26.0, nextRun=2022-12-08 15:52:25.0, currentDate=Thu Dec 08 15:52:26 CST 2022 2022-12-08 15:52:26.213 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:51:26.0, nextRunTime=2022-12-08 15:52:25.0} 2022-12-08 15:52:26.255 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:52:26.255 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:52:26.255 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:52:26.292 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:26.293 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:26.293 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:26.293 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:27.395 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 409, operation:EXECUTE, state: RUNNING 2022-12-08 15:52:27.457 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=409, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:52:27.375+08:00, endTime=null} 2022-12-08 15:52:28.106 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:28.110 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:28.467 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:409, status:SUCCESS 2022-12-08 15:52:28.473 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:409, status:SUCCESS 2022-12-08 15:52:28.537 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:52:28.543 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:52:28.724 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:48:28.366, end=2022-12-08T15:50:28.671} 2022-12-08 15:52:28.741 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:52:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:52:28.801 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:52:28.798346+08:00, lastProcessTime=2022-12-08T15:52:18.795336+08:00 2022-12-08 15:52:28.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:52:28.798346+08:00, resultsCount=0 2022-12-08 15:52:28.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:52:28.798346+08:00, resultsCount=0 2022-12-08 15:52:28.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:52:28.798346+08:00 2022-12-08 15:52:29.626 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:29.629 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:30.167 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:52:30.734 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:51:31.0, nextRun=2022-12-08 15:52:30.0, currentDate=Thu Dec 08 15:52:30 CST 2022 2022-12-08 15:52:30.734 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:51:31.0, nextRunTime=2022-12-08 15:52:30.0} 2022-12-08 15:52:30.757 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:52:30.864 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:01.0, nextRun=2022-12-08 15:52:30.0, currentDate=Thu Dec 08 15:52:30 CST 2022 2022-12-08 15:52:30.864 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:52:01.0, nextRunTime=2022-12-08 15:52:30.0} 2022-12-08 15:52:30.880 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:52:30.881 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:52:30.881 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:52:31.112 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:31.117 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:31.465 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:52:31.468 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:52:31.570 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 410, operation:EXECUTE, state: RUNNING 2022-12-08 15:52:31.639 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=410, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:52:31.556+08:00, endTime=null} 2022-12-08 15:52:32.063 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:410, status:SUCCESS 2022-12-08 15:52:32.069 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:410, status:SUCCESS 2022-12-08 15:52:32.290 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:32.379 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:52:32.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:32.723 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:32.724 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:32.725 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:33.176 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:34.117 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:34.122 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:34.796 INFO 42 --- [pool-ocp-schedules-18,,91c562a8f43f] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:52:34.797 INFO 42 --- [pool-ocp-schedules-18,,91c562a8f43f] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:52:35.356 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:52:35.361 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:52:35.628 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:52:35.799 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:35.813 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:35.882 INFO 42 --- [pool-ocp-schedules-3,,7c191a92d018] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:52:36.027 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:52:36.218 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:52:36.600 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:52:37.122 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:37.127 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:52:38.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:52:38.797704+08:00, lastProcessTime=2022-12-08T15:52:28.798346+08:00 2022-12-08 15:52:38.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:52:38.797704+08:00, resultsCount=0 2022-12-08 15:52:38.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:52:38.797704+08:00, resultsCount=0 2022-12-08 15:52:38.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:52:38.797704+08:00 2022-12-08 15:52:38.952 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:38.952 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:38.953 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:38.953 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:38.984 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:52:40.128 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:40.132 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:41.472 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:52:41.477 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:52:41.508 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:52:41.574 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:52:42.037 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:42.074 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:42.328 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:52:42.379 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:42.443 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:52:43.132 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:43.138 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:43.260 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:45.089 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:45.090 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:45.185 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:45.185 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:45.471 INFO 42 --- [pool-ocp-schedules-15,,e7950d401664] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:52:45.495 INFO 42 --- [pool-ocp-schedules-15,,e7950d401664] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:52:45.693 INFO 42 --- [pool-ocp-schedules-17,,a00bd6a58d07] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:52:45.884 INFO 42 --- [pool-ocp-schedules-20,,517dbc783dd7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:52:46.049 INFO 42 --- [pool-ocp-schedules-13,,8a59982543ef] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:52:46.138 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:46.143 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:47.529 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:52:47.534 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:52:48.161 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:48.261 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:48.679 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:52:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:52:48.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:52:48.791279+08:00, lastProcessTime=2022-12-08T15:52:38.797704+08:00 2022-12-08 15:52:48.903 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:52:48.791279+08:00, resultsCount=0 2022-12-08 15:52:48.903 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:52:48.791279+08:00, resultsCount=0 2022-12-08 15:52:48.903 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:52:48.791279+08:00 2022-12-08 15:52:49.144 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:49.150 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:50.722 INFO 42 --- [pool-ocp-schedules-3,,80f56dd34e8b] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:52:51.053 INFO 42 --- [pool-ocp-schedules-16,,99fce051a980] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:52:51.256 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:51.256 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:51.349 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:51.349 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:51.799 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:52:51.804 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:52:52.055 INFO 42 --- [pool-ocp-schedules-12,,170f2e314bb0] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:52:52.151 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:52.157 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:52.161 INFO 42 --- [pool-ocp-schedules-16,,58a046343779] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:52:52.162 INFO 42 --- [pool-ocp-schedules-16,,58a046343779] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:52:52.162 INFO 42 --- [pool-ocp-schedules-16,,58a046343779] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:52:52.443 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:52.541 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:52:53.719 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:52:53.936 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:52:53.943 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:52:54.062 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:52:54.487 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:54.512 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:52:54.616 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:52:54.847 INFO 42 --- [pool-ocp-schedules-16,,825b4fcf0f12] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:52:54.848 INFO 42 --- [pool-ocp-schedules-16,,825b4fcf0f12] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:52:55.158 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:55.162 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:55.885 INFO 42 --- [pool-ocp-schedules-11,,e6975b31de27] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:52:57.575 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:57.575 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:57.612 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:52:57.612 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:52:58.163 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:52:58.167 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:52:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,762296c29f4b] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:52:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,762296c29f4b] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:52:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:52:58.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:52:58.790220+08:00, lastProcessTime=2022-12-08T15:52:48.791279+08:00 2022-12-08 15:52:58.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:52:58.790220+08:00, resultsCount=0 2022-12-08 15:52:58.880 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:52:58.790220+08:00, resultsCount=0 2022-12-08 15:52:58.880 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:52:58.790220+08:00 2022-12-08 15:52:59.850 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:52:59.857 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:53:01.018 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:00.0, nextRun=2022-12-08 15:53:00.0, currentDate=Thu Dec 08 15:53:01 CST 2022 2022-12-08 15:53:01.019 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:52:00.0, nextRunTime=2022-12-08 15:53:00.0} 2022-12-08 15:53:01.037 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:53:01.038 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:53:01.038 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:53:01.091 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:00.0, nextRun=2022-12-08 15:53:00.0, currentDate=Thu Dec 08 15:53:01 CST 2022 2022-12-08 15:53:01.091 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:52:00.0, nextRunTime=2022-12-08 15:53:00.0} 2022-12-08 15:53:01.117 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:53:01.117 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:53:01.117 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:53:01.168 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:01.173 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:01.256 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:01.256 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:01.363 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:00.0, nextRun=2022-12-08 15:53:00.0, currentDate=Thu Dec 08 15:53:01 CST 2022 2022-12-08 15:53:01.364 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:52:00.0, nextRunTime=2022-12-08 15:53:00.0} 2022-12-08 15:53:01.388 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:53:01.388 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:53:01.389 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:53:01.476 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:53:01.536 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:31.0, nextRun=2022-12-08 15:53:00.0, currentDate=Thu Dec 08 15:53:01 CST 2022 2022-12-08 15:53:01.536 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:52:31.0, nextRunTime=2022-12-08 15:53:00.0} 2022-12-08 15:53:01.552 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:53:01.552 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:53:01.552 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:53:01.625 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:01.0, nextRun=2022-12-08 15:53:00.0, currentDate=Thu Dec 08 15:53:01 CST 2022 2022-12-08 15:53:01.625 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:52:01.0, nextRunTime=2022-12-08 15:53:00.0} 2022-12-08 15:53:01.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:53:01.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:53:01.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:53:01.831 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:53:01.834 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:53:02.096 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 411, operation:EXECUTE, state: RUNNING 2022-12-08 15:53:02.143 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=411, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:53:02.083+08:00, endTime=null} 2022-12-08 15:53:02.204 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 412, operation:EXECUTE, state: RUNNING 2022-12-08 15:53:02.238 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=412, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:53:02.192+08:00, endTime=null} 2022-12-08 15:53:02.326 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 413, operation:EXECUTE, state: RUNNING 2022-12-08 15:53:02.392 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=413, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:53:02.309+08:00, endTime=null} 2022-12-08 15:53:02.468 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 414, operation:EXECUTE, state: RUNNING 2022-12-08 15:53:02.486 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,df782c6c9a37] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486040, interval=60 2022-12-08 15:53:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,df782c6c9a37] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485982, count=0, elapsed=1668815496654 2022-12-08 15:53:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,6d76b70e5724] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486040, interval=60 2022-12-08 15:53:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,6d76b70e5724] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670485982, count=0, elapsed=1668815496658 2022-12-08 15:53:02.741 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:53:02.761 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=414, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:53:02.448+08:00, endTime=null} 2022-12-08 15:53:02.852 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 415, operation:EXECUTE, state: RUNNING 2022-12-08 15:53:02.982 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=415, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:53:02.838+08:00, endTime=null} 2022-12-08 15:53:03.575 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:411, status:SUCCESS 2022-12-08 15:53:03.580 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:411, status:SUCCESS 2022-12-08 15:53:03.799 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:04.078 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:412, status:SUCCESS 2022-12-08 15:53:04.097 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:412, status:SUCCESS 2022-12-08 15:53:04.174 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:04.179 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:04.355 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:413, status:SUCCESS 2022-12-08 15:53:04.361 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:413, status:SUCCESS 2022-12-08 15:53:04.474 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:04.475 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:04.475 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:04.475 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:04.592 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:414, status:SUCCESS 2022-12-08 15:53:04.599 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:414, status:SUCCESS 2022-12-08 15:53:04.703 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:415, status:SUCCESS 2022-12-08 15:53:04.710 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:415, status:SUCCESS 2022-12-08 15:53:05.805 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:53:05.887 INFO 42 --- [pool-ocp-schedules-9,,9630525f1c42] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:53:06.068 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:06.0, nextRun=2022-12-08 15:53:05.0, currentDate=Thu Dec 08 15:53:06 CST 2022 2022-12-08 15:53:06.068 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:52:06.0, nextRunTime=2022-12-08 15:53:05.0} 2022-12-08 15:53:06.082 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:53:06.083 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:53:06.083 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:53:06.281 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:53:06.664 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:53:06.866 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:53:06.872 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:53:07.114 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 416, operation:EXECUTE, state: RUNNING 2022-12-08 15:53:07.175 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=416, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:53:07.099+08:00, endTime=null} 2022-12-08 15:53:07.179 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:07.184 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:07.637 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:07.638 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:07.996 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:53:08.554 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:416, status:SUCCESS 2022-12-08 15:53:08.560 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:416, status:SUCCESS 2022-12-08 15:53:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:53:08.805 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:53:08.801845+08:00, lastProcessTime=2022-12-08T15:52:58.790220+08:00 2022-12-08 15:53:08.903 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:53:08.801845+08:00, resultsCount=0 2022-12-08 15:53:08.903 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:53:08.801845+08:00, resultsCount=0 2022-12-08 15:53:08.903 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:53:08.801845+08:00 2022-12-08 15:53:09.113 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:53:10.187 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:10.195 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:10.701 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:10.702 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:10.704 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:10.705 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:11.859 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:53:11.889 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:53:12.742 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:12.970 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:53:13.196 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:13.201 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:13.207 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:53:13.215 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:53:13.887 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:13.887 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:14.117 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:14.369 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:53:14.887 INFO 42 --- [pool-ocp-schedules-13,,19bdf2440c61] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:53:14.888 INFO 42 --- [pool-ocp-schedules-13,,19bdf2440c61] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:53:15.888 INFO 42 --- [pool-ocp-schedules-2,,4c17e369f82b] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:53:16.202 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:16.210 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:17.353 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:17.354 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:17.355 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:17.356 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:53:18.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:53:18.793903+08:00, lastProcessTime=2022-12-08T15:53:08.801845+08:00 2022-12-08 15:53:18.929 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:53:18.793903+08:00, resultsCount=0 2022-12-08 15:53:18.929 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:53:18.793903+08:00, resultsCount=0 2022-12-08 15:53:18.929 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:53:18.793903+08:00 2022-12-08 15:53:19.211 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:19.215 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:19.932 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:53:19.938 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:53:20.425 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:20.460 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:20.846 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:53:21.175 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:20.0, nextRun=2022-12-08 15:53:20.0, currentDate=Thu Dec 08 15:53:21 CST 2022 2022-12-08 15:53:21.175 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:52:20.0, nextRunTime=2022-12-08 15:53:20.0} 2022-12-08 15:53:21.194 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:53:21.194 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:53:21.195 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:53:21.717 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 417, operation:EXECUTE, state: RUNNING 2022-12-08 15:53:21.758 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=417, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:53:21.702+08:00, endTime=null} 2022-12-08 15:53:21.897 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:53:22.069 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:53:22.216 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:22.224 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:22.955 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:23.021 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:53:23.439 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:417, status:SUCCESS 2022-12-08 15:53:23.446 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:417, status:SUCCESS 2022-12-08 15:53:23.789 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:23.789 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:23.845 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:23.845 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:24.339 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:24.460 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:53:25.225 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:25.234 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:25.566 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:26.0, nextRun=2022-12-08 15:53:25.0, currentDate=Thu Dec 08 15:53:25 CST 2022 2022-12-08 15:53:25.566 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:52:26.0, nextRunTime=2022-12-08 15:53:25.0} 2022-12-08 15:53:25.614 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:53:25.614 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:53:25.615 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:53:25.886 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 418, operation:EXECUTE, state: RUNNING 2022-12-08 15:53:25.890 INFO 42 --- [pool-ocp-schedules-11,,24bff58adf2c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:53:26.201 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=418, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:53:25.871+08:00, endTime=null} 2022-12-08 15:53:26.595 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:53:26.601 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:53:26.908 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:26.984 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:27.202 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:53:27.848 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:418, status:SUCCESS 2022-12-08 15:53:27.857 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:418, status:SUCCESS 2022-12-08 15:53:28.235 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:28.242 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:53:28.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:53:28.791317+08:00, lastProcessTime=2022-12-08T15:53:18.793903+08:00 2022-12-08 15:53:28.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:53:28.791317+08:00, resultsCount=0 2022-12-08 15:53:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:53:28.791317+08:00, resultsCount=0 2022-12-08 15:53:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:53:28.791317+08:00 2022-12-08 15:53:30.005 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:30.006 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:30.030 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:53:02.0, nextRun=2022-12-08 15:53:30.0, currentDate=Thu Dec 08 15:53:30 CST 2022 2022-12-08 15:53:30.031 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:53:02.0, nextRunTime=2022-12-08 15:53:30.0} 2022-12-08 15:53:30.052 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:53:30.053 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:53:30.053 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:53:30.093 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:30.096 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:30.345 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 419, operation:EXECUTE, state: RUNNING 2022-12-08 15:53:30.430 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=419, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:53:30.332+08:00, endTime=null} 2022-12-08 15:53:31.243 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:31.247 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:31.356 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:419, status:SUCCESS 2022-12-08 15:53:31.363 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:419, status:SUCCESS 2022-12-08 15:53:31.407 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:31.0, nextRun=2022-12-08 15:53:30.0, currentDate=Thu Dec 08 15:53:31 CST 2022 2022-12-08 15:53:31.408 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:52:31.0, nextRunTime=2022-12-08 15:53:30.0} 2022-12-08 15:53:31.426 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:53:32.128 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:53:32.235 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:53:32.586 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:53:32.591 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:53:33.003 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:33.063 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:33.223 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:33.241 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:53:33.507 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:53:34.248 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:34.252 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:34.391 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:34.948 INFO 42 --- [pool-ocp-schedules-6,,d6dcfdb132eb] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:53:34.948 INFO 42 --- [pool-ocp-schedules-6,,d6dcfdb132eb] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:53:35.843 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:53:35.891 INFO 42 --- [pool-ocp-schedules-9,,29606b54db16] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:53:36.253 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:36.253 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:36.350 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:53:36.503 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:36.504 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:36.808 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:53:37.252 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:37.257 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:53:38.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:53:38.791211+08:00, lastProcessTime=2022-12-08T15:53:28.791317+08:00 2022-12-08 15:53:38.929 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:53:38.791211+08:00, resultsCount=0 2022-12-08 15:53:38.930 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:53:38.791211+08:00, resultsCount=0 2022-12-08 15:53:38.931 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:53:38.791211+08:00 2022-12-08 15:53:39.172 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:53:39.179 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:53:39.445 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:39.489 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:53:39.602 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:39.821 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:53:40.190 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:53:40.206 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=16ms, period=120000ms 2022-12-08 15:53:40.258 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:40.263 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:42.163 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:53:42.268 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:53:42.499 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:42.499 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:42.673 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:42.674 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:43.241 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:43.263 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:43.269 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:43.488 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:53:44.486 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:45.052 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:53:45.061 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:53:45.470 INFO 42 --- [pool-ocp-schedules-17,,be4f1585b0a2] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:53:45.508 INFO 42 --- [pool-ocp-schedules-17,,be4f1585b0a2] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:53:45.601 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:45.695 INFO 42 --- [pool-ocp-schedules-16,,cdaae5d2d191] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:53:45.739 INFO 42 --- [pool-ocp-schedules-11,,92b73b491ea3] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:53:45.740 INFO 42 --- [pool-ocp-schedules-11,,92b73b491ea3] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:53:45.892 INFO 42 --- [pool-ocp-schedules-9,,7544605b55d0] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:53:46.050 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:46.055 INFO 42 --- [pool-ocp-schedules-2,,62dfd5949872] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:53:46.270 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:46.275 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:46.422 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:53:48.704 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:48.704 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:53:48.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:53:48.791365+08:00, lastProcessTime=2022-12-08T15:53:38.791211+08:00 2022-12-08 15:53:48.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:53:48.791365+08:00, resultsCount=0 2022-12-08 15:53:48.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:53:48.791365+08:00, resultsCount=0 2022-12-08 15:53:48.923 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:53:48.791365+08:00 2022-12-08 15:53:49.117 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:49.117 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:49.276 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:49.282 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:50.949 INFO 42 --- [pool-ocp-schedules-13,,346e72773d87] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:53:51.342 INFO 42 --- [pool-ocp-schedules-5,,c7d4b24e083d] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:53:51.746 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:53:51.757 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:53:52.177 INFO 42 --- [pool-ocp-schedules-2,,3727267d12e0] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:53:52.198 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:53:52.211 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:52.283 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:52.287 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:52.306 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:53:52.529 INFO 42 --- [pool-ocp-schedules-1,,1a74323fb191] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:53:52.530 INFO 42 --- [pool-ocp-schedules-1,,1a74323fb191] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:53:52.530 INFO 42 --- [pool-ocp-schedules-1,,1a74323fb191] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:53:53.273 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:53.561 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:53:54.514 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:53:54.579 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:53:54.867 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:53:55.051 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:53:55.075 INFO 42 --- [pool-ocp-schedules-10,,b7c17be39260] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:53:55.076 INFO 42 --- [pool-ocp-schedules-10,,b7c17be39260] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:53:55.288 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:55.293 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:55.511 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:55.512 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:55.893 INFO 42 --- [pool-ocp-schedules-6,,a60bdfd34bb2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:53:57.924 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:53:57.925 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:53:58.294 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:53:58.299 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:53:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,c27c304292c6] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:53:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,c27c304292c6] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:53:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:53:58.806 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:53:58.803385+08:00, lastProcessTime=2022-12-08T15:53:48.791365+08:00 2022-12-08 15:53:58.929 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:53:58.803385+08:00, resultsCount=0 2022-12-08 15:53:58.929 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:53:58.803385+08:00, resultsCount=0 2022-12-08 15:53:58.930 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:53:58.803385+08:00 2022-12-08 15:54:00.000 INFO 42 --- [pool-ocp-schedules-18,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:54:00.414 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:54:00.421 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:54:00.920 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:52:00.0, nextRun=2022-12-08 15:54:00.0, currentDate=Thu Dec 08 15:54:00 CST 2022 2022-12-08 15:54:00.921 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:52:00.0, nextRunTime=2022-12-08 15:54:00.0} 2022-12-08 15:54:00.942 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:54:01.018 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:53:01.0, nextRun=2022-12-08 15:54:00.0, currentDate=Thu Dec 08 15:54:01 CST 2022 2022-12-08 15:54:01.019 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:53:01.0, nextRunTime=2022-12-08 15:54:00.0} 2022-12-08 15:54:01.042 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:54:01.043 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:54:01.043 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:54:01.136 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:53:01.0, nextRun=2022-12-08 15:54:00.0, currentDate=Thu Dec 08 15:54:01 CST 2022 2022-12-08 15:54:01.136 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:53:01.0, nextRunTime=2022-12-08 15:54:00.0} 2022-12-08 15:54:01.166 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:54:01.167 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:54:01.167 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:54:01.232 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:53:01.0, nextRun=2022-12-08 15:54:00.0, currentDate=Thu Dec 08 15:54:01 CST 2022 2022-12-08 15:54:01.233 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:53:01.0, nextRunTime=2022-12-08 15:54:00.0} 2022-12-08 15:54:01.256 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:54:01.257 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:54:01.257 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:54:01.300 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:01.304 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:01.318 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:53:30.0, nextRun=2022-12-08 15:54:00.0, currentDate=Thu Dec 08 15:54:01 CST 2022 2022-12-08 15:54:01.318 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:53:30.0, nextRunTime=2022-12-08 15:54:00.0} 2022-12-08 15:54:01.338 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:54:01.339 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:54:01.339 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:54:01.441 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:53:02.0, nextRun=2022-12-08 15:54:00.0, currentDate=Thu Dec 08 15:54:01 CST 2022 2022-12-08 15:54:01.442 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:53:02.0, nextRunTime=2022-12-08 15:54:00.0} 2022-12-08 15:54:01.461 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:54:01.462 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:54:01.462 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:54:01.705 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:01.778 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:01.864 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 420, operation:EXECUTE, state: RUNNING 2022-12-08 15:54:01.969 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=420, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:54:01.849+08:00, endTime=null} 2022-12-08 15:54:02.048 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 421, operation:EXECUTE, state: RUNNING 2022-12-08 15:54:02.072 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:54:02.097 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=421, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:54:02.032+08:00, endTime=null} 2022-12-08 15:54:02.171 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 422, operation:EXECUTE, state: RUNNING 2022-12-08 15:54:02.239 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=422, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:54:02.155+08:00, endTime=null} 2022-12-08 15:54:02.308 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 423, operation:EXECUTE, state: RUNNING 2022-12-08 15:54:02.346 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=423, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:54:02.292+08:00, endTime=null} 2022-12-08 15:54:02.430 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 424, operation:EXECUTE, state: RUNNING 2022-12-08 15:54:02.474 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:54:02.506 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=424, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:54:02.419+08:00, endTime=null} 2022-12-08 15:54:02.527 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:54:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,1d112124eeb0] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486100, interval=60 2022-12-08 15:54:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,1d112124eeb0] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486042, count=0, elapsed=1668815556594 2022-12-08 15:54:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,f0b66425627c] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486100, interval=60 2022-12-08 15:54:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,f0b66425627c] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486042, count=0, elapsed=1668815556598 2022-12-08 15:54:03.359 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:03.648 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:54:03.657 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:420, status:SUCCESS 2022-12-08 15:54:03.662 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:420, status:SUCCESS 2022-12-08 15:54:03.835 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:421, status:SUCCESS 2022-12-08 15:54:03.841 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:421, status:SUCCESS 2022-12-08 15:54:03.957 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:422, status:SUCCESS 2022-12-08 15:54:03.962 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:422, status:SUCCESS 2022-12-08 15:54:04.254 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:423, status:SUCCESS 2022-12-08 15:54:04.260 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:423, status:SUCCESS 2022-12-08 15:54:04.305 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:04.310 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:04.448 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:424, status:SUCCESS 2022-12-08 15:54:04.465 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:424, status:SUCCESS 2022-12-08 15:54:04.580 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:04.769 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:04.770 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:04.920 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:04.920 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:05.624 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:53:06.0, nextRun=2022-12-08 15:54:05.0, currentDate=Thu Dec 08 15:54:05 CST 2022 2022-12-08 15:54:05.624 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:53:06.0, nextRunTime=2022-12-08 15:54:05.0} 2022-12-08 15:54:05.644 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:54:05.645 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:54:05.645 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:54:05.894 INFO 42 --- [pool-ocp-schedules-7,,f3147d4d850c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:54:05.898 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:54:06.477 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:54:06.668 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 425, operation:EXECUTE, state: RUNNING 2022-12-08 15:54:06.772 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=425, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:54:06.623+08:00, endTime=null} 2022-12-08 15:54:06.855 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:54:07.290 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:54:07.296 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:54:07.311 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:07.315 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:07.957 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:08.009 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:08.126 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:425, status:SUCCESS 2022-12-08 15:54:08.132 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:425, status:SUCCESS 2022-12-08 15:54:08.418 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:54:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:54:08.801 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:54:08.797973+08:00, lastProcessTime=2022-12-08T15:53:58.803385+08:00 2022-12-08 15:54:08.940 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:54:08.797973+08:00, resultsCount=0 2022-12-08 15:54:08.940 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:54:08.797973+08:00, resultsCount=0 2022-12-08 15:54:08.941 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:54:08.797973+08:00 2022-12-08 15:54:09.513 INFO 42 --- [pool-ocp-schedules-18,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:54:09.651 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:54:09.960 INFO 42 --- [pool-ocp-schedules-18,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:54:10.105 INFO 42 --- [pool-ocp-schedules-18,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:54:10.316 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:10.331 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:10.461 INFO 42 --- [pool-ocp-schedules-18,,] o.s.boot.SpringApplication : Started application in 10.407 seconds (JVM running for 2047.307) 2022-12-08 15:54:11.048 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:11.049 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:11.083 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:11.084 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:12.533 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:54:12.585 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:54:12.786 INFO 42 --- [pool-ocp-schedules-18,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:54:12.786+08:00 2022-12-08 15:54:13.332 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:13.337 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:13.406 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:13.653 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:54:13.658 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:54:13.694 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:54:14.590 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:14.590 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:14.606 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:14.985 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:54:15.124 INFO 42 --- [pool-ocp-schedules-19,,aefff2611e37] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:54:15.124 INFO 42 --- [pool-ocp-schedules-19,,aefff2611e37] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:54:15.896 INFO 42 --- [pool-ocp-schedules-8,,864c077d5b30] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:54:16.338 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:16.343 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:17.712 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:17.713 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:17.716 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:17.717 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:18.768 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:54:18.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:54:18.791434+08:00, lastProcessTime=2022-12-08T15:54:08.797973+08:00 2022-12-08 15:54:18.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:54:18.791434+08:00, resultsCount=0 2022-12-08 15:54:18.921 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:54:18.791434+08:00, resultsCount=0 2022-12-08 15:54:18.921 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:54:18.791434+08:00 2022-12-08 15:54:19.344 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:19.348 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:20.211 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:54:20.216 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:54:20.477 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:53:21.0, nextRun=2022-12-08 15:54:20.0, currentDate=Thu Dec 08 15:54:20 CST 2022 2022-12-08 15:54:20.478 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:53:21.0, nextRunTime=2022-12-08 15:54:20.0} 2022-12-08 15:54:20.499 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:54:20.500 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:54:20.500 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:54:20.824 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:20.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:21.071 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 426, operation:EXECUTE, state: RUNNING 2022-12-08 15:54:21.175 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=426, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:54:21.033+08:00, endTime=null} 2022-12-08 15:54:21.358 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:54:21.591 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:426, status:SUCCESS 2022-12-08 15:54:21.600 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:426, status:SUCCESS 2022-12-08 15:54:22.349 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:22.354 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:22.601 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:54:22.626 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:54:23.451 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:24.001 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:54:24.008 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:24.008 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:24.009 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:24.009 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:24.698 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:24.733 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:54:25.017 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:53:26.0, nextRun=2022-12-08 15:54:25.0, currentDate=Thu Dec 08 15:54:25 CST 2022 2022-12-08 15:54:25.018 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:53:26.0, nextRunTime=2022-12-08 15:54:25.0} 2022-12-08 15:54:25.063 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:54:25.064 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:54:25.064 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:54:25.311 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 427, operation:EXECUTE, state: RUNNING 2022-12-08 15:54:25.355 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:25.360 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:25.541 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=427, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:54:25.298+08:00, endTime=null} 2022-12-08 15:54:25.897 INFO 42 --- [pool-ocp-schedules-10,,c47ee42413d9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:54:26.438 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:427, status:SUCCESS 2022-12-08 15:54:26.443 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:427, status:SUCCESS 2022-12-08 15:54:26.528 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:54:26.534 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:54:27.109 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:27.110 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:27.733 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:54:28.361 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:28.372 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:54:28.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:54:28.800621+08:00, lastProcessTime=2022-12-08T15:54:18.791434+08:00 2022-12-08 15:54:28.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:54:28.800621+08:00, resultsCount=0 2022-12-08 15:54:28.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:54:28.800621+08:00, resultsCount=0 2022-12-08 15:54:28.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:54:28.800621+08:00 2022-12-08 15:54:29.891 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:50:28.671, end=2022-12-08T15:52:29.404} 2022-12-08 15:54:29.937 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:54:30.020 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:53:31.0, nextRun=2022-12-08 15:54:30.0, currentDate=Thu Dec 08 15:54:30 CST 2022 2022-12-08 15:54:30.021 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:53:31.0, nextRunTime=2022-12-08 15:54:30.0} 2022-12-08 15:54:30.047 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:54:30.341 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:30.341 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:30.342 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:30.342 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:30.526 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:01.0, nextRun=2022-12-08 15:54:30.0, currentDate=Thu Dec 08 15:54:30 CST 2022 2022-12-08 15:54:30.527 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:54:01.0, nextRunTime=2022-12-08 15:54:30.0} 2022-12-08 15:54:30.548 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:54:30.549 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:54:30.549 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:54:31.373 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:31.378 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:31.690 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 428, operation:EXECUTE, state: RUNNING 2022-12-08 15:54:31.759 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=428, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:54:31.675+08:00, endTime=null} 2022-12-08 15:54:32.770 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:54:32.778 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:54:33.164 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:428, status:SUCCESS 2022-12-08 15:54:33.171 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:428, status:SUCCESS 2022-12-08 15:54:33.343 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:54:33.349 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:54:33.484 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:33.607 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:33.607 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:33.936 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:54:34.098 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:54:34.379 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:34.383 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:34.733 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:35.233 INFO 42 --- [pool-ocp-schedules-11,,982e10da3b1e] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:54:35.234 INFO 42 --- [pool-ocp-schedules-11,,982e10da3b1e] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:54:35.898 INFO 42 --- [pool-ocp-schedules-5,,c173d060f1aa] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:54:36.185 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:54:36.676 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:36.676 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:36.677 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:36.677 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:37.384 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:37.388 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:37.440 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:52:05+08:00, updateTime=2022-12-08T15:54:05+08:00, expireTime=null, isLeader=false} 2022-12-08 15:54:37.445 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:54:38.227 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:54:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:54:38.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:54:38.792985+08:00, lastProcessTime=2022-12-08T15:54:28.800621+08:00 2022-12-08 15:54:38.846 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:52:06+08:00, updateTime=2022-12-08T15:54:06+08:00, expireTime=null, isLeader=false} 2022-12-08 15:54:38.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:54:38.792985+08:00, resultsCount=0 2022-12-08 15:54:38.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:54:38.792985+08:00, resultsCount=0 2022-12-08 15:54:38.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:54:38.792985+08:00 2022-12-08 15:54:39.120 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:51:06+08:00, updateTime=2022-12-08T15:54:06+08:00, expireTime=null, isLeader=false} 2022-12-08 15:54:39.127 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:54:39.477 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:54:39.476 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:54:39.483 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:54:39.489 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:54:39.787 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:54:40.389 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:40.394 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:40.455 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:40.456 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:40.813 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:54:42.950 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:54:42.967 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:54:43.395 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:43.400 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:43.529 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:43.711 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:43.711 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:43.712 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:43.712 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:44.156 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:54:44.955 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:45.473 INFO 42 --- [pool-ocp-schedules-9,,0fdc59ddc272] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:54:45.513 INFO 42 --- [pool-ocp-schedules-9,,0fdc59ddc272] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:54:45.696 INFO 42 --- [pool-ocp-schedules-10,,a04727eea627] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:54:45.900 INFO 42 --- [pool-ocp-schedules-3,,7eea5497fde3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:54:46.065 INFO 42 --- [pool-ocp-schedules-7,,1f84b6c28d60] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:54:46.220 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:54:46.226 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:54:46.401 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:46.406 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:47.345 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:47.354 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:47.997 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:54:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:54:48.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:54:48.796151+08:00, lastProcessTime=2022-12-08T15:54:38.792985+08:00 2022-12-08 15:54:48.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:54:48.796151+08:00, resultsCount=0 2022-12-08 15:54:48.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:54:48.796151+08:00, resultsCount=0 2022-12-08 15:54:48.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:54:48.796151+08:00 2022-12-08 15:54:49.407 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:49.413 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:50.970 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:50.971 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:50.971 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:50.971 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:51.003 INFO 42 --- [pool-ocp-schedules-16,,d1d38402092e] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:54:51.544 INFO 42 --- [pool-ocp-schedules-7,,ebd61f4b6256] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:54:51.937 INFO 42 --- [http-nio-8080-exec-4,97c221b96a1a4c79,ea9c17b81209] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=97c221b96a1a4c79, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 15:54:51.938 INFO 42 --- [http-nio-8080-exec-4,97c221b96a1a4c79,ea9c17b81209] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=97c221b96a1a4c79, duration=9 ms] 2022-12-08 15:54:52.290 INFO 42 --- [pool-ocp-schedules-12,,baa63707d1bb] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:54:52.320 INFO 42 --- [http-nio-8080-exec-6,,] c.a.o.s.i.a.CsrfRequestMatcher : CSRF token required for API [PUT /api/v2/profiles/me/changePassword, client 192.168.28.1, traceId ] 2022-12-08 15:54:52.415 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:52.421 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:52.659 INFO 42 --- [http-nio-8080-exec-6,42233da81aee45a8,2262b21faddd] c.a.o.server.trace.RequestTracingAspect : API: [PUT /api/v2/profiles/me/changePassword?null, client=192.168.28.1, traceId=42233da81aee45a8, method=SuccessResponse com.alipay.ocp.server.controller.ProfileController.changePassword(ChangePasswordRequest,HttpServletRequest), args=ChangePasswordRequest(currentpassword=xxx newpassword=xxx] 2022-12-08 15:54:52.680 INFO 42 --- [pool-ocp-schedules-7,,166a19974f5d] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:54:52.681 INFO 42 --- [pool-ocp-schedules-7,,166a19974f5d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:54:52.681 INFO 42 --- [pool-ocp-schedules-7,,166a19974f5d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:54:53.005 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:54:53.041 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:54:53.314 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:54:53.320 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:54:53.693 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:53.780 INFO 42 --- [http-nio-8080-exec-6,42233da81aee45a8,2262b21faddd] c.a.ocp.service.profile.ProfileService : Changed password: 100 admin 2022-12-08 15:54:54.040 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:54.041 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:54:54.076 INFO 42 --- [http-nio-8080-exec-6,42233da81aee45a8,2262b21faddd] c.a.o.s.iam.user.PasswordChangeService : Password changed: username = admin, operator = admin 2022-12-08 15:54:54.329 INFO 42 --- [http-nio-8080-exec-6,42233da81aee45a8,2262b21faddd] c.a.o.server.trace.RequestTracingAspect : API OK: [PUT /api/v2/profiles/me/changePassword client=192.168.28.1, traceId=42233da81aee45a8, duration=1997 ms] 2022-12-08 15:54:54.475 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:54:54.722 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:54:55.167 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:54:55.311 INFO 42 --- [pool-ocp-schedules-17,,cd932b86eea0] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:54:55.312 INFO 42 --- [pool-ocp-schedules-17,,cd932b86eea0] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:54:55.341 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:54:55.422 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:55.426 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:55.901 INFO 42 --- [pool-ocp-schedules-7,,e5d58530bd08] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:54:57.132 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:57.132 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:57.158 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:54:57.159 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:54:58.427 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:54:58.431 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:54:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,2d888c868532] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:54:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,2d888c868532] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:54:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:54:58.818 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:54:58.816157+08:00, lastProcessTime=2022-12-08T15:54:48.796151+08:00 2022-12-08 15:54:58.936 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:54:58.816157+08:00, resultsCount=0 2022-12-08 15:54:58.937 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:54:58.816157+08:00, resultsCount=0 2022-12-08 15:54:58.937 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:54:58.816157+08:00 2022-12-08 15:54:59.751 INFO 42 --- [http-nio-8080-exec-5,f62df8ab85734886,455d8a403f9f] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=f62df8ab85734886, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 15:54:59.751 INFO 42 --- [http-nio-8080-exec-5,f62df8ab85734886,455d8a403f9f] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=f62df8ab85734886, duration=2 ms] 2022-12-08 15:54:59.887 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:54:59.896 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:55:00.172 INFO 42 --- [http-nio-8080-exec-10,,] o.s.a.CustomAuthenticationSuccessHandler : Authentication successful for /api/v2/iam/login 2022-12-08 15:55:00.271 INFO 42 --- [http-nio-8080-exec-10,,] o.s.a.CustomAuthenticationSuccessHandler : Redirecting to saved url: / 2022-12-08 15:55:00.405 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:00.407 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:00.742 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:55:00.818 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:02.0, nextRun=2022-12-08 15:55:00.0, currentDate=Thu Dec 08 15:55:00 CST 2022 2022-12-08 15:55:00.819 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 15:50:02.0, nextRunTime=2022-12-08 15:55:00.0} 2022-12-08 15:55:01.043 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 15:55:01.043 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:01.044 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:01.212 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:02.0, nextRun=2022-12-08 15:55:00.0, currentDate=Thu Dec 08 15:55:01 CST 2022 2022-12-08 15:55:01.213 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:50:02.0, nextRunTime=2022-12-08 15:55:00.0} 2022-12-08 15:55:01.391 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 15:55:01.392 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 15:55:01.432 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:01.438 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:01.666 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:01.0, nextRun=2022-12-08 15:55:00.0, currentDate=Thu Dec 08 15:55:01 CST 2022 2022-12-08 15:55:01.666 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:54:01.0, nextRunTime=2022-12-08 15:55:00.0} 2022-12-08 15:55:01.684 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:55:01.685 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:01.685 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:01.976 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:01.0, nextRun=2022-12-08 15:55:00.0, currentDate=Thu Dec 08 15:55:01 CST 2022 2022-12-08 15:55:01.976 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:54:01.0, nextRunTime=2022-12-08 15:55:00.0} 2022-12-08 15:55:02.006 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:55:02.006 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:02.006 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:02.332 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:01.0, nextRun=2022-12-08 15:55:00.0, currentDate=Thu Dec 08 15:55:02 CST 2022 2022-12-08 15:55:02.332 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:54:01.0, nextRunTime=2022-12-08 15:55:00.0} 2022-12-08 15:55:02.351 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:55:02.352 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:02.352 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:02.470 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:31.0, nextRun=2022-12-08 15:55:00.0, currentDate=Thu Dec 08 15:55:02 CST 2022 2022-12-08 15:55:02.471 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:54:31.0, nextRunTime=2022-12-08 15:55:00.0} 2022-12-08 15:55:02.487 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:55:02.487 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:02.487 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:02.541 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 429, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:02.617 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:03.0, nextRun=2022-12-08 15:55:00.0, currentDate=Thu Dec 08 15:55:02 CST 2022 2022-12-08 15:55:02.617 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:50:03.0, nextRunTime=2022-12-08 15:55:00.0} 2022-12-08 15:55:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,995947344f76] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486160, interval=60 2022-12-08 15:55:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,995947344f76] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486102, count=0, elapsed=1668815616534 2022-12-08 15:55:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,fd4dc9352c21] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486160, interval=60 2022-12-08 15:55:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,fd4dc9352c21] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486102, count=0, elapsed=1668815616538 2022-12-08 15:55:02.642 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 15:55:02.643 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:02.643 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:02.745 INFO 42 --- [http-nio-8080-exec-5,c5470c4557c24e9e,ee8b921b97c5] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=c5470c4557c24e9e, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 15:55:02.745 INFO 42 --- [http-nio-8080-exec-5,c5470c4557c24e9e,ee8b921b97c5] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=c5470c4557c24e9e, duration=1 ms] 2022-12-08 15:55:02.756 INFO 42 --- [http-nio-8080-exec-2,dc1cec5bd2f24d67,f591f033feb6] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=192.168.28.1, traceId=dc1cec5bd2f24d67, method=SuccessResponse com.alipay.ocp.server.controller.ProfileController.userInfo(), args=] 2022-12-08 15:55:02.755 INFO 42 --- [http-nio-8080-exec-3,d2e212230b49457f,0e30f10b8e9f] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=192.168.28.1, traceId=d2e212230b49457f, method=SuccessResponse com.alipay.ocp.server.controller.PropertyController.getSystemInfo(), args=] 2022-12-08 15:55:02.756 INFO 42 --- [http-nio-8080-exec-10,7ab29c990bf94376,b1075c36e8d0] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=192.168.28.1, traceId=7ab29c990bf94376, method=Map com.alipay.ocp.server.controller.InfoController.info(), args=] 2022-12-08 15:55:02.765 INFO 42 --- [http-nio-8080-exec-10,7ab29c990bf94376,b1075c36e8d0] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=192.168.28.1, traceId=7ab29c990bf94376, duration=10 ms] 2022-12-08 15:55:02.781 INFO 42 --- [http-nio-8080-exec-3,d2e212230b49457f,0e30f10b8e9f] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=192.168.28.1, traceId=d2e212230b49457f, duration=43 ms] 2022-12-08 15:55:02.803 INFO 42 --- [http-nio-8080-exec-2,dc1cec5bd2f24d67,f591f033feb6] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=192.168.28.1, traceId=dc1cec5bd2f24d67, duration=49 ms] 2022-12-08 15:55:02.816 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=429, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T15:55:02.517+08:00, endTime=null} 2022-12-08 15:55:02.868 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 430, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:02.959 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:01.0, nextRun=2022-12-08 15:55:00.0, currentDate=Thu Dec 08 15:55:02 CST 2022 2022-12-08 15:55:02.959 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:54:01.0, nextRunTime=2022-12-08 15:55:00.0} 2022-12-08 15:55:02.973 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:55:02.973 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:02.973 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:02.995 INFO 42 --- [http-nio-8080-exec-7,39eff88901fa49af,46bdb56727d7] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/mc/info?null, client=192.168.28.1, traceId=39eff88901fa49af, method=SuccessResponse com.alipay.ocp.server.controller.OcpMultiClusterInfoController.info(), args=] 2022-12-08 15:55:02.996 INFO 42 --- [http-nio-8080-exec-7,39eff88901fa49af,46bdb56727d7] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/mc/info client=192.168.28.1, traceId=39eff88901fa49af, duration=2 ms] 2022-12-08 15:55:03.050 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:55:03.102 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:55:03.194 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=430, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:55:02.857+08:00, endTime=null} 2022-12-08 15:55:03.256 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 431, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:03.331 INFO 42 --- [http-nio-8080-exec-1,483c1b14b968428f,15f4a3ad1a81] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/maz/state?null, client=192.168.28.1, traceId=483c1b14b968428f, method=SuccessResponse com.alipay.ocp.server.controller.MultiAzoneController.state(), args=] 2022-12-08 15:55:03.392 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=431, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:55:03.245+08:00, endTime=null} 2022-12-08 15:55:03.402 INFO 42 --- [http-nio-8080-exec-1,483c1b14b968428f,15f4a3ad1a81] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/maz/state client=192.168.28.1, traceId=483c1b14b968428f, duration=75 ms] 2022-12-08 15:55:03.713 INFO 42 --- [http-nio-8080-exec-2,40e74838dc574b36,0b40677d37a8] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=192.168.28.1, traceId=40e74838dc574b36, method=OffsetDateTime com.alipay.ocp.server.controller.InfoController.time(), args=] 2022-12-08 15:55:03.716 INFO 42 --- [http-nio-8080-exec-2,40e74838dc574b36,0b40677d37a8] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=192.168.28.1, traceId=40e74838dc574b36, duration=6 ms] 2022-12-08 15:55:03.743 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:55:03.744 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:55:03.746 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:55:03.747 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:55:03.780 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:04.439 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:04.443 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:04.467 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 432, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:04.544 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:429, status:SUCCESS 2022-12-08 15:55:04.551 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:429, status:SUCCESS 2022-12-08 15:55:04.608 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=432, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:55:04.457+08:00, endTime=null} 2022-12-08 15:55:04.663 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 433, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:04.686 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:430, status:SUCCESS 2022-12-08 15:55:04.692 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:430, status:SUCCESS 2022-12-08 15:55:04.753 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=433, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:55:04.649+08:00, endTime=null} 2022-12-08 15:55:04.788 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:431, status:SUCCESS 2022-12-08 15:55:04.792 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:431, status:SUCCESS 2022-12-08 15:55:04.812 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 434, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:04.898 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=434, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T15:55:04.800+08:00, endTime=null} 2022-12-08 15:55:04.938 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 435, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:04.994 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=435, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:55:04.932+08:00, endTime=null} 2022-12-08 15:55:05.081 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:55:05.368 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:05.902 INFO 42 --- [pool-ocp-schedules-2,,a60c7f95953b] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:55:05.919 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:06.0, nextRun=2022-12-08 15:55:05.0, currentDate=Thu Dec 08 15:55:05 CST 2022 2022-12-08 15:55:05.921 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:54:06.0, nextRunTime=2022-12-08 15:55:05.0} 2022-12-08 15:55:05.944 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:55:05.945 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:05.945 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:06.384 INFO 42 --- [http-nio-8080-exec-2,906219d57d4e4d89,d0312cb1ea47] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=906219d57d4e4d89, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 15:55:06.515 WARN 42 --- [http-nio-8080-exec-2,906219d57d4e4d89,d0312cb1ea47] o.h.v.i.p.javabean.JavaBeanExecutable : HV000254: Missing parameter metadata for WithRemote(String, int, String), which declares implicit or synthetic parameters. Automatic resolution of generic type information for method parameters may yield incorrect results if multiple parameters have the same erasure. To solve this, compile your code with the '-parameters' flag. 2022-12-08 15:55:06.794 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:55:06.799 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:55:06.860 INFO 42 --- [http-nio-8080-exec-2,906219d57d4e4d89,d0312cb1ea47] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=906219d57d4e4d89, duration=541 ms] 2022-12-08 15:55:06.947 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:432, status:SUCCESS 2022-12-08 15:55:06.963 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:432, status:SUCCESS 2022-12-08 15:55:07.023 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:433, status:SUCCESS 2022-12-08 15:55:07.029 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:433, status:SUCCESS 2022-12-08 15:55:07.069 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 436, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:07.112 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:434, status:SUCCESS 2022-12-08 15:55:07.117 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:434, status:SUCCESS 2022-12-08 15:55:07.125 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=436, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:55:07.059+08:00, endTime=null} 2022-12-08 15:55:07.443 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:07.447 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:07.473 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:435, status:SUCCESS 2022-12-08 15:55:07.479 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:435, status:SUCCESS 2022-12-08 15:55:08.227 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:55:08.395 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:54:37+08:00, updateTime=2022-12-08T15:54:37+08:00, expireTime=null, isLeader=false} 2022-12-08 15:55:08.417 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:55:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:55:08.805 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:55:08.802938+08:00, lastProcessTime=2022-12-08T15:54:58.816157+08:00 2022-12-08 15:55:08.853 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:436, status:SUCCESS 2022-12-08 15:55:08.883 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:436, status:SUCCESS 2022-12-08 15:55:08.942 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:55:08.802938+08:00, resultsCount=0 2022-12-08 15:55:08.942 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:55:08.802938+08:00, resultsCount=0 2022-12-08 15:55:08.943 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:55:08.802938+08:00 2022-12-08 15:55:09.477 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:55:09.776 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:55:10.384 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:55:10.448 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:10.453 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:13.321 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:55:13.324 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:55:13.454 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:13.459 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:14.023 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:15.369 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:55:15.426 INFO 42 --- [pool-ocp-schedules-19,,d6cda01dd29d] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:55:15.427 INFO 42 --- [pool-ocp-schedules-19,,d6cda01dd29d] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:55:15.506 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:15.903 INFO 42 --- [pool-ocp-schedules-1,,17121b9cf2ad] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:55:16.460 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:16.467 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:17.396 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:55:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:55:18.820 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:55:18.817904+08:00, lastProcessTime=2022-12-08T15:55:08.802938+08:00 2022-12-08 15:55:18.945 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:55:18.817904+08:00, resultsCount=0 2022-12-08 15:55:18.946 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:55:18.817904+08:00, resultsCount=0 2022-12-08 15:55:18.947 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:55:18.817904+08:00 2022-12-08 15:55:19.467 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:19.472 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:20.781 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:20.0, nextRun=2022-12-08 15:55:20.0, currentDate=Thu Dec 08 15:55:20 CST 2022 2022-12-08 15:55:20.782 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:54:20.0, nextRunTime=2022-12-08 15:55:20.0} 2022-12-08 15:55:20.807 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:55:20.807 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:20.808 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:21.405 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 437, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:21.993 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=437, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:55:21.392+08:00, endTime=null} 2022-12-08 15:55:22.473 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:22.485 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:23.809 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:55:23.819 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:55:24.024 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:55:24.028 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:55:24.551 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:25.248 INFO 42 --- [http-nio-8080-exec-5,b5251b04df534b8e,0027122c894e] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=192.168.28.1, traceId=b5251b04df534b8e, method=OffsetDateTime com.alipay.ocp.server.controller.InfoController.time(), args=] 2022-12-08 15:55:25.248 INFO 42 --- [http-nio-8080-exec-5,b5251b04df534b8e,0027122c894e] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=192.168.28.1, traceId=b5251b04df534b8e, duration=2 ms] 2022-12-08 15:55:25.257 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:437, status:SUCCESS 2022-12-08 15:55:25.265 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:437, status:SUCCESS 2022-12-08 15:55:25.486 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:25.487 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:55:25.491 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:25.602 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:55:25.847 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:25.904 INFO 42 --- [pool-ocp-schedules-1,,4aba4b63ae2c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:55:26.191 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:25.0, nextRun=2022-12-08 15:55:25.0, currentDate=Thu Dec 08 15:55:26 CST 2022 2022-12-08 15:55:26.192 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:54:25.0, nextRunTime=2022-12-08 15:55:25.0} 2022-12-08 15:55:26.235 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:55:26.236 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:26.237 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:26.776 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:26.780 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:27.076 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:55:27.144 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 438, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:27.257 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=438, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:55:27.130+08:00, endTime=null} 2022-12-08 15:55:28.491 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:28.497 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:55:28.821 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:55:28.818916+08:00, lastProcessTime=2022-12-08T15:55:18.817904+08:00 2022-12-08 15:55:28.937 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:55:28.818916+08:00, resultsCount=0 2022-12-08 15:55:28.938 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:55:28.818916+08:00, resultsCount=0 2022-12-08 15:55:28.939 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:55:28.818916+08:00 2022-12-08 15:55:28.991 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:438, status:SUCCESS 2022-12-08 15:55:28.998 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:438, status:SUCCESS 2022-12-08 15:55:30.072 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:55:30.072 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:55:30.073 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:55:30.073 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:55:30.781 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:30.0, nextRun=2022-12-08 15:55:30.0, currentDate=Thu Dec 08 15:55:30 CST 2022 2022-12-08 15:55:30.782 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:54:30.0, nextRunTime=2022-12-08 15:55:30.0} 2022-12-08 15:55:30.808 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:55:30.995 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:02.0, nextRun=2022-12-08 15:55:30.0, currentDate=Thu Dec 08 15:55:30 CST 2022 2022-12-08 15:55:30.996 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:55:02.0, nextRunTime=2022-12-08 15:55:30.0} 2022-12-08 15:55:31.012 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:55:31.013 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:55:31.013 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:55:31.370 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 439, operation:EXECUTE, state: RUNNING 2022-12-08 15:55:31.498 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:31.504 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:31.811 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=439, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:55:31.359+08:00, endTime=null} 2022-12-08 15:55:33.261 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:55:33.266 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:55:33.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:33.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:34.005 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:55:34.363 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:55:34.384 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:55:34.505 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:34.509 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:34.817 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:35.008 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:439, status:SUCCESS 2022-12-08 15:55:35.016 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:439, status:SUCCESS 2022-12-08 15:55:35.615 INFO 42 --- [pool-ocp-schedules-10,,fefc2f54ab7a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:55:35.616 INFO 42 --- [pool-ocp-schedules-10,,fefc2f54ab7a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:55:35.695 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:55:35.906 INFO 42 --- [pool-ocp-schedules-17,,3dda66f7f121] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:55:36.575 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:36.929 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:55:36.929 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:55:36.932 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:55:36.932 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:55:37.510 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:37.514 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:38.475 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:55:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:55:38.807 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:55:38.804750+08:00, lastProcessTime=2022-12-08T15:55:28.818916+08:00 2022-12-08 15:55:38.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:55:38.804750+08:00, resultsCount=0 2022-12-08 15:55:38.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:55:38.804750+08:00, resultsCount=0 2022-12-08 15:55:38.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:55:38.804750+08:00 2022-12-08 15:55:39.592 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:55:39.884 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:55:39.891 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:55:39.954 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:55:40.148 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:40.148 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:40.195 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:55:40.229 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=34ms, period=120000ms 2022-12-08 15:55:40.516 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:40.521 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:40.603 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:55:40.918 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:55:43.495 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:55:43.496 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:55:43.523 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:43.527 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:43.915 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:55:43.916 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:55:44.817 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:55:44.821 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:55:45.470 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 15:55:45.471 INFO 42 --- [pool-ocp-schedules-9,,aa5ef1c86455] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:55:45.507 INFO 42 --- [pool-ocp-schedules-9,,aa5ef1c86455] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:55:45.514 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:45.697 INFO 42 --- [pool-ocp-schedules-18,,c81cf49165ff] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:55:45.744 INFO 42 --- [pool-ocp-schedules-16,,790ac9da5851] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:55:45.744 INFO 42 --- [pool-ocp-schedules-16,,790ac9da5851] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:55:45.907 INFO 42 --- [pool-ocp-schedules-3,,b72f02ec9394] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:55:45.908 INFO 42 --- [pool-ocp-schedules-4,,c8d5403a5be7] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 15:55:46.087 INFO 42 --- [pool-ocp-schedules-1,,5a058f644c6f] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:55:46.142 INFO 42 --- [pool-ocp-schedules-12,,e35a714e0e8b] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 15:55:46.528 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:46.616 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:55:46.619 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:55:48.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:55:48.797496+08:00, lastProcessTime=2022-12-08T15:55:38.804750+08:00 2022-12-08 15:55:48.828 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:48.967 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:55:48.975 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:55:49.010 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:55:48.797496+08:00, resultsCount=0 2022-12-08 15:55:49.011 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:55:48.797496+08:00, resultsCount=0 2022-12-08 15:55:49.011 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:55:48.797496+08:00 2022-12-08 15:55:49.620 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:49.624 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:51.265 INFO 42 --- [pool-ocp-schedules-5,,71dfa359a213] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:55:51.694 INFO 42 --- [pool-ocp-schedules-17,,97829201d310] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:55:51.857 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:51.862 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:52.272 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:55:52.402 INFO 42 --- [pool-ocp-schedules-18,,81b335965da2] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:55:52.625 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:52.634 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:52.810 INFO 42 --- [pool-ocp-schedules-9,,e9672157b7ac] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:55:52.811 INFO 42 --- [pool-ocp-schedules-9,,e9672157b7ac] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:55:52.812 INFO 42 --- [pool-ocp-schedules-9,,e9672157b7ac] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:55:54.960 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:55:54.960 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:55:54.961 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:55:54.961 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:55:55.514 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:55:55.520 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:55:55.635 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:55.639 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:55.673 INFO 42 --- [pool-ocp-schedules-7,,1742387d1d8d] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:55:55.673 INFO 42 --- [pool-ocp-schedules-7,,1742387d1d8d] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:55:55.908 INFO 42 --- [pool-ocp-schedules-8,,4fc3f04f9108] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:55:56.274 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:55:56.617 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:55:57.593 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:55:57.599 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:55:58.033 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:58.033 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:55:58.219 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:55:58.640 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:55:58.645 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:55:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,d3e06e32b2a0] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:55:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,d3e06e32b2a0] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:55:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:55:58.826 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:55:58.818846+08:00, lastProcessTime=2022-12-08T15:55:48.797496+08:00 2022-12-08 15:55:58.829 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:55:58.979 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:55:58.818846+08:00, resultsCount=0 2022-12-08 15:55:58.981 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:55:58.818846+08:00, resultsCount=0 2022-12-08 15:55:58.981 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:55:58.818846+08:00 2022-12-08 15:55:59.715 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:01.040 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:54:01.0, nextRun=2022-12-08 15:56:00.0, currentDate=Thu Dec 08 15:56:01 CST 2022 2022-12-08 15:56:01.041 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:54:01.0, nextRunTime=2022-12-08 15:56:00.0} 2022-12-08 15:56:01.061 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:56:01.101 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:01.101 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:01.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:01.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:01.137 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:02.0, nextRun=2022-12-08 15:56:00.0, currentDate=Thu Dec 08 15:56:01 CST 2022 2022-12-08 15:56:01.138 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:55:02.0, nextRunTime=2022-12-08 15:56:00.0} 2022-12-08 15:56:01.154 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:56:01.155 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:56:01.155 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:56:01.323 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:02.0, nextRun=2022-12-08 15:56:00.0, currentDate=Thu Dec 08 15:56:01 CST 2022 2022-12-08 15:56:01.324 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:55:02.0, nextRunTime=2022-12-08 15:56:00.0} 2022-12-08 15:56:01.352 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:56:01.352 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:56:01.353 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:56:01.410 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:02.0, nextRun=2022-12-08 15:56:00.0, currentDate=Thu Dec 08 15:56:01 CST 2022 2022-12-08 15:56:01.411 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:55:02.0, nextRunTime=2022-12-08 15:56:00.0} 2022-12-08 15:56:01.434 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:56:01.435 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:56:01.435 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:56:01.524 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:31.0, nextRun=2022-12-08 15:56:00.0, currentDate=Thu Dec 08 15:56:01 CST 2022 2022-12-08 15:56:01.524 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:55:31.0, nextRunTime=2022-12-08 15:56:00.0} 2022-12-08 15:56:01.543 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:56:01.543 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:56:01.544 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:56:01.637 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:03.0, nextRun=2022-12-08 15:56:00.0, currentDate=Thu Dec 08 15:56:01 CST 2022 2022-12-08 15:56:01.638 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:55:03.0, nextRunTime=2022-12-08 15:56:00.0} 2022-12-08 15:56:01.646 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:01.650 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:01.657 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:56:01.658 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:56:01.658 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:56:02.303 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 440, operation:EXECUTE, state: RUNNING 2022-12-08 15:56:02.435 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=440, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:56:02.289+08:00, endTime=null} 2022-12-08 15:56:02.513 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 441, operation:EXECUTE, state: RUNNING 2022-12-08 15:56:02.557 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=441, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:56:02.497+08:00, endTime=null} 2022-12-08 15:56:02.627 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 442, operation:EXECUTE, state: RUNNING 2022-12-08 15:56:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,c94bcd091ad7] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486220, interval=60 2022-12-08 15:56:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,c94bcd091ad7] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486162, count=0, elapsed=1668815676473 2022-12-08 15:56:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,72670d85a7ab] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486220, interval=60 2022-12-08 15:56:02.642 INFO 42 --- [pool-prometheus-minute-schedule-1,,72670d85a7ab] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486162, count=0, elapsed=1668815676480 2022-12-08 15:56:02.685 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=442, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:56:02.613+08:00, endTime=null} 2022-12-08 15:56:02.775 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 443, operation:EXECUTE, state: RUNNING 2022-12-08 15:56:02.876 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=443, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:56:02.761+08:00, endTime=null} 2022-12-08 15:56:02.971 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 444, operation:EXECUTE, state: RUNNING 2022-12-08 15:56:03.133 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=444, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:56:02.951+08:00, endTime=null} 2022-12-08 15:56:03.786 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:56:03.795 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:56:04.265 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:04.286 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:440, status:SUCCESS 2022-12-08 15:56:04.291 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:04.292 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:440, status:SUCCESS 2022-12-08 15:56:04.443 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:441, status:SUCCESS 2022-12-08 15:56:04.452 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:441, status:SUCCESS 2022-12-08 15:56:04.555 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:56:04.608 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:442, status:SUCCESS 2022-12-08 15:56:04.614 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:442, status:SUCCESS 2022-12-08 15:56:04.651 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:04.654 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:04.981 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:443, status:SUCCESS 2022-12-08 15:56:04.987 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:443, status:SUCCESS 2022-12-08 15:56:05.110 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:444, status:SUCCESS 2022-12-08 15:56:05.116 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:444, status:SUCCESS 2022-12-08 15:56:05.554 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:56:05.558 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:56:05.910 INFO 42 --- [pool-ocp-schedules-14,,285264c1807e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:56:06.315 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:06.0, nextRun=2022-12-08 15:56:05.0, currentDate=Thu Dec 08 15:56:06 CST 2022 2022-12-08 15:56:06.316 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:55:06.0, nextRunTime=2022-12-08 15:56:05.0} 2022-12-08 15:56:06.333 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:56:06.334 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:56:06.334 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:56:06.664 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:07.286 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 445, operation:EXECUTE, state: RUNNING 2022-12-08 15:56:07.373 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=445, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:56:07.269+08:00, endTime=null} 2022-12-08 15:56:07.429 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:07.429 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:07.430 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:07.431 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:07.655 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:07.663 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:08.705 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:56:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:56:08.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:56:08.794830+08:00, lastProcessTime=2022-12-08T15:55:58.818846+08:00 2022-12-08 15:56:08.986 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:56:08.794830+08:00, resultsCount=0 2022-12-08 15:56:08.987 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:56:08.794830+08:00, resultsCount=0 2022-12-08 15:56:08.987 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:56:08.794830+08:00 2022-12-08 15:56:09.045 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:445, status:SUCCESS 2022-12-08 15:56:09.055 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:445, status:SUCCESS 2022-12-08 15:56:09.176 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:56:09.800 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:10.029 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:56:10.105 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:56:10.112 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:56:10.207 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:54:39+08:00, updateTime=2022-12-08T15:55:39+08:00, expireTime=null, isLeader=false} 2022-12-08 15:56:10.260 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:54:39+08:00, updateTime=2022-12-08T15:55:39+08:00, expireTime=null, isLeader=false} 2022-12-08 15:56:10.267 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:56:10.317 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:56:10.326 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:56:10.551 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:10.553 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:10.664 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:10.668 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:10.940 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:56:11.457 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:56:13.670 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:13.674 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:13.920 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:13.921 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:13.921 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:13.922 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:15.715 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:56:15.718 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:56:15.754 INFO 42 --- [pool-ocp-schedules-9,,2c572fbe4e37] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:56:15.755 INFO 42 --- [pool-ocp-schedules-9,,2c572fbe4e37] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:56:15.911 INFO 42 --- [pool-ocp-schedules-14,,77233ed39098] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:56:16.350 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:56:16.356 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:56:16.676 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:16.681 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:16.739 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:17.268 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:17.268 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:17.714 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:56:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:56:18.816 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:56:18.811846+08:00, lastProcessTime=2022-12-08T15:56:08.794830+08:00 2022-12-08 15:56:18.935 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:56:18.811846+08:00, resultsCount=0 2022-12-08 15:56:18.935 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:56:18.811846+08:00, resultsCount=0 2022-12-08 15:56:18.935 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:56:18.811846+08:00 2022-12-08 15:56:19.253 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:56:19.682 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:19.694 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:20.029 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:20.038 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:21.0, nextRun=2022-12-08 15:56:20.0, currentDate=Thu Dec 08 15:56:20 CST 2022 2022-12-08 15:56:20.039 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:55:21.0, nextRunTime=2022-12-08 15:56:20.0} 2022-12-08 15:56:20.056 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:56:20.058 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:56:20.058 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:56:20.340 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:20.340 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:20.343 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:20.343 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:20.637 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 446, operation:EXECUTE, state: RUNNING 2022-12-08 15:56:20.700 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=446, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:56:20.611+08:00, endTime=null} 2022-12-08 15:56:21.994 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:446, status:SUCCESS 2022-12-08 15:56:22.003 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:446, status:SUCCESS 2022-12-08 15:56:22.184 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T15:50:20.832, end=2022-12-08T15:55:22.064} 2022-12-08 15:56:22.184 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T15:50:20.832, end=2022-12-08T15:55:22.063} 2022-12-08 15:56:22.198 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:56:22.199 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 15:56:22.695 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:22.699 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:22.956 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:56:22.968 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:56:23.453 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:23.457 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:23.574 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:56:25.700 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:25.709 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:25.818 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:56:25.821 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:56:25.912 INFO 42 --- [pool-ocp-schedules-15,,1b7ae58fc7a1] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:56:26.000 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:26.0, nextRun=2022-12-08 15:56:25.0, currentDate=Thu Dec 08 15:56:26 CST 2022 2022-12-08 15:56:26.001 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:55:26.0, nextRunTime=2022-12-08 15:56:25.0} 2022-12-08 15:56:26.044 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:56:26.044 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:56:26.044 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:56:26.574 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:26.574 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:26.575 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:26.575 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:26.780 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:56:26.867 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 447, operation:EXECUTE, state: RUNNING 2022-12-08 15:56:26.945 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:26.954 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=447, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:56:26.853+08:00, endTime=null} 2022-12-08 15:56:28.325 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:447, status:SUCCESS 2022-12-08 15:56:28.331 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:447, status:SUCCESS 2022-12-08 15:56:28.710 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:28.714 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:56:28.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:56:28.791332+08:00, lastProcessTime=2022-12-08T15:56:18.811846+08:00 2022-12-08 15:56:28.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:56:28.791332+08:00, resultsCount=0 2022-12-08 15:56:28.888 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:56:28.791332+08:00, resultsCount=0 2022-12-08 15:56:28.888 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:56:28.791332+08:00 2022-12-08 15:56:29.006 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:56:29.011 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:56:29.325 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:56:29.630 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:29.631 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:30.067 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:30.098 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:56:30.404 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:52:29.404, end=2022-12-08T15:54:30.359} 2022-12-08 15:56:30.427 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:56:30.900 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:31.0, nextRun=2022-12-08 15:56:30.0, currentDate=Thu Dec 08 15:56:30 CST 2022 2022-12-08 15:56:30.901 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:55:31.0, nextRunTime=2022-12-08 15:56:30.0} 2022-12-08 15:56:30.940 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:56:31.077 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:02.0, nextRun=2022-12-08 15:56:30.0, currentDate=Thu Dec 08 15:56:31 CST 2022 2022-12-08 15:56:31.078 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:56:02.0, nextRunTime=2022-12-08 15:56:30.0} 2022-12-08 15:56:31.097 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:56:31.098 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:56:31.098 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:56:31.715 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:31.721 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:32.097 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 448, operation:EXECUTE, state: RUNNING 2022-12-08 15:56:32.354 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=448, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:56:32.085+08:00, endTime=null} 2022-12-08 15:56:32.718 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:32.719 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:32.721 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:32.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:34.333 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:448, status:SUCCESS 2022-12-08 15:56:34.343 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:448, status:SUCCESS 2022-12-08 15:56:34.721 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:34.727 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:35.328 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:56:35.333 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:56:35.873 INFO 42 --- [pool-ocp-schedules-5,,7360a1a5ae93] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:56:35.874 INFO 42 --- [pool-ocp-schedules-5,,7360a1a5ae93] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:56:35.884 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:35.885 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:35.913 INFO 42 --- [pool-ocp-schedules-9,,8df857be9c65] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:56:35.941 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:56:35.945 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:56:36.466 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:56:37.045 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:37.728 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:37.732 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:56:38.782 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:56:38.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:56:38.790777+08:00, lastProcessTime=2022-12-08T15:56:28.791332+08:00 2022-12-08 15:56:38.878 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:56:38.790777+08:00, resultsCount=0 2022-12-08 15:56:38.878 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:56:38.790777+08:00, resultsCount=0 2022-12-08 15:56:38.878 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:56:38.790777+08:00 2022-12-08 15:56:38.971 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:38.971 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:38.973 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:38.973 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:39.419 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:56:40.191 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:40.317 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:56:40.434 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:56:40.732 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:40.736 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:41.753 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:56:41.759 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:56:41.945 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:56:42.057 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:42.060 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:42.333 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:56:43.737 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:43.742 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:45.137 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:45.138 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:45.183 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:45.183 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:45.471 INFO 42 --- [pool-ocp-schedules-7,,43b467745254] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:56:45.497 INFO 42 --- [pool-ocp-schedules-7,,43b467745254] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:56:45.698 INFO 42 --- [pool-ocp-schedules-18,,4b7de959bad1] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:56:45.914 INFO 42 --- [pool-ocp-schedules-9,,7c70ea71442a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:56:45.985 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:56:46.010 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:56:46.093 INFO 42 --- [pool-ocp-schedules-2,,71b66abd12df] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:56:46.743 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:46.747 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:47.092 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:47.623 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:56:47.628 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:56:48.197 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:48.239 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:48.756 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:56:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:56:48.803 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:56:48.801357+08:00, lastProcessTime=2022-12-08T15:56:38.790777+08:00 2022-12-08 15:56:48.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:56:48.801357+08:00, resultsCount=0 2022-12-08 15:56:48.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:56:48.801357+08:00, resultsCount=0 2022-12-08 15:56:48.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:56:48.801357+08:00 2022-12-08 15:56:49.618 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:56:49.748 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:49.752 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:50.290 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:51.280 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:51.281 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:51.382 INFO 42 --- [pool-ocp-schedules-8,,2b5660f07464] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:56:51.416 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:51.417 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:51.999 INFO 42 --- [pool-ocp-schedules-1,,f21d05ac8df8] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:56:52.496 INFO 42 --- [pool-ocp-schedules-8,,37492376679d] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:56:52.753 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:52.757 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:52.928 INFO 42 --- [pool-ocp-schedules-3,,8c67b5af90cc] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:56:52.929 INFO 42 --- [pool-ocp-schedules-3,,8c67b5af90cc] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:56:52.929 INFO 42 --- [pool-ocp-schedules-3,,8c67b5af90cc] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:56:53.987 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:56:53.991 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:56:54.396 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:54.475 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:56:54.645 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:56:55.757 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:55.762 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:55.915 INFO 42 --- [pool-ocp-schedules-12,,9a5c47d6b4f9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:56:56.168 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:56:56.199 INFO 42 --- [pool-ocp-schedules-11,,f4faa1da3980] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:56:56.200 INFO 42 --- [pool-ocp-schedules-11,,f4faa1da3980] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:56:56.239 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:56:56.989 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:56:57.126 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:56:57.479 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:57.479 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:57.542 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:56:57.542 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:56:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,8e52d7d87d56] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:56:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,8e52d7d87d56] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:56:58.763 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:56:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:56:58.768 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:56:58.803 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:56:58.800753+08:00, lastProcessTime=2022-12-08T15:56:48.801357+08:00 2022-12-08 15:56:58.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:56:58.800753+08:00, resultsCount=0 2022-12-08 15:56:58.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:56:58.800753+08:00, resultsCount=0 2022-12-08 15:56:58.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:56:58.800753+08:00 2022-12-08 15:56:59.645 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:57:00.001 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 15:57:00.351 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:00.670 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:57:00.674 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:57:01.375 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:01.0, nextRun=2022-12-08 15:57:00.0, currentDate=Thu Dec 08 15:57:01 CST 2022 2022-12-08 15:57:01.376 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:56:01.0, nextRunTime=2022-12-08 15:57:00.0} 2022-12-08 15:57:01.396 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:57:01.397 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:57:01.397 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:57:01.768 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:01.981 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:01.994 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:01.0, nextRun=2022-12-08 15:57:00.0, currentDate=Thu Dec 08 15:57:01 CST 2022 2022-12-08 15:57:01.994 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:56:01.0, nextRunTime=2022-12-08 15:57:00.0} 2022-12-08 15:57:02.018 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:57:02.018 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:57:02.018 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:57:02.044 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 449, operation:EXECUTE, state: RUNNING 2022-12-08 15:57:02.331 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:01.0, nextRun=2022-12-08 15:57:00.0, currentDate=Thu Dec 08 15:57:02 CST 2022 2022-12-08 15:57:02.332 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:56:01.0, nextRunTime=2022-12-08 15:57:00.0} 2022-12-08 15:57:02.333 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=449, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:57:02.032+08:00, endTime=null} 2022-12-08 15:57:02.356 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:57:02.356 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:57:02.357 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:57:02.450 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:31.0, nextRun=2022-12-08 15:57:00.0, currentDate=Thu Dec 08 15:57:02 CST 2022 2022-12-08 15:57:02.451 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:56:31.0, nextRunTime=2022-12-08 15:57:00.0} 2022-12-08 15:57:02.470 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:57:02.471 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:57:02.471 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:57:02.607 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:02.0, nextRun=2022-12-08 15:57:00.0, currentDate=Thu Dec 08 15:57:02 CST 2022 2022-12-08 15:57:02.608 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:56:02.0, nextRunTime=2022-12-08 15:57:00.0} 2022-12-08 15:57:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,f722a617b9cd] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486280, interval=60 2022-12-08 15:57:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,f722a617b9cd] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486222, count=0, elapsed=1668815736413 2022-12-08 15:57:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,14bf0774aa0e] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486280, interval=60 2022-12-08 15:57:02.641 INFO 42 --- [pool-prometheus-minute-schedule-1,,14bf0774aa0e] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486222, count=0, elapsed=1668815736419 2022-12-08 15:57:02.656 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:57:02.657 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:57:02.657 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:57:03.202 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:449, status:SUCCESS 2022-12-08 15:57:03.207 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:449, status:SUCCESS 2022-12-08 15:57:03.429 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 450, operation:EXECUTE, state: RUNNING 2022-12-08 15:57:03.825 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=450, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:57:03.407+08:00, endTime=null} 2022-12-08 15:57:03.890 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 451, operation:EXECUTE, state: RUNNING 2022-12-08 15:57:03.944 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=451, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:57:03.871+08:00, endTime=null} 2022-12-08 15:57:04.006 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 452, operation:EXECUTE, state: RUNNING 2022-12-08 15:57:04.340 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=452, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:57:03.996+08:00, endTime=null} 2022-12-08 15:57:04.391 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 453, operation:EXECUTE, state: RUNNING 2022-12-08 15:57:04.610 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=453, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:57:04.381+08:00, endTime=null} 2022-12-08 15:57:04.982 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:04.991 INFO 42 --- [pool-ocp-schedules-15,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 15:57:05.123 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:05.134 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:450, status:SUCCESS 2022-12-08 15:57:05.140 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:450, status:SUCCESS 2022-12-08 15:57:05.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:451, status:SUCCESS 2022-12-08 15:57:05.250 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:451, status:SUCCESS 2022-12-08 15:57:05.411 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:452, status:SUCCESS 2022-12-08 15:57:05.416 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:452, status:SUCCESS 2022-12-08 15:57:05.494 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:453, status:SUCCESS 2022-12-08 15:57:05.499 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:453, status:SUCCESS 2022-12-08 15:57:05.516 INFO 42 --- [pool-ocp-schedules-15,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 15:57:05.651 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 15:57:05.916 INFO 42 --- [pool-ocp-schedules-16,,6fdabce55ebe] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:57:05.975 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : Started application in 5.93 seconds (JVM running for 2222.821) 2022-12-08 15:57:06.193 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:06.0, nextRun=2022-12-08 15:57:05.0, currentDate=Thu Dec 08 15:57:06 CST 2022 2022-12-08 15:57:06.194 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:56:06.0, nextRunTime=2022-12-08 15:57:05.0} 2022-12-08 15:57:06.209 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:57:06.210 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:57:06.210 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:57:06.282 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:57:06.321 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:57:06.742 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 454, operation:EXECUTE, state: RUNNING 2022-12-08 15:57:06.776 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=454, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:57:06.698+08:00, endTime=null} 2022-12-08 15:57:07.152 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:07.930 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:454, status:SUCCESS 2022-12-08 15:57:07.936 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:454, status:SUCCESS 2022-12-08 15:57:08.124 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:08.127 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:08.183 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T15:57:08.183+08:00 2022-12-08 15:57:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:57:08.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:57:08.793121+08:00, lastProcessTime=2022-12-08T15:56:58.800753+08:00 2022-12-08 15:57:08.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:57:08.793121+08:00, resultsCount=0 2022-12-08 15:57:08.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:57:08.793121+08:00, resultsCount=0 2022-12-08 15:57:08.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:57:08.793121+08:00 2022-12-08 15:57:09.045 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:57:09.085 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:55:08+08:00, updateTime=2022-12-08T15:56:38+08:00, expireTime=null, isLeader=false} 2022-12-08 15:57:09.092 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:57:10.083 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:57:10.463 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:57:10.550 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:57:11.128 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:11.133 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:11.250 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:11.611 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:57:12.046 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:57:14.134 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:14.138 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:15.935 INFO 42 --- [pool-ocp-schedules-10,,6ce2c8985536] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:57:16.321 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:57:16.345 INFO 42 --- [pool-ocp-schedules-4,,e24ee364b3fc] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:57:16.346 INFO 42 --- [pool-ocp-schedules-4,,e24ee364b3fc] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:57:16.374 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:57:16.760 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:57:16.766 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:57:17.138 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:17.143 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:17.181 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:17.533 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:17.542 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:17.876 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:57:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:57:18.803 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:57:18.800377+08:00, lastProcessTime=2022-12-08T15:57:08.793121+08:00 2022-12-08 15:57:18.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:57:18.800377+08:00, resultsCount=0 2022-12-08 15:57:18.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:57:18.800377+08:00, resultsCount=0 2022-12-08 15:57:18.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:57:18.800377+08:00 2022-12-08 15:57:20.144 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:20.149 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:20.464 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:57:20.663 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:20.663 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:20.664 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:20.665 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:21.343 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:20.0, nextRun=2022-12-08 15:57:20.0, currentDate=Thu Dec 08 15:57:21 CST 2022 2022-12-08 15:57:21.343 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:56:20.0, nextRunTime=2022-12-08 15:57:20.0} 2022-12-08 15:57:21.364 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:57:21.364 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:57:21.364 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:57:21.425 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:22.048 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 455, operation:EXECUTE, state: RUNNING 2022-12-08 15:57:22.086 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=455, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:57:22.036+08:00, endTime=null} 2022-12-08 15:57:22.584 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:455, status:SUCCESS 2022-12-08 15:57:22.595 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:455, status:SUCCESS 2022-12-08 15:57:23.149 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:23.157 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:23.203 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:57:23.209 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:57:23.835 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:23.836 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:24.300 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:57:25.672 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:26.0, nextRun=2022-12-08 15:57:25.0, currentDate=Thu Dec 08 15:57:25 CST 2022 2022-12-08 15:57:25.673 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:56:26.0, nextRunTime=2022-12-08 15:57:25.0} 2022-12-08 15:57:25.719 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:57:25.719 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:57:25.720 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:57:25.937 INFO 42 --- [pool-ocp-schedules-15,,1fd0c37cfa8a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:57:26.158 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:26.162 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:26.201 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 456, operation:EXECUTE, state: RUNNING 2022-12-08 15:57:26.349 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=456, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:57:26.183+08:00, endTime=null} 2022-12-08 15:57:26.400 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:57:26.526 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:57:26.909 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:26.909 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:26.910 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:26.910 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:27.083 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:57:27.403 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:27.677 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:456, status:SUCCESS 2022-12-08 15:57:27.686 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:456, status:SUCCESS 2022-12-08 15:57:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:57:28.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:57:28.793501+08:00, lastProcessTime=2022-12-08T15:57:18.800377+08:00 2022-12-08 15:57:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:57:28.793501+08:00, resultsCount=0 2022-12-08 15:57:28.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:57:28.793501+08:00, resultsCount=0 2022-12-08 15:57:28.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:57:28.793501+08:00 2022-12-08 15:57:29.163 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:29.168 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:29.677 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:57:29.684 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:57:30.421 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:30.432 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:30.784 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:57:30.823 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:57:30.886 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:31.0, nextRun=2022-12-08 15:57:30.0, currentDate=Thu Dec 08 15:57:30 CST 2022 2022-12-08 15:57:30.886 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:56:31.0, nextRunTime=2022-12-08 15:57:30.0} 2022-12-08 15:57:30.914 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:57:31.021 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:57:02.0, nextRun=2022-12-08 15:57:30.0, currentDate=Thu Dec 08 15:57:31 CST 2022 2022-12-08 15:57:31.021 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:57:02.0, nextRunTime=2022-12-08 15:57:30.0} 2022-12-08 15:57:31.040 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:57:31.041 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:57:31.041 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:57:31.485 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 457, operation:EXECUTE, state: RUNNING 2022-12-08 15:57:31.506 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:31.694 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=457, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:57:31.472+08:00, endTime=null} 2022-12-08 15:57:32.169 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:32.173 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:33.481 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:457, status:SUCCESS 2022-12-08 15:57:33.496 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:457, status:SUCCESS 2022-12-08 15:57:33.523 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:33.523 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:33.524 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:33.524 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:35.174 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:35.183 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:35.938 INFO 42 --- [pool-ocp-schedules-9,,27c54b0bb696] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:57:36.017 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:57:36.023 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:57:36.490 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:57:36.573 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:57:36.585 INFO 42 --- [pool-ocp-schedules-2,,2615953243d6] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:57:36.586 INFO 42 --- [pool-ocp-schedules-2,,2615953243d6] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:57:36.855 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:36.864 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:37.203 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:57:37.574 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:38.184 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:38.188 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:57:38.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:57:38.795926+08:00, lastProcessTime=2022-12-08T15:57:28.793501+08:00 2022-12-08 15:57:38.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:57:38.795926+08:00, resultsCount=0 2022-12-08 15:57:38.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:57:38.795926+08:00, resultsCount=0 2022-12-08 15:57:38.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:57:38.795926+08:00 2022-12-08 15:57:39.129 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:57:39.929 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:39.929 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:39.984 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:39.985 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:40.360 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:57:40.390 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=30ms, period=120000ms 2022-12-08 15:57:40.550 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:57:40.809 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:57:40.871 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:57:41.189 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:41.194 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:41.686 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:42.403 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:57:43.297 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:57:43.302 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:57:43.444 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:43.695 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:43.977 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:57:44.195 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:44.201 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:45.472 INFO 42 --- [pool-ocp-schedules-4,,d56c6d449357] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:57:45.512 INFO 42 --- [pool-ocp-schedules-4,,d56c6d449357] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:57:45.699 INFO 42 --- [pool-ocp-schedules-12,,2f6498d0f142] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:57:45.746 INFO 42 --- [pool-ocp-schedules-1,,d6732a484f45] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:57:45.747 INFO 42 --- [pool-ocp-schedules-1,,d6732a484f45] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:57:45.939 INFO 42 --- [pool-ocp-schedules-16,,d5b32476f866] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:57:46.098 INFO 42 --- [pool-ocp-schedules-20,,b1e39c5a4f5d] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:57:46.623 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:57:46.627 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:57:46.637 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:46.637 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:46.814 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:46.815 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:47.202 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:47.206 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:47.614 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:57:48.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:57:48.797981+08:00, lastProcessTime=2022-12-08T15:57:38.795926+08:00 2022-12-08 15:57:48.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:57:48.797981+08:00, resultsCount=0 2022-12-08 15:57:48.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:57:48.797981+08:00, resultsCount=0 2022-12-08 15:57:48.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:57:48.797981+08:00 2022-12-08 15:57:50.207 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:50.212 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:50.479 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:57:50.485 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:57:50.939 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:57:51.459 INFO 42 --- [pool-ocp-schedules-12,,6247eeab94e7] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:57:52.082 INFO 42 --- [pool-ocp-schedules-11,,bb3719ccac67] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:57:52.175 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:52.561 INFO 42 --- [pool-ocp-schedules-5,,d219717df717] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:57:53.109 INFO 42 --- [pool-ocp-schedules-17,,8503fc0cb20b] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:57:53.110 INFO 42 --- [pool-ocp-schedules-17,,8503fc0cb20b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:57:53.110 INFO 42 --- [pool-ocp-schedules-17,,8503fc0cb20b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:57:53.213 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:53.218 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:53.440 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:53.441 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:57:53.740 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:57:55.940 INFO 42 --- [pool-ocp-schedules-16,,23ccf025fbc1] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:57:56.218 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:56.223 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:56.690 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:56.691 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:56.691 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:57:56.691 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:57:56.711 INFO 42 --- [pool-ocp-schedules-4,,3c79650351d8] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:57:56.712 INFO 42 --- [pool-ocp-schedules-4,,3c79650351d8] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:57:56.765 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:57:56.769 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:57:57.783 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:57:58.111 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:57:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,bdfffe6ebb50] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:57:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,bdfffe6ebb50] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:57:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:57:58.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:57:58.794433+08:00, lastProcessTime=2022-12-08T15:57:48.797981+08:00 2022-12-08 15:57:59.224 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:57:59.227 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:57:59.239 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:57:58.794433+08:00, resultsCount=0 2022-12-08 15:57:59.240 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:57:58.794433+08:00, resultsCount=0 2022-12-08 15:57:59.240 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:57:58.794433+08:00 2022-12-08 15:58:00.115 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:58:00.148 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:56:01.0, nextRun=2022-12-08 15:58:00.0, currentDate=Thu Dec 08 15:58:00 CST 2022 2022-12-08 15:58:00.149 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:56:01.0, nextRunTime=2022-12-08 15:58:00.0} 2022-12-08 15:58:00.173 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 15:58:00.493 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:58:00.536 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:57:01.0, nextRun=2022-12-08 15:58:00.0, currentDate=Thu Dec 08 15:58:00 CST 2022 2022-12-08 15:58:00.537 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:57:01.0, nextRunTime=2022-12-08 15:58:00.0} 2022-12-08 15:58:00.554 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:58:00.555 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:58:00.555 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:58:00.679 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:57:02.0, nextRun=2022-12-08 15:58:00.0, currentDate=Thu Dec 08 15:58:00 CST 2022 2022-12-08 15:58:00.680 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:57:02.0, nextRunTime=2022-12-08 15:58:00.0} 2022-12-08 15:58:00.707 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:58:00.708 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:58:00.708 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:58:00.971 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:58:01.128 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:57:02.0, nextRun=2022-12-08 15:58:00.0, currentDate=Thu Dec 08 15:58:01 CST 2022 2022-12-08 15:58:01.129 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:57:02.0, nextRunTime=2022-12-08 15:58:00.0} 2022-12-08 15:58:01.153 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:58:01.154 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:58:01.154 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:58:01.251 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 458, operation:EXECUTE, state: RUNNING 2022-12-08 15:58:01.298 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:57:31.0, nextRun=2022-12-08 15:58:00.0, currentDate=Thu Dec 08 15:58:01 CST 2022 2022-12-08 15:58:01.299 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:57:31.0, nextRunTime=2022-12-08 15:58:00.0} 2022-12-08 15:58:01.316 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:58:01.316 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:58:01.316 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:58:01.426 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=458, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:58:01.235+08:00, endTime=null} 2022-12-08 15:58:01.514 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 459, operation:EXECUTE, state: RUNNING 2022-12-08 15:58:01.540 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:57:03.0, nextRun=2022-12-08 15:58:00.0, currentDate=Thu Dec 08 15:58:01 CST 2022 2022-12-08 15:58:01.541 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:57:03.0, nextRunTime=2022-12-08 15:58:00.0} 2022-12-08 15:58:01.560 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:58:01.560 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:58:01.560 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:58:01.888 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=459, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:58:01.500+08:00, endTime=null} 2022-12-08 15:58:02.217 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:02.228 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:02.241 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,bed5daef0499] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486340, interval=60 2022-12-08 15:58:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,bed5daef0499] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486282, count=0, elapsed=1668815796354 2022-12-08 15:58:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,466838edb20a] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486340, interval=60 2022-12-08 15:58:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,466838edb20a] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486282, count=0, elapsed=1668815796358 2022-12-08 15:58:03.017 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 460, operation:EXECUTE, state: RUNNING 2022-12-08 15:58:03.216 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=460, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:58:02.994+08:00, endTime=null} 2022-12-08 15:58:03.276 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 461, operation:EXECUTE, state: RUNNING 2022-12-08 15:58:03.399 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=461, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:58:03.264+08:00, endTime=null} 2022-12-08 15:58:03.416 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:458, status:SUCCESS 2022-12-08 15:58:03.440 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:458, status:SUCCESS 2022-12-08 15:58:03.443 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:03.481 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 462, operation:EXECUTE, state: RUNNING 2022-12-08 15:58:03.504 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:03.579 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=462, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:58:03.468+08:00, endTime=null} 2022-12-08 15:58:03.596 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:459, status:SUCCESS 2022-12-08 15:58:03.602 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:459, status:SUCCESS 2022-12-08 15:58:03.744 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:58:04.983 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:460, status:SUCCESS 2022-12-08 15:58:04.988 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:460, status:SUCCESS 2022-12-08 15:58:05.054 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:57:06.0, nextRun=2022-12-08 15:58:05.0, currentDate=Thu Dec 08 15:58:05 CST 2022 2022-12-08 15:58:05.055 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:57:06.0, nextRunTime=2022-12-08 15:58:05.0} 2022-12-08 15:58:05.072 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:58:05.073 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:58:05.073 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:58:05.093 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:461, status:SUCCESS 2022-12-08 15:58:05.098 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:461, status:SUCCESS 2022-12-08 15:58:05.242 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:05.245 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:05.246 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:462, status:SUCCESS 2022-12-08 15:58:05.251 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:462, status:SUCCESS 2022-12-08 15:58:05.668 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 463, operation:EXECUTE, state: RUNNING 2022-12-08 15:58:05.728 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=463, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:58:05.657+08:00, endTime=null} 2022-12-08 15:58:05.941 INFO 42 --- [pool-ocp-schedules-19,,3b7b57a4e0d7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:58:06.548 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:463, status:SUCCESS 2022-12-08 15:58:06.558 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:463, status:SUCCESS 2022-12-08 15:58:06.582 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:06.583 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:06.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:06.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:07.084 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:58:07.087 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:58:07.907 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:08.246 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:08.252 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:58:08.810 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:58:08.805453+08:00, lastProcessTime=2022-12-08T15:57:58.794433+08:00 2022-12-08 15:58:08.925 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:58:08.805453+08:00, resultsCount=0 2022-12-08 15:58:08.926 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:58:08.805453+08:00, resultsCount=0 2022-12-08 15:58:08.926 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:58:08.805453+08:00 2022-12-08 15:58:09.080 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:58:09.087 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:58:09.528 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:58:09.682 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:09.784 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:10.204 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:58:10.809 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:58:10.890 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:58:11.253 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:11.257 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:11.295 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:58:12.460 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:12.732 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:12.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:12.830 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:12.830 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:13.649 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:58:14.257 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:14.262 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:15.467 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:58:15.476 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:58:15.824 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:15.940 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:15.943 INFO 42 --- [pool-ocp-schedules-13,,2bbc11eea2fc] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:58:16.318 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:58:16.753 INFO 42 --- [pool-ocp-schedules-20,,e016feb15d04] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:58:16.753 INFO 42 --- [pool-ocp-schedules-20,,e016feb15d04] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:58:17.123 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:58:17.160 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:58:17.263 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:17.267 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:17.949 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:58:18.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:58:18.796136+08:00, lastProcessTime=2022-12-08T15:58:08.805453+08:00 2022-12-08 15:58:18.900 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:18.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:18.935 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:58:18.796136+08:00, resultsCount=0 2022-12-08 15:58:18.936 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:58:18.796136+08:00, resultsCount=0 2022-12-08 15:58:18.937 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:58:18.796136+08:00 2022-12-08 15:58:19.313 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:19.313 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:20.268 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:20.272 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:20.700 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:57:21.0, nextRun=2022-12-08 15:58:20.0, currentDate=Thu Dec 08 15:58:20 CST 2022 2022-12-08 15:58:20.700 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:57:21.0, nextRunTime=2022-12-08 15:58:20.0} 2022-12-08 15:58:20.717 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:58:20.718 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:58:20.718 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:58:20.982 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 464, operation:EXECUTE, state: RUNNING 2022-12-08 15:58:21.094 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=464, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:58:20.970+08:00, endTime=null} 2022-12-08 15:58:21.382 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:58:21.514 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:58:21.520 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:58:21.977 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:22.454 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:22.537 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:464, status:SUCCESS 2022-12-08 15:58:22.543 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:464, status:SUCCESS 2022-12-08 15:58:22.620 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:22.805 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:58:23.273 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:23.278 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:25.026 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:57:26.0, nextRun=2022-12-08 15:58:25.0, currentDate=Thu Dec 08 15:58:25 CST 2022 2022-12-08 15:58:25.027 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:57:26.0, nextRunTime=2022-12-08 15:58:25.0} 2022-12-08 15:58:25.079 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:58:25.080 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:58:25.080 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:58:25.273 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:25.273 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:25.530 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:25.531 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:25.944 INFO 42 --- [pool-ocp-schedules-4,,87452856b61e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:58:26.232 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 465, operation:EXECUTE, state: RUNNING 2022-12-08 15:58:26.279 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:26.283 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:26.535 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=465, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:58:26.216+08:00, endTime=null} 2022-12-08 15:58:27.448 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:58:27.454 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:58:27.713 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:465, status:SUCCESS 2022-12-08 15:58:27.720 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:465, status:SUCCESS 2022-12-08 15:58:28.062 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:58:28.069 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:58:28.199 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:28.338 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:28.588 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:28.692 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:58:28.755 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:58:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:58:28.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:58:28.792747+08:00, lastProcessTime=2022-12-08T15:58:18.796136+08:00 2022-12-08 15:58:28.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:58:28.792747+08:00, resultsCount=0 2022-12-08 15:58:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:58:28.792747+08:00, resultsCount=0 2022-12-08 15:58:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:58:28.792747+08:00 2022-12-08 15:58:29.284 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:29.288 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:30.597 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:54:30.359, end=2022-12-08T15:56:30.554} 2022-12-08 15:58:30.629 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 15:58:30.655 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:57:31.0, nextRun=2022-12-08 15:58:30.0, currentDate=Thu Dec 08 15:58:30 CST 2022 2022-12-08 15:58:30.656 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:57:31.0, nextRunTime=2022-12-08 15:58:30.0} 2022-12-08 15:58:30.676 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:58:30.761 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:01.0, nextRun=2022-12-08 15:58:30.0, currentDate=Thu Dec 08 15:58:30 CST 2022 2022-12-08 15:58:30.762 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:58:01.0, nextRunTime=2022-12-08 15:58:30.0} 2022-12-08 15:58:30.778 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:58:30.778 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:58:30.779 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:58:31.402 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:31.403 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:31.429 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:58:31.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:31.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:31.671 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 466, operation:EXECUTE, state: RUNNING 2022-12-08 15:58:31.710 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=466, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:58:31.658+08:00, endTime=null} 2022-12-08 15:58:32.289 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:32.293 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:32.672 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:33.064 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:466, status:SUCCESS 2022-12-08 15:58:33.075 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:466, status:SUCCESS 2022-12-08 15:58:34.401 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:58:34.407 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:58:34.562 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:34.747 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:35.087 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:58:35.293 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:35.297 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:35.945 INFO 42 --- [pool-ocp-schedules-19,,d98fb9946b13] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:58:36.802 INFO 42 --- [pool-ocp-schedules-13,,8ed93ae9bdb3] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:58:36.803 INFO 42 --- [pool-ocp-schedules-13,,8ed93ae9bdb3] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:58:37.516 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:58:37.519 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:58:37.611 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:37.612 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:37.805 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:37.806 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:38.280 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:38.298 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:38.302 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:58:38.801 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:58:38.798950+08:00, lastProcessTime=2022-12-08T15:58:28.792747+08:00 2022-12-08 15:58:38.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:58:38.798950+08:00, resultsCount=0 2022-12-08 15:58:38.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:58:38.798950+08:00, resultsCount=0 2022-12-08 15:58:38.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:58:38.798950+08:00 2022-12-08 15:58:39.629 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:58:40.866 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:58:40.871 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:58:40.890 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:58:41.131 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:41.135 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:58:41.248 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:56:10+08:00, updateTime=2022-12-08T15:58:10+08:00, expireTime=null, isLeader=false} 2022-12-08 15:58:41.257 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:58:41.303 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:41.308 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:41.581 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:58:43.031 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:43.816 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:58:43.841 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:44.199 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:58:44.308 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:44.313 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:44.394 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:44.394 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:45.471 INFO 42 --- [pool-ocp-schedules-11,,8263cebdf9ef] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:58:45.522 INFO 42 --- [pool-ocp-schedules-11,,8263cebdf9ef] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:58:45.700 INFO 42 --- [pool-ocp-schedules-20,,cce5472a0f07] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:58:45.947 INFO 42 --- [pool-ocp-schedules-4,,cdbbd17be7ca] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:58:46.131 INFO 42 --- [pool-ocp-schedules-16,,5bb67247f6cf] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:58:46.985 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:46.986 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:47.314 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:47.318 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:47.566 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:58:47.599 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:58:48.374 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:58:48.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:58:48.797024+08:00, lastProcessTime=2022-12-08T15:58:38.798950+08:00 2022-12-08 15:58:48.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:58:48.797024+08:00, resultsCount=0 2022-12-08 15:58:48.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:58:48.797024+08:00, resultsCount=0 2022-12-08 15:58:48.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:58:48.797024+08:00 2022-12-08 15:58:49.515 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:58:49.522 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:58:50.145 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:50.319 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:50.323 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:50.610 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:51.137 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:58:51.556 INFO 42 --- [pool-ocp-schedules-20,,9f9d7809ccb5] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:58:51.682 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:58:52.187 INFO 42 --- [pool-ocp-schedules-6,,1ec340005a7c] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:58:52.624 INFO 42 --- [pool-ocp-schedules-5,,1267966d9b7d] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:58:53.103 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:53.212 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:53.213 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:53.248 INFO 42 --- [pool-ocp-schedules-16,,aa8839755b65] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:58:53.249 INFO 42 --- [pool-ocp-schedules-16,,aa8839755b65] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:58:53.250 INFO 42 --- [pool-ocp-schedules-16,,aa8839755b65] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:58:53.324 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:53.328 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:53.695 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:58:53.696 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:58:55.948 INFO 42 --- [pool-ocp-schedules-14,,703234fea525] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:58:56.328 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:58:56.329 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:56.333 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:56.334 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:58:56.785 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:56.901 INFO 42 --- [pool-ocp-schedules-19,,f0735da2cc71] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:58:56.902 INFO 42 --- [pool-ocp-schedules-19,,f0735da2cc71] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:58:57.312 INFO 42 --- [http-nio-8080-exec-9,bbdf633b87d24a38,d0a7398a6b35] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=192.168.28.1, traceId=bbdf633b87d24a38, method=OffsetDateTime com.alipay.ocp.server.controller.InfoController.time(), args=] 2022-12-08 15:58:57.313 INFO 42 --- [http-nio-8080-exec-9,bbdf633b87d24a38,d0a7398a6b35] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=192.168.28.1, traceId=bbdf633b87d24a38, duration=6 ms] 2022-12-08 15:58:57.641 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:58:57.678 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:58:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,2aa776c09274] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:58:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,2aa776c09274] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:58:58.668 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:58:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:58:58.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:58:58.795923+08:00, lastProcessTime=2022-12-08T15:58:48.797024+08:00 2022-12-08 15:58:58.965 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:58:58.971 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:58:58.795923+08:00, resultsCount=0 2022-12-08 15:58:58.972 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:58:58.795923+08:00, resultsCount=0 2022-12-08 15:58:58.972 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:58:58.795923+08:00 2022-12-08 15:58:59.334 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:58:59.338 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:58:59.396 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:58:59.984 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:59:00.940 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:01.0, nextRun=2022-12-08 15:59:00.0, currentDate=Thu Dec 08 15:59:00 CST 2022 2022-12-08 15:59:00.940 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:58:01.0, nextRunTime=2022-12-08 15:59:00.0} 2022-12-08 15:59:00.959 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 15:59:00.960 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:59:00.960 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 15:59:01.009 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:01.0, nextRun=2022-12-08 15:59:00.0, currentDate=Thu Dec 08 15:59:01 CST 2022 2022-12-08 15:59:01.010 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:58:01.0, nextRunTime=2022-12-08 15:59:00.0} 2022-12-08 15:59:01.036 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:59:01.036 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:59:01.037 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 15:59:01.095 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:01.0, nextRun=2022-12-08 15:59:00.0, currentDate=Thu Dec 08 15:59:01 CST 2022 2022-12-08 15:59:01.096 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:58:01.0, nextRunTime=2022-12-08 15:59:00.0} 2022-12-08 15:59:01.121 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 15:59:01.122 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:59:01.122 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 15:59:01.171 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:31.0, nextRun=2022-12-08 15:59:00.0, currentDate=Thu Dec 08 15:59:01 CST 2022 2022-12-08 15:59:01.172 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:58:31.0, nextRunTime=2022-12-08 15:59:00.0} 2022-12-08 15:59:01.189 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:59:01.190 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:59:01.190 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:59:01.217 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 467, operation:EXECUTE, state: RUNNING 2022-12-08 15:59:01.277 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:02.0, nextRun=2022-12-08 15:59:00.0, currentDate=Thu Dec 08 15:59:01 CST 2022 2022-12-08 15:59:01.278 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:58:02.0, nextRunTime=2022-12-08 15:59:00.0} 2022-12-08 15:59:01.299 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 15:59:01.300 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:59:01.300 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 15:59:01.303 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=467, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T15:59:01.203+08:00, endTime=null} 2022-12-08 15:59:01.394 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 468, operation:EXECUTE, state: RUNNING 2022-12-08 15:59:01.435 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=468, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T15:59:01.365+08:00, endTime=null} 2022-12-08 15:59:01.754 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:59:02.002 INFO 42 --- [http-nio-8080-exec-2,a8e20947758e41eb,18b6874fd6d5] c.a.o.server.trace.RequestTracingAspect : API: [GET /error?null, client=192.168.28.1, traceId=a8e20947758e41eb, method=ModelAndView com.alipay.ocp.server.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2022-12-08 15:59:02.030 WARN 42 --- [http-nio-8080-exec-2,a8e20947758e41eb,18b6874fd6d5] c.a.o.s.c.web.CustomErrorController : Requested URL not found: [url=/cluster, client=192.168.28.1, traceId=a8e20947758e41eb] 2022-12-08 15:59:02.031 INFO 42 --- [http-nio-8080-exec-2,a8e20947758e41eb,18b6874fd6d5] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /error client=192.168.28.1, traceId=a8e20947758e41eb, duration=34 ms] 2022-12-08 15:59:02.043 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:467, status:SUCCESS 2022-12-08 15:59:02.051 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:467, status:SUCCESS 2022-12-08 15:59:02.206 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:468, status:SUCCESS 2022-12-08 15:59:02.213 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:468, status:SUCCESS 2022-12-08 15:59:02.323 INFO 42 --- [http-nio-8080-exec-3,6b8268adc8c54843,1b01ac9a853b] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=192.168.28.1, traceId=6b8268adc8c54843, method=SuccessResponse com.alipay.ocp.server.controller.PropertyController.getSystemInfo(), args=] 2022-12-08 15:59:02.325 INFO 42 --- [http-nio-8080-exec-3,6b8268adc8c54843,1b01ac9a853b] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=192.168.28.1, traceId=6b8268adc8c54843, duration=4 ms] 2022-12-08 15:59:02.338 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:02.342 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:02.399 INFO 42 --- [http-nio-8080-exec-10,c2b506cf378f4bd6,2aba388b8011] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/maz/state?null, client=192.168.28.1, traceId=c2b506cf378f4bd6, method=SuccessResponse com.alipay.ocp.server.controller.MultiAzoneController.state(), args=] 2022-12-08 15:59:02.399 INFO 42 --- [http-nio-8080-exec-5,74347688b1ad471d,1ce934eb9885] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/mc/info?null, client=192.168.28.1, traceId=74347688b1ad471d, method=SuccessResponse com.alipay.ocp.server.controller.OcpMultiClusterInfoController.info(), args=] 2022-12-08 15:59:02.400 INFO 42 --- [http-nio-8080-exec-5,74347688b1ad471d,1ce934eb9885] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/mc/info client=192.168.28.1, traceId=74347688b1ad471d, duration=3 ms] 2022-12-08 15:59:02.412 INFO 42 --- [http-nio-8080-exec-10,c2b506cf378f4bd6,2aba388b8011] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/maz/state client=192.168.28.1, traceId=c2b506cf378f4bd6, duration=15 ms] 2022-12-08 15:59:02.472 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:02.473 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:02.532 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 469, operation:EXECUTE, state: RUNNING 2022-12-08 15:59:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,b8fb65f0b2a9] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486400, interval=60 2022-12-08 15:59:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,b8fb65f0b2a9] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486342, count=0, elapsed=1668815856294 2022-12-08 15:59:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,d6e55d6ffb6d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486400, interval=60 2022-12-08 15:59:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,d6e55d6ffb6d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486342, count=0, elapsed=1668815856298 2022-12-08 15:59:02.879 INFO 42 --- [http-nio-8080-exec-7,b1df0429b9e3462a,f427729f0194] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=192.168.28.1, traceId=b1df0429b9e3462a, method=SuccessResponse com.alipay.ocp.server.controller.ProfileController.userInfo(), args=] 2022-12-08 15:59:02.880 INFO 42 --- [http-nio-8080-exec-6,28dbf3fe53cc476c,338052e6db9d] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=192.168.28.1, traceId=28dbf3fe53cc476c, method=SuccessResponse com.alipay.ocp.server.controller.PropertyController.getSystemInfo(), args=] 2022-12-08 15:59:02.881 INFO 42 --- [http-nio-8080-exec-6,28dbf3fe53cc476c,338052e6db9d] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=192.168.28.1, traceId=28dbf3fe53cc476c, duration=2 ms] 2022-12-08 15:59:02.889 INFO 42 --- [http-nio-8080-exec-8,8b052f485fef4db0,5c2c32d4c5ca] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=192.168.28.1, traceId=8b052f485fef4db0, method=Map com.alipay.ocp.server.controller.InfoController.info(), args=] 2022-12-08 15:59:02.889 INFO 42 --- [http-nio-8080-exec-8,8b052f485fef4db0,5c2c32d4c5ca] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=192.168.28.1, traceId=8b052f485fef4db0, duration=1 ms] 2022-12-08 15:59:02.893 INFO 42 --- [http-nio-8080-exec-1,1d0ece387f5d498c,0b353d1c8283] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=1d0ece387f5d498c, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 15:59:02.894 INFO 42 --- [http-nio-8080-exec-1,1d0ece387f5d498c,0b353d1c8283] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=1d0ece387f5d498c, duration=2 ms] 2022-12-08 15:59:02.903 INFO 42 --- [http-nio-8080-exec-7,b1df0429b9e3462a,f427729f0194] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=192.168.28.1, traceId=b1df0429b9e3462a, duration=26 ms] 2022-12-08 15:59:03.158 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:03.482 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:03.483 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:03.489 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=469, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T15:59:02.509+08:00, endTime=null} 2022-12-08 15:59:03.760 INFO 42 --- [http-nio-8080-exec-4,f33e0f9b4309482b,3bc2d939714c] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=192.168.28.1, traceId=f33e0f9b4309482b, method=OffsetDateTime com.alipay.ocp.server.controller.InfoController.time(), args=] 2022-12-08 15:59:03.761 INFO 42 --- [http-nio-8080-exec-4,f33e0f9b4309482b,3bc2d939714c] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=192.168.28.1, traceId=f33e0f9b4309482b, duration=2 ms] 2022-12-08 15:59:03.775 INFO 42 --- [http-nio-8080-exec-9,9d417f145deb4184,ff6f2ff8d7f9] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/mc/info?null, client=192.168.28.1, traceId=9d417f145deb4184, method=SuccessResponse com.alipay.ocp.server.controller.OcpMultiClusterInfoController.info(), args=] 2022-12-08 15:59:03.776 INFO 42 --- [http-nio-8080-exec-9,9d417f145deb4184,ff6f2ff8d7f9] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/mc/info client=192.168.28.1, traceId=9d417f145deb4184, duration=2 ms] 2022-12-08 15:59:03.806 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 470, operation:EXECUTE, state: RUNNING 2022-12-08 15:59:03.816 INFO 42 --- [http-nio-8080-exec-2,f1c069f5581c4ddf,9878c40e91ff] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=f1c069f5581c4ddf, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 15:59:03.893 INFO 42 --- [http-nio-8080-exec-2,f1c069f5581c4ddf,9878c40e91ff] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=f1c069f5581c4ddf, duration=81 ms] 2022-12-08 15:59:04.299 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=470, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:59:03.794+08:00, endTime=null} 2022-12-08 15:59:04.370 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 471, operation:EXECUTE, state: RUNNING 2022-12-08 15:59:04.583 INFO 42 --- [http-nio-8080-exec-3,8ec4300393bd4ee3,188207dc06f3] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/maz/state?null, client=192.168.28.1, traceId=8ec4300393bd4ee3, method=SuccessResponse com.alipay.ocp.server.controller.MultiAzoneController.state(), args=] 2022-12-08 15:59:04.585 INFO 42 --- [http-nio-8080-exec-3,8ec4300393bd4ee3,188207dc06f3] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/maz/state client=192.168.28.1, traceId=8ec4300393bd4ee3, duration=3 ms] 2022-12-08 15:59:04.607 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=471, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T15:59:04.358+08:00, endTime=null} 2022-12-08 15:59:04.936 INFO 42 --- [http-nio-8080-exec-5,18adf739acaa42d1,9c8d0443b7be] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=18adf739acaa42d1, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 15:59:05.037 INFO 42 --- [http-nio-8080-exec-5,18adf739acaa42d1,9c8d0443b7be] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=18adf739acaa42d1, duration=104 ms] 2022-12-08 15:59:05.194 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:59:05.206 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:59:05.343 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:05.347 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:05.454 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:05.0, nextRun=2022-12-08 15:59:05.0, currentDate=Thu Dec 08 15:59:05 CST 2022 2022-12-08 15:59:05.455 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:58:05.0, nextRunTime=2022-12-08 15:59:05.0} 2022-12-08 15:59:05.474 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 15:59:05.475 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:59:05.475 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 15:59:05.950 INFO 42 --- [pool-ocp-schedules-7,,d1532480198e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:59:06.034 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 472, operation:EXECUTE, state: RUNNING 2022-12-08 15:59:06.114 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=472, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T15:59:06.022+08:00, endTime=null} 2022-12-08 15:59:06.160 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:469, status:SUCCESS 2022-12-08 15:59:06.168 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:469, status:SUCCESS 2022-12-08 15:59:06.274 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:470, status:SUCCESS 2022-12-08 15:59:06.279 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:470, status:SUCCESS 2022-12-08 15:59:06.371 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:471, status:SUCCESS 2022-12-08 15:59:06.376 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:471, status:SUCCESS 2022-12-08 15:59:06.453 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:472, status:SUCCESS 2022-12-08 15:59:06.459 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:472, status:SUCCESS 2022-12-08 15:59:06.497 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:07.165 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:07.374 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:59:07.851 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:59:07.856 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:59:08.348 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:08.353 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:08.714 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:59:08.807 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:59:08.803978+08:00, lastProcessTime=2022-12-08T15:58:58.795923+08:00 2022-12-08 15:59:08.974 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:59:08.803978+08:00, resultsCount=0 2022-12-08 15:59:08.974 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:59:08.803978+08:00, resultsCount=0 2022-12-08 15:59:08.975 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:59:08.803978+08:00 2022-12-08 15:59:09.565 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:09.565 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:09.878 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:59:10.256 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:10.257 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:11.135 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:59:11.354 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:11.358 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:11.529 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:56:10+08:00, updateTime=2022-12-08T15:58:40+08:00, expireTime=null, isLeader=false} 2022-12-08 15:59:11.537 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 15:59:11.643 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:59:11.785 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:59:12.612 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:59:12.619 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:59:12.801 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:13.362 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:13.736 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:13.930 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:59:14.006 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:59:14.359 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:14.364 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:15.951 INFO 42 --- [pool-ocp-schedules-6,,f0483b69230a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:59:16.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:16.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:16.923 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:16.924 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:16.964 INFO 42 --- [pool-ocp-schedules-12,,f260a404edd7] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:59:16.965 INFO 42 --- [pool-ocp-schedules-12,,f260a404edd7] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:59:17.364 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:17.369 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:17.915 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:59:17.919 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:59:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:59:18.778 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:18.791 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:59:18.789766+08:00, lastProcessTime=2022-12-08T15:59:08.803978+08:00 2022-12-08 15:59:18.917 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:59:18.789766+08:00, resultsCount=0 2022-12-08 15:59:18.918 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:59:18.789766+08:00, resultsCount=0 2022-12-08 15:59:18.918 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:59:18.789766+08:00 2022-12-08 15:59:19.176 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:59:19.183 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:59:20.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:20.370 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:20.374 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:20.848 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:21.0, nextRun=2022-12-08 15:59:20.0, currentDate=Thu Dec 08 15:59:20 CST 2022 2022-12-08 15:59:20.849 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:58:21.0, nextRunTime=2022-12-08 15:59:20.0} 2022-12-08 15:59:20.867 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 15:59:20.868 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:59:20.868 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 15:59:21.372 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 473, operation:EXECUTE, state: RUNNING 2022-12-08 15:59:21.424 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=473, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T15:59:21.358+08:00, endTime=null} 2022-12-08 15:59:21.840 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:59:22.675 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:473, status:SUCCESS 2022-12-08 15:59:22.682 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:473, status:SUCCESS 2022-12-08 15:59:23.375 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:23.380 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:23.954 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:25.952 INFO 42 --- [pool-ocp-schedules-10,,e3e0b948f790] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:59:26.178 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:25.0, nextRun=2022-12-08 15:59:25.0, currentDate=Thu Dec 08 15:59:26 CST 2022 2022-12-08 15:59:26.179 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:58:25.0, nextRunTime=2022-12-08 15:59:25.0} 2022-12-08 15:59:26.226 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 15:59:26.227 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:59:26.227 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 15:59:26.380 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:26.385 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:26.669 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 474, operation:EXECUTE, state: RUNNING 2022-12-08 15:59:26.722 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=474, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T15:59:26.656+08:00, endTime=null} 2022-12-08 15:59:28.030 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:59:28.034 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:59:28.555 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:474, status:SUCCESS 2022-12-08 15:59:28.562 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:474, status:SUCCESS 2022-12-08 15:59:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:59:28.801 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:59:28.799673+08:00, lastProcessTime=2022-12-08T15:59:18.789766+08:00 2022-12-08 15:59:28.875 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:28.918 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:59:28.799673+08:00, resultsCount=0 2022-12-08 15:59:28.918 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:59:28.799673+08:00, resultsCount=0 2022-12-08 15:59:28.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:59:28.799673+08:00 2022-12-08 15:59:29.094 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:59:29.386 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:29.390 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:29.565 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 15:59:31.086 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:31.0, nextRun=2022-12-08 15:59:30.0, currentDate=Thu Dec 08 15:59:31 CST 2022 2022-12-08 15:59:31.087 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:58:31.0, nextRunTime=2022-12-08 15:59:30.0} 2022-12-08 15:59:31.128 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 15:59:31.225 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:59:01.0, nextRun=2022-12-08 15:59:30.0, currentDate=Thu Dec 08 15:59:31 CST 2022 2022-12-08 15:59:31.226 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:59:01.0, nextRunTime=2022-12-08 15:59:30.0} 2022-12-08 15:59:31.277 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 15:59:31.278 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 15:59:31.278 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 15:59:31.845 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 475, operation:EXECUTE, state: RUNNING 2022-12-08 15:59:31.885 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:59:31.900 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=475, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T15:59:31.832+08:00, endTime=null} 2022-12-08 15:59:32.238 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:475, status:SUCCESS 2022-12-08 15:59:32.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:475, status:SUCCESS 2022-12-08 15:59:32.391 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:32.396 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:34.181 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:34.698 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:59:34.704 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:59:35.397 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:35.403 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:35.743 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:35.954 INFO 42 --- [pool-ocp-schedules-15,,59371610fe49] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:59:37.042 INFO 42 --- [pool-ocp-schedules-5,,06129c163d91] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:59:37.042 INFO 42 --- [pool-ocp-schedules-5,,06129c163d91] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:59:37.752 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:37.951 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:59:38.158 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:59:38.165 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:59:38.404 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:38.409 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:59:38.822 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:59:38.819178+08:00, lastProcessTime=2022-12-08T15:59:28.799673+08:00 2022-12-08 15:59:38.863 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:38.864 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:38.908 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:38.957 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:59:38.819178+08:00, resultsCount=0 2022-12-08 15:59:38.958 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:59:38.819178+08:00, resultsCount=0 2022-12-08 15:59:38.958 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:59:38.819178+08:00 2022-12-08 15:59:39.384 INFO 42 --- [http-nio-8080-exec-10,13eeaa67437a472c,377fa3f88465] c.a.o.server.trace.RequestTracingAspect : API: [GET /error?null, client=192.168.28.1, traceId=13eeaa67437a472c, method=ModelAndView com.alipay.ocp.server.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2022-12-08 15:59:39.384 WARN 42 --- [http-nio-8080-exec-10,13eeaa67437a472c,377fa3f88465] c.a.o.s.c.web.CustomErrorController : Requested URL not found: [url=/cluster, client=192.168.28.1, traceId=13eeaa67437a472c] 2022-12-08 15:59:39.385 INFO 42 --- [http-nio-8080-exec-10,13eeaa67437a472c,377fa3f88465] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /error client=192.168.28.1, traceId=13eeaa67437a472c, duration=3 ms] 2022-12-08 15:59:39.554 INFO 42 --- [http-nio-8080-exec-1,ed29a67e8c7c42e2,54299b5b43c1] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=192.168.28.1, traceId=ed29a67e8c7c42e2, method=SuccessResponse com.alipay.ocp.server.controller.PropertyController.getSystemInfo(), args=] 2022-12-08 15:59:39.554 INFO 42 --- [http-nio-8080-exec-1,ed29a67e8c7c42e2,54299b5b43c1] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=192.168.28.1, traceId=ed29a67e8c7c42e2, duration=1 ms] 2022-12-08 15:59:39.641 INFO 42 --- [http-nio-8080-exec-2,b091c1134e8149b9,16b04044443b] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/maz/state?null, client=192.168.28.1, traceId=b091c1134e8149b9, method=SuccessResponse com.alipay.ocp.server.controller.MultiAzoneController.state(), args=] 2022-12-08 15:59:39.643 INFO 42 --- [http-nio-8080-exec-6,3380695c58fa4413,48bd2f55d98f] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/mc/info?null, client=192.168.28.1, traceId=3380695c58fa4413, method=SuccessResponse com.alipay.ocp.server.controller.OcpMultiClusterInfoController.info(), args=] 2022-12-08 15:59:39.644 INFO 42 --- [http-nio-8080-exec-6,3380695c58fa4413,48bd2f55d98f] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/mc/info client=192.168.28.1, traceId=3380695c58fa4413, duration=2 ms] 2022-12-08 15:59:39.645 INFO 42 --- [http-nio-8080-exec-2,b091c1134e8149b9,16b04044443b] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/maz/state client=192.168.28.1, traceId=b091c1134e8149b9, duration=5 ms] 2022-12-08 15:59:39.765 INFO 42 --- [http-nio-8080-exec-9,48e3033445b8404a,f7764915b7e7] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=192.168.28.1, traceId=48e3033445b8404a, method=SuccessResponse com.alipay.ocp.server.controller.PropertyController.getSystemInfo(), args=] 2022-12-08 15:59:39.766 INFO 42 --- [http-nio-8080-exec-9,48e3033445b8404a,f7764915b7e7] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=192.168.28.1, traceId=48e3033445b8404a, duration=2 ms] 2022-12-08 15:59:39.766 INFO 42 --- [http-nio-8080-exec-4,47ca0866c785473e,0f6945510a17] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=47ca0866c785473e, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 15:59:39.767 INFO 42 --- [http-nio-8080-exec-7,410faa9761f94659,0aab2c7884f1] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=192.168.28.1, traceId=410faa9761f94659, method=Map com.alipay.ocp.server.controller.InfoController.info(), args=] 2022-12-08 15:59:39.772 INFO 42 --- [http-nio-8080-exec-7,410faa9761f94659,0aab2c7884f1] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=192.168.28.1, traceId=410faa9761f94659, duration=6 ms] 2022-12-08 15:59:39.774 INFO 42 --- [http-nio-8080-exec-8,730e7777b97f43e4,3e91a29f551b] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=192.168.28.1, traceId=730e7777b97f43e4, method=SuccessResponse com.alipay.ocp.server.controller.ProfileController.userInfo(), args=] 2022-12-08 15:59:39.776 INFO 42 --- [http-nio-8080-exec-4,47ca0866c785473e,0f6945510a17] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=47ca0866c785473e, duration=11 ms] 2022-12-08 15:59:39.815 INFO 42 --- [http-nio-8080-exec-8,730e7777b97f43e4,3e91a29f551b] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=192.168.28.1, traceId=730e7777b97f43e4, duration=42 ms] 2022-12-08 15:59:39.818 INFO 42 --- [http-nio-8080-exec-3,7aec69e44837444c,14a1d7618c6e] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/mc/info?null, client=192.168.28.1, traceId=7aec69e44837444c, method=SuccessResponse com.alipay.ocp.server.controller.OcpMultiClusterInfoController.info(), args=] 2022-12-08 15:59:39.819 INFO 42 --- [http-nio-8080-exec-3,7aec69e44837444c,14a1d7618c6e] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/mc/info client=192.168.28.1, traceId=7aec69e44837444c, duration=2 ms] 2022-12-08 15:59:39.852 INFO 42 --- [http-nio-8080-exec-5,e5d0dfa27e2e4c1d,71fdadb91241] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=192.168.28.1, traceId=e5d0dfa27e2e4c1d, method=OffsetDateTime com.alipay.ocp.server.controller.InfoController.time(), args=] 2022-12-08 15:59:39.852 INFO 42 --- [http-nio-8080-exec-5,e5d0dfa27e2e4c1d,71fdadb91241] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=192.168.28.1, traceId=e5d0dfa27e2e4c1d, duration=2 ms] 2022-12-08 15:59:39.957 INFO 42 --- [http-nio-8080-exec-10,57e6fa1342434cb3,9e865514500d] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/maz/state?null, client=192.168.28.1, traceId=57e6fa1342434cb3, method=SuccessResponse com.alipay.ocp.server.controller.MultiAzoneController.state(), args=] 2022-12-08 15:59:39.958 INFO 42 --- [http-nio-8080-exec-10,57e6fa1342434cb3,9e865514500d] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/maz/state client=192.168.28.1, traceId=57e6fa1342434cb3, duration=2 ms] 2022-12-08 15:59:40.052 INFO 42 --- [http-nio-8080-exec-1,1a2079e838cc4763,60da6e0cc966] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=1a2079e838cc4763, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 15:59:40.076 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:59:40.118 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:57:09+08:00, updateTime=2022-12-08T15:59:09+08:00, expireTime=null, isLeader=false} 2022-12-08 15:59:40.130 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 15:59:40.141 INFO 42 --- [http-nio-8080-exec-1,1a2079e838cc4763,60da6e0cc966] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=1a2079e838cc4763, duration=93 ms] 2022-12-08 15:59:40.191 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 15:59:40.221 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=30ms, period=120000ms 2022-12-08 15:59:40.284 INFO 42 --- [http-nio-8080-exec-6,9186d603b1bd44a4,cb6a13e9ed47] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=9186d603b1bd44a4, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 15:59:40.334 INFO 42 --- [http-nio-8080-exec-6,9186d603b1bd44a4,cb6a13e9ed47] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=9186d603b1bd44a4, duration=52 ms] 2022-12-08 15:59:40.950 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:40.950 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:41.410 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:41.418 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:41.643 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 15:59:41.723 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 15:59:41.923 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:59:43.868 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:59:43.873 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:59:44.154 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:59:44.221 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:44.295 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:44.418 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:44.423 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:45.055 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:45.488 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:59:45.491 INFO 42 --- [pool-ocp-schedules-15,,497b2a2ab55a] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 15:59:45.537 INFO 42 --- [pool-ocp-schedules-15,,497b2a2ab55a] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 15:59:45.702 INFO 42 --- [pool-ocp-schedules-10,,46443839daf8] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 15:59:45.748 INFO 42 --- [pool-ocp-schedules-5,,8420adff504b] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:59:45.749 INFO 42 --- [pool-ocp-schedules-5,,8420adff504b] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:59:45.955 INFO 42 --- [pool-ocp-schedules-8,,571dd2b5d6a4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:59:46.136 INFO 42 --- [pool-ocp-schedules-17,,d58f69cdd983] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 15:59:47.346 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:47.346 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:47.424 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:47.437 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:48.122 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:48.123 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:48.185 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:59:48.223 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:59:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:59:48.839 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:59:48.836083+08:00, lastProcessTime=2022-12-08T15:59:38.819178+08:00 2022-12-08 15:59:48.952 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:59:48.836083+08:00, resultsCount=0 2022-12-08 15:59:48.952 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:59:48.836083+08:00, resultsCount=0 2022-12-08 15:59:48.953 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:59:48.836083+08:00 2022-12-08 15:59:49.245 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:50.438 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:50.443 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:50.757 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:59:50.763 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:59:51.295 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:51.614 INFO 42 --- [pool-ocp-schedules-12,,2b0aad9ae44a] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 15:59:51.972 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 15:59:52.256 INFO 42 --- [pool-ocp-schedules-16,,3ebb1dc6256b] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 15:59:52.785 INFO 42 --- [pool-ocp-schedules-2,,e5cf0b9b9e41] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 15:59:53.360 INFO 42 --- [pool-ocp-schedules-7,,24a56b53d93d] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 15:59:53.361 INFO 42 --- [pool-ocp-schedules-7,,24a56b53d93d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:59:53.361 INFO 42 --- [pool-ocp-schedules-7,,24a56b53d93d] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 15:59:53.445 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:53.450 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:53.692 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 15:59:53.895 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 15:59:54.252 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 15:59:54.441 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:54.442 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:55.956 INFO 42 --- [pool-ocp-schedules-2,,2d222db43b41] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 15:59:56.451 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:56.457 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:56.796 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 15:59:56.797 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 15:59:57.134 INFO 42 --- [pool-ocp-schedules-9,,46929599a329] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:59:57.136 INFO 42 --- [pool-ocp-schedules-9,,46929599a329] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 15:59:58.279 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 15:59:58.304 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 15:59:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,b79eb7ac960d] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 15:59:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,b79eb7ac960d] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 15:59:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 15:59:58.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T15:59:58.794114+08:00, lastProcessTime=2022-12-08T15:59:48.836083+08:00 2022-12-08 15:59:58.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T15:59:58.794114+08:00, resultsCount=0 2022-12-08 15:59:58.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T15:59:58.794114+08:00, resultsCount=0 2022-12-08 15:59:58.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T15:59:58.794114+08:00 2022-12-08 15:59:59.123 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 15:59:59.129 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 15:59:59.197 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 15:59:59.458 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 15:59:59.463 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 15:59:59.559 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:00.000 INFO 42 --- [pool-ocp-schedules-9,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 16:00:00.117 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:00.577 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:00.608 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:01.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:00 CST 2022 2022-12-08 16:00:00.609 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=12, name=Refresh agent config, templateName=RefreshAgentConfigSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 15:50:01.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:00.630 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Refresh agent config, nodeCount=1, taskCount=1 2022-12-08 16:00:00.630 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:00.631 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Refresh agent config, taskDefinitionId=12, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:00.730 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:58:00.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:00 CST 2022 2022-12-08 16:00:00.731 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 15:58:00.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:00.755 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:00:00.806 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:50:01.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:00 CST 2022 2022-12-08 16:00:00.806 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=15, name=Sync system event, templateName=SyncSystemEventSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 15:50:01.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:00.832 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync system event 2022-12-08 16:00:00.923 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:01.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:00 CST 2022 2022-12-08 16:00:00.924 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 15:55:01.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:00.945 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 16:00:00.946 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:00.946 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:00.947 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:00:00.993 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:01.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:00 CST 2022 2022-12-08 16:00:00.994 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:55:01.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:01.033 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 16:00:01.034 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 16:00:01.360 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:59:01.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:01 CST 2022 2022-12-08 16:00:01.361 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 476, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:01.361 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:59:01.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:01.391 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:00:01.392 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:01.392 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:01.460 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=476, name=Refresh all agent config, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.RefreshAllAgentConfigTask, seriesId=0, startTime=2022-12-08T16:00:01.347+08:00, endTime=null} 2022-12-08 16:00:01.505 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:59:01.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:01 CST 2022 2022-12-08 16:00:01.505 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:59:01.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:01.525 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 477, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:01.533 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:00:01.534 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:01.534 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:01.599 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=477, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T16:00:01.512+08:00, endTime=null} 2022-12-08 16:00:01.614 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:59:01.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:01 CST 2022 2022-12-08 16:00:01.615 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:59:01.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:01.652 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:00:01.653 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:01.653 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:01.754 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:59:31.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:01 CST 2022 2022-12-08 16:00:01.755 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 15:59:31.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:01.771 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:00:01.772 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:01.772 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:01.856 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:55:03.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:01 CST 2022 2022-12-08 16:00:01.857 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 15:55:03.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:01.880 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 16:00:01.882 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:01.883 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:01.999 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:59:01.0, nextRun=2022-12-08 16:00:00.0, currentDate=Thu Dec 08 16:00:01 CST 2022 2022-12-08 16:00:02.000 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 15:59:01.0, nextRunTime=2022-12-08 16:00:00.0} 2022-12-08 16:00:02.022 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:00:02.023 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:02.023 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:02.030 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:00:02.464 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:02.468 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:02.634 INFO 42 --- [pool-prometheus-minute-schedule-1,,127e3b8ebad2] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486460, interval=60 2022-12-08 16:00:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,127e3b8ebad2] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486402, count=0, elapsed=1668815916233 2022-12-08 16:00:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,ef286f290444] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486460, interval=60 2022-12-08 16:00:02.641 INFO 42 --- [pool-prometheus-minute-schedule-2,,ef286f290444] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486402, count=0, elapsed=1668815916239 2022-12-08 16:00:02.676 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 480, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:02.935 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=480, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:00:02.664+08:00, endTime=null} 2022-12-08 16:00:03.045 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 481, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:03.160 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=481, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:00:03.022+08:00, endTime=null} 2022-12-08 16:00:03.173 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:476, status:SUCCESS 2022-12-08 16:00:03.179 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:476, status:SUCCESS 2022-12-08 16:00:03.240 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 482, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:03.294 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:477, status:SUCCESS 2022-12-08 16:00:03.300 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:477, status:SUCCESS 2022-12-08 16:00:03.325 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=482, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T16:00:03.227+08:00, endTime=null} 2022-12-08 16:00:03.400 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 483, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:03.438 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:03.438 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:03.473 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=483, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:00:03.384+08:00, endTime=null} 2022-12-08 16:00:03.501 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:480, status:SUCCESS 2022-12-08 16:00:03.506 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:480, status:SUCCESS 2022-12-08 16:00:03.533 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 478, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:03.570 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=478, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:00:03.523+08:00, endTime=null} 2022-12-08 16:00:03.624 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:481, status:SUCCESS 2022-12-08 16:00:03.630 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:481, status:SUCCESS 2022-12-08 16:00:03.641 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:03.680 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:03.650 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 479, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:03.737 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:482, status:SUCCESS 2022-12-08 16:00:03.743 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:482, status:SUCCESS 2022-12-08 16:00:03.765 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=479, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:00:03.632+08:00, endTime=null} 2022-12-08 16:00:04.505 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:05.469 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:05.473 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:05.491 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:478, status:SUCCESS 2022-12-08 16:00:05.497 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:478, status:SUCCESS 2022-12-08 16:00:05.513 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:59:05.0, nextRun=2022-12-08 16:00:05.0, currentDate=Thu Dec 08 16:00:05 CST 2022 2022-12-08 16:00:05.514 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 15:59:05.0, nextRunTime=2022-12-08 16:00:05.0} 2022-12-08 16:00:05.529 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:00:05.530 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:05.530 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:05.635 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:479, status:SUCCESS 2022-12-08 16:00:05.641 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:479, status:SUCCESS 2022-12-08 16:00:05.722 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:483, status:SUCCESS 2022-12-08 16:00:05.729 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:483, status:SUCCESS 2022-12-08 16:00:05.891 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 484, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:05.923 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=484, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:00:05.840+08:00, endTime=null} 2022-12-08 16:00:05.957 INFO 42 --- [pool-ocp-schedules-1,,a73d4e50b7bf] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:00:06.198 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:00:06.209 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:00:06.497 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:06.770 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:06.859 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:00:07.031 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:484, status:SUCCESS 2022-12-08 16:00:07.036 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:484, status:SUCCESS 2022-12-08 16:00:08.474 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:08.478 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:08.622 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:00:08.624 INFO 42 --- [pool-ocp-schedules-9,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 16:00:08.668 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:00:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:00:08.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:00:08.794544+08:00, lastProcessTime=2022-12-08T15:59:58.794114+08:00 2022-12-08 16:00:08.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:00:08.794544+08:00, resultsCount=0 2022-12-08 16:00:08.898 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:00:08.794544+08:00, resultsCount=0 2022-12-08 16:00:08.898 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:00:08.794544+08:00 2022-12-08 16:00:09.050 INFO 42 --- [pool-ocp-schedules-9,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 16:00:09.164 INFO 42 --- [pool-ocp-schedules-9,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 16:00:09.437 INFO 42 --- [pool-ocp-schedules-9,,] o.s.boot.SpringApplication : Started application in 9.368 seconds (JVM running for 2406.283) 2022-12-08 16:00:09.727 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:09.740 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:09.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:09.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:09.861 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:10.163 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:00:11.036 INFO 42 --- [pool-ocp-schedules-9,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T16:00:11.036+08:00 2022-12-08 16:00:11.479 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:11.484 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:11.723 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:00:12.066 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:00:12.179 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:00:12.185 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:00:12.228 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:58:41+08:00, updateTime=2022-12-08T15:59:41+08:00, expireTime=null, isLeader=false} 2022-12-08 16:00:12.236 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:00:12.393 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:00:12.819 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:12.898 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:13.343 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:00:14.390 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:00:14.484 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:14.489 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:14.532 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:15.869 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:15.870 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:15.959 INFO 42 --- [pool-ocp-schedules-19,,24cc8eaca1fe] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:00:15.972 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:15.973 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:17.212 INFO 42 --- [pool-ocp-schedules-8,,8257d6675bca] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:00:17.213 INFO 42 --- [pool-ocp-schedules-8,,8257d6675bca] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:00:17.490 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:17.494 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:18.538 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:00:18.544 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:00:18.748 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:00:18.753 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:00:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:00:18.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:00:18.794029+08:00, lastProcessTime=2022-12-08T16:00:08.794544+08:00 2022-12-08 16:00:18.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:00:18.794029+08:00, resultsCount=0 2022-12-08 16:00:18.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:00:18.794029+08:00, resultsCount=0 2022-12-08 16:00:18.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:00:18.794029+08:00 2022-12-08 16:00:18.975 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:19.035 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:19.136 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:00:19.949 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:20.495 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:20.500 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:21.217 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:59:21.0, nextRun=2022-12-08 16:00:20.0, currentDate=Thu Dec 08 16:00:21 CST 2022 2022-12-08 16:00:21.218 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 15:59:21.0, nextRunTime=2022-12-08 16:00:20.0} 2022-12-08 16:00:21.235 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:00:21.236 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:21.236 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:22.042 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:22.043 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:22.130 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:22.130 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:22.339 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 485, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:22.406 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=485, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:00:22.310+08:00, endTime=null} 2022-12-08 16:00:22.481 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:00:23.206 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:485, status:SUCCESS 2022-12-08 16:00:23.215 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:485, status:SUCCESS 2022-12-08 16:00:23.500 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:23.507 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:24.311 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:00:24.317 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:00:24.593 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:25.105 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:25.172 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:25.413 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:00:25.710 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:59:26.0, nextRun=2022-12-08 16:00:25.0, currentDate=Thu Dec 08 16:00:25 CST 2022 2022-12-08 16:00:25.710 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 15:59:26.0, nextRunTime=2022-12-08 16:00:25.0} 2022-12-08 16:00:25.754 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:00:25.755 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:25.755 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:25.960 INFO 42 --- [pool-ocp-schedules-5,,6643deaee500] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:00:26.508 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:26.512 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:26.543 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 486, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:26.609 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=486, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:00:26.526+08:00, endTime=null} 2022-12-08 16:00:27.929 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:486, status:SUCCESS 2022-12-08 16:00:27.936 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:486, status:SUCCESS 2022-12-08 16:00:28.178 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:28.178 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:28.223 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:28.224 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:00:28.801 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:00:28.809 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:00:28.807596+08:00, lastProcessTime=2022-12-08T16:00:18.794029+08:00 2022-12-08 16:00:28.832 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:00:28.917 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:00:28.807596+08:00, resultsCount=0 2022-12-08 16:00:28.918 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:00:28.807596+08:00, resultsCount=0 2022-12-08 16:00:28.918 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:00:28.807596+08:00 2022-12-08 16:00:29.497 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:00:29.513 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:29.518 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:30.014 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:59:31.0, nextRun=2022-12-08 16:00:30.0, currentDate=Thu Dec 08 16:00:30 CST 2022 2022-12-08 16:00:30.014 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 15:59:31.0, nextRunTime=2022-12-08 16:00:30.0} 2022-12-08 16:00:30.042 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:00:30.062 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:30.120 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:02.0, nextRun=2022-12-08 16:00:30.0, currentDate=Thu Dec 08 16:00:30 CST 2022 2022-12-08 16:00:30.121 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:00:02.0, nextRunTime=2022-12-08 16:00:30.0} 2022-12-08 16:00:30.153 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:00:30.154 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:00:30.154 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:00:30.733 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 487, operation:EXECUTE, state: RUNNING 2022-12-08 16:00:30.760 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:00:30.769 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:00:30.794 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:56:30.554, end=2022-12-08T15:58:30.721} 2022-12-08 16:00:30.820 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:00:30.867 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=487, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:00:30.718+08:00, endTime=null} 2022-12-08 16:00:31.548 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:31.548 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:31.900 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:00:32.110 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:487, status:SUCCESS 2022-12-08 16:00:32.118 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:487, status:SUCCESS 2022-12-08 16:00:32.518 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:32.523 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:32.528 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:00:34.615 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:34.616 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:34.619 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:34.619 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:34.634 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:35.523 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:35.528 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:35.961 INFO 42 --- [pool-ocp-schedules-6,,91e496671a2a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:00:37.112 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:00:37.117 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:00:37.296 INFO 42 --- [pool-ocp-schedules-13,,6db66fe52622] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:00:37.297 INFO 42 --- [pool-ocp-schedules-13,,6db66fe52622] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:00:37.667 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:37.705 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:37.824 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:00:38.529 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:38.534 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:00:38.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:00:38.792913+08:00, lastProcessTime=2022-12-08T16:00:28.807596+08:00 2022-12-08 16:00:38.856 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:00:38.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:00:38.792913+08:00, resultsCount=0 2022-12-08 16:00:38.888 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:00:38.792913+08:00, resultsCount=0 2022-12-08 16:00:38.888 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:00:38.792913+08:00 2022-12-08 16:00:38.927 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:00:40.100 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:40.216 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:00:40.767 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:40.767 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:40.790 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:40.790 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:41.535 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:41.538 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:42.066 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:00:42.136 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:59:11+08:00, updateTime=2022-12-08T16:00:11+08:00, expireTime=null, isLeader=false} 2022-12-08 16:00:42.143 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 16:00:42.393 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:00:42.620 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:00:43.027 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:00:43.034 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:00:43.861 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:43.899 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:44.293 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:00:44.539 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:44.544 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:44.552 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:00:44.684 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:45.471 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 16:00:45.480 INFO 42 --- [pool-ocp-schedules-4,,e3147c07e9cc] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:00:45.516 INFO 42 --- [pool-ocp-schedules-4,,e3147c07e9cc] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:00:45.703 INFO 42 --- [pool-ocp-schedules-12,,2575c2471844] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:00:45.962 INFO 42 --- [pool-ocp-schedules-1,,a0820e3f7cc5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:00:45.990 INFO 42 --- [pool-ocp-schedules-11,,5108390d3736] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 16:00:46.141 INFO 42 --- [pool-ocp-schedules-9,,7f703e566c2c] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:00:47.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:47.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:47.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:47.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:47.545 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:47.550 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:00:48.788 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:00:48.787012+08:00, lastProcessTime=2022-12-08T16:00:38.792913+08:00 2022-12-08 16:00:48.873 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:00:48.787012+08:00, resultsCount=0 2022-12-08 16:00:48.873 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:00:48.787012+08:00, resultsCount=0 2022-12-08 16:00:48.874 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:00:48.787012+08:00 2022-12-08 16:00:49.149 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:00:49.153 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:00:49.509 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:00:49.514 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:00:50.216 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:50.424 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:50.424 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:50.551 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:50.557 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:50.599 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:00:51.686 INFO 42 --- [pool-ocp-schedules-17,,1a0308143994] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:00:52.312 INFO 42 --- [pool-ocp-schedules-6,,c98099289f67] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:00:52.683 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:00:52.836 INFO 42 --- [pool-ocp-schedules-5,,8a152590f037] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:00:53.483 INFO 42 --- [pool-ocp-schedules-7,,5575d1ffb6cd] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:00:53.484 INFO 42 --- [pool-ocp-schedules-7,,5575d1ffb6cd] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:00:53.485 INFO 42 --- [pool-ocp-schedules-7,,5575d1ffb6cd] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:00:53.509 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:53.509 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:53.510 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:53.510 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:53.558 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:53.565 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:54.725 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:00:55.817 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:00:55.822 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:00:55.963 INFO 42 --- [pool-ocp-schedules-20,,f716ade2c632] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:00:56.566 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:56.570 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:56.579 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:56.579 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:00:56.637 INFO 42 --- [pool-prometheus-hour-schedule-2,,6c579357ccc7] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670490000, interval=3600 2022-12-08 16:00:56.638 INFO 42 --- [pool-prometheus-hour-schedule-2,,6c579357ccc7] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486456, count=0, elapsed=1668815970182 2022-12-08 16:00:56.645 INFO 42 --- [pool-prometheus-hour-schedule-1,,72da10484c5d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670490000, interval=3600 2022-12-08 16:00:56.646 INFO 42 --- [pool-prometheus-hour-schedule-1,,72da10484c5d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486456, count=0, elapsed=1668815970190 2022-12-08 16:00:56.908 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:00:57.360 INFO 42 --- [pool-ocp-schedules-18,,4f1493a17145] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:00:57.361 INFO 42 --- [pool-ocp-schedules-18,,4f1493a17145] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:00:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,450830590bda] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:00:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,450830590bda] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:00:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:00:58.813 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:00:58.807899+08:00, lastProcessTime=2022-12-08T16:00:48.787012+08:00 2022-12-08 16:00:58.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:00:58.807899+08:00, resultsCount=0 2022-12-08 16:00:58.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:00:58.807899+08:00, resultsCount=0 2022-12-08 16:00:58.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:00:58.807899+08:00 2022-12-08 16:00:59.214 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:00:59.217 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:00:59.571 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:00:59.590 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:00:59.598 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:00:59.660 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:59.660 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:00:59.673 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:00:59.673 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:00.269 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:00.704 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2022-12-08 16:01:00.0, currentDate=Thu Dec 08 16:01:00 CST 2022 2022-12-08 16:01:00.704 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=8, name=Collect cluster snapshot, templateName=CollectClusterSnapshotSchedule, scheduleRule=0 1 * * * *, lastRunTime=null, nextRunTime=2022-12-08 16:01:00.0} 2022-12-08 16:01:00.757 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Collect cluster snapshot 2022-12-08 16:01:00.865 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:01.0, nextRun=2022-12-08 16:01:00.0, currentDate=Thu Dec 08 16:01:00 CST 2022 2022-12-08 16:01:00.870 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:00:01.0, nextRunTime=2022-12-08 16:01:00.0} 2022-12-08 16:01:00.903 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:01:00.904 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:01:00.904 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:01:01.130 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:02.0, nextRun=2022-12-08 16:01:00.0, currentDate=Thu Dec 08 16:01:01 CST 2022 2022-12-08 16:01:01.130 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:00:02.0, nextRunTime=2022-12-08 16:01:00.0} 2022-12-08 16:01:01.160 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:01:01.161 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:01:01.161 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:01:01.277 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:02.0, nextRun=2022-12-08 16:01:00.0, currentDate=Thu Dec 08 16:01:01 CST 2022 2022-12-08 16:01:01.278 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:00:02.0, nextRunTime=2022-12-08 16:01:00.0} 2022-12-08 16:01:01.324 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:01:01.325 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:01:01.325 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:01:01.372 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 488, operation:EXECUTE, state: RUNNING 2022-12-08 16:01:01.412 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:30.0, nextRun=2022-12-08 16:01:00.0, currentDate=Thu Dec 08 16:01:01 CST 2022 2022-12-08 16:01:01.413 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:00:30.0, nextRunTime=2022-12-08 16:01:00.0} 2022-12-08 16:01:01.417 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=488, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:01:01.359+08:00, endTime=null} 2022-12-08 16:01:01.434 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:01:01.435 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:01:01.435 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:01:01.514 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 489, operation:EXECUTE, state: RUNNING 2022-12-08 16:01:01.527 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:02.0, nextRun=2022-12-08 16:01:00.0, currentDate=Thu Dec 08 16:01:01 CST 2022 2022-12-08 16:01:01.527 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:00:02.0, nextRunTime=2022-12-08 16:01:00.0} 2022-12-08 16:01:01.547 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:01:01.548 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:01:01.548 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:01:01.843 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=489, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:01:01.497+08:00, endTime=null} 2022-12-08 16:01:02.548 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:01:02.554 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:01:02.591 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:02.595 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,e22b4719d91a] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486520, interval=60 2022-12-08 16:01:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,e22b4719d91a] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486462, count=0, elapsed=1668815976174 2022-12-08 16:01:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,062e5378dc8e] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486520, interval=60 2022-12-08 16:01:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,062e5378dc8e] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486462, count=0, elapsed=1668815976178 2022-12-08 16:01:02.707 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:01:03.245 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:03.247 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:03.314 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 490, operation:EXECUTE, state: RUNNING 2022-12-08 16:01:03.787 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:01:03.791 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=490, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:01:03.299+08:00, endTime=null} 2022-12-08 16:01:03.804 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:488, status:SUCCESS 2022-12-08 16:01:03.810 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:488, status:SUCCESS 2022-12-08 16:01:03.858 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 491, operation:EXECUTE, state: RUNNING 2022-12-08 16:01:03.945 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=491, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:01:03.844+08:00, endTime=null} 2022-12-08 16:01:03.956 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:489, status:SUCCESS 2022-12-08 16:01:03.962 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:489, status:SUCCESS 2022-12-08 16:01:04.008 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 492, operation:EXECUTE, state: RUNNING 2022-12-08 16:01:04.155 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=492, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:01:03.998+08:00, endTime=null} 2022-12-08 16:01:05.049 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:05.128 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:06.0, nextRun=2022-12-08 16:01:05.0, currentDate=Thu Dec 08 16:01:05 CST 2022 2022-12-08 16:01:05.129 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:00:06.0, nextRunTime=2022-12-08 16:01:05.0} 2022-12-08 16:01:05.144 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:01:05.145 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:01:05.145 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:01:05.593 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:490, status:SUCCESS 2022-12-08 16:01:05.596 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:05.599 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:490, status:SUCCESS 2022-12-08 16:01:05.600 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:05.689 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:491, status:SUCCESS 2022-12-08 16:01:05.697 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:491, status:SUCCESS 2022-12-08 16:01:05.795 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:492, status:SUCCESS 2022-12-08 16:01:05.807 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:492, status:SUCCESS 2022-12-08 16:01:05.964 INFO 42 --- [pool-ocp-schedules-18,,0b43ea078299] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:01:06.270 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 493, operation:EXECUTE, state: RUNNING 2022-12-08 16:01:06.310 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=493, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:01:06.249+08:00, endTime=null} 2022-12-08 16:01:06.728 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:06.728 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:06.728 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:06.729 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:07.353 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:493, status:SUCCESS 2022-12-08 16:01:07.361 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:493, status:SUCCESS 2022-12-08 16:01:08.600 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:08.605 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:01:08.808 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:01:08.806349+08:00, lastProcessTime=2022-12-08T16:00:58.807899+08:00 2022-12-08 16:01:08.933 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:01:08.806349+08:00, resultsCount=0 2022-12-08 16:01:08.934 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:01:08.806349+08:00, resultsCount=0 2022-12-08 16:01:08.934 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:01:08.806349+08:00 2022-12-08 16:01:09.101 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:01:09.110 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:01:09.249 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:01:09.298 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:01:09.931 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:09.931 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:10.279 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:01:10.286 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:01:10.567 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:11.605 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:11.610 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:12.200 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:01:12.540 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:01:13.249 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:01:13.284 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:13.284 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:13.284 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:13.284 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:14.611 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:14.615 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:14.631 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:01:15.101 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:15.480 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:01:15.490 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:01:15.511 INFO 42 --- [http-nio-8080-exec-5,062e95a29ca54e5f,48d9a72063f2] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=127.0.0.1, traceId=062e95a29ca54e5f, method=OffsetDateTime com.alipay.ocp.server.controller.InfoController.time(), args=] 2022-12-08 16:01:15.511 INFO 42 --- [http-nio-8080-exec-5,062e95a29ca54e5f,48d9a72063f2] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=127.0.0.1, traceId=062e95a29ca54e5f, duration=3 ms] 2022-12-08 16:01:15.965 INFO 42 --- [pool-ocp-schedules-20,,bca5daa6fc42] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:01:16.389 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:16.395 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:16.662 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:01:17.433 INFO 42 --- [pool-ocp-schedules-5,,f3a6e2c562bb] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:01:17.433 INFO 42 --- [pool-ocp-schedules-5,,f3a6e2c562bb] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:01:17.615 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:17.620 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:01:18.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:01:18.797087+08:00, lastProcessTime=2022-12-08T16:01:08.806349+08:00 2022-12-08 16:01:18.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:01:18.797087+08:00, resultsCount=0 2022-12-08 16:01:18.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:01:18.797087+08:00, resultsCount=0 2022-12-08 16:01:18.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:01:18.797087+08:00 2022-12-08 16:01:19.323 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:01:19.374 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:01:19.654 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:19.655 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:19.660 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:19.661 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:20.104 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:21.0, nextRun=2022-12-08 16:01:20.0, currentDate=Thu Dec 08 16:01:20 CST 2022 2022-12-08 16:01:20.105 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:00:21.0, nextRunTime=2022-12-08 16:01:20.0} 2022-12-08 16:01:20.127 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:01:20.128 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:01:20.128 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:01:20.556 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 494, operation:EXECUTE, state: RUNNING 2022-12-08 16:01:20.620 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:20.624 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:20.659 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=494, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:01:20.542+08:00, endTime=null} 2022-12-08 16:01:20.661 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:21.940 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:01:21.945 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:01:22.006 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:494, status:SUCCESS 2022-12-08 16:01:22.012 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:494, status:SUCCESS 2022-12-08 16:01:22.359 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T15:55:22.063, end=2022-12-08T16:00:22.299} 2022-12-08 16:01:22.359 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T15:55:22.064, end=2022-12-08T16:00:22.295} 2022-12-08 16:01:22.373 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 16:01:22.373 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 16:01:23.013 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:23.068 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:23.284 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:01:23.526 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:01:23.625 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:23.629 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:25.146 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:25.620 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:26.0, nextRun=2022-12-08 16:01:25.0, currentDate=Thu Dec 08 16:01:25 CST 2022 2022-12-08 16:01:25.621 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:00:26.0, nextRunTime=2022-12-08 16:01:25.0} 2022-12-08 16:01:25.664 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:01:25.664 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:01:25.665 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:01:25.966 INFO 42 --- [pool-ocp-schedules-17,,394251554ba9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:01:26.151 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:26.151 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:26.356 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:26.356 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:26.630 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:26.635 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:26.789 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 495, operation:EXECUTE, state: RUNNING 2022-12-08 16:01:26.829 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=495, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:01:26.776+08:00, endTime=null} 2022-12-08 16:01:28.367 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:495, status:SUCCESS 2022-12-08 16:01:28.373 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:495, status:SUCCESS 2022-12-08 16:01:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:01:28.778 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:01:28.784 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:01:28.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:01:28.800844+08:00, lastProcessTime=2022-12-08T16:01:18.797087+08:00 2022-12-08 16:01:28.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:01:28.800844+08:00, resultsCount=0 2022-12-08 16:01:28.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:01:28.800844+08:00, resultsCount=0 2022-12-08 16:01:28.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:01:28.800844+08:00 2022-12-08 16:01:29.195 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:29.412 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:01:29.450 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:29.459 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:01:29.635 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:29.639 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:29.696 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:01:29.865 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:01:30.693 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:31.163 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:30.0, nextRun=2022-12-08 16:01:30.0, currentDate=Thu Dec 08 16:01:31 CST 2022 2022-12-08 16:01:31.164 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:00:30.0, nextRunTime=2022-12-08 16:01:30.0} 2022-12-08 16:01:31.183 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:01:31.250 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:01:01.0, nextRun=2022-12-08 16:01:30.0, currentDate=Thu Dec 08 16:01:31 CST 2022 2022-12-08 16:01:31.251 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:01:01.0, nextRunTime=2022-12-08 16:01:30.0} 2022-12-08 16:01:31.266 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:01:31.266 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:01:31.266 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:01:31.963 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 496, operation:EXECUTE, state: RUNNING 2022-12-08 16:01:32.007 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=496, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:01:31.947+08:00, endTime=null} 2022-12-08 16:01:32.302 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:32.303 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:32.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:32.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:32.640 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:32.648 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:33.415 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:496, status:SUCCESS 2022-12-08 16:01:33.419 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:01:33.427 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:496, status:SUCCESS 2022-12-08 16:01:35.160 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:01:35.177 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:35.178 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:01:35.426 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:35.649 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:35.659 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:35.719 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:35.967 INFO 42 --- [pool-ocp-schedules-10,,b0f882791fef] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:01:35.987 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:01:37.793 INFO 42 --- [pool-ocp-schedules-12,,cce271320897] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:01:37.793 INFO 42 --- [pool-ocp-schedules-12,,cce271320897] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:01:38.500 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:38.500 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:38.660 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:38.664 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:01:38.791 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:01:38.790026+08:00, lastProcessTime=2022-12-08T16:01:28.800844+08:00 2022-12-08 16:01:38.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:01:38.790026+08:00, resultsCount=0 2022-12-08 16:01:38.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:01:38.790026+08:00, resultsCount=0 2022-12-08 16:01:38.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:01:38.790026+08:00 2022-12-08 16:01:38.982 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:38.982 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:39.466 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:01:39.559 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:01:40.288 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:01:40.301 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=13ms, period=120000ms 2022-12-08 16:01:40.336 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:01:40.766 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:41.154 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:01:41.159 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:01:41.590 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:41.665 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:41.669 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:42.072 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:42.540 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:01:42.574 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:01:42.681 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:01:43.450 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:01:44.669 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:44.674 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:44.931 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:01:45.077 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:45.078 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:45.225 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:45.257 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:45.257 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:45.470 INFO 42 --- [pool-ocp-schedules-17,,1be81fdf7057] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:01:45.496 INFO 42 --- [pool-ocp-schedules-17,,1be81fdf7057] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:01:45.705 INFO 42 --- [pool-ocp-schedules-11,,8255e0806f2d] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:01:45.750 INFO 42 --- [pool-ocp-schedules-2,,62ac5a785f21] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:01:45.751 INFO 42 --- [pool-ocp-schedules-2,,62ac5a785f21] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:01:45.968 INFO 42 --- [pool-ocp-schedules-9,,836d614a2b70] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:01:46.156 INFO 42 --- [pool-ocp-schedules-8,,9553e0344ef3] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:01:47.674 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:47.684 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:47.801 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:01:47.808 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:01:48.628 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:48.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:01:48.790 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:01:48.788356+08:00, lastProcessTime=2022-12-08T16:01:38.790026+08:00 2022-12-08 16:01:48.874 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:01:48.788356+08:00, resultsCount=0 2022-12-08 16:01:48.874 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:01:48.788356+08:00, resultsCount=0 2022-12-08 16:01:48.874 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:01:48.788356+08:00 2022-12-08 16:01:48.932 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:01:49.498 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:01:49.695 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:01:50.685 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:50.689 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:50.830 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:51.697 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:51.697 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:51.698 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:51.699 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:51.820 INFO 42 --- [pool-ocp-schedules-9,,3ae54a692701] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:01:52.415 INFO 42 --- [pool-ocp-schedules-17,,1ad9b3a8af11] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:01:52.930 INFO 42 --- [pool-ocp-schedules-5,,31c6fa74ca3e] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:01:53.483 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:01:53.689 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:53.696 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:53.899 INFO 42 --- [pool-ocp-schedules-1,,ecaa400c9e4b] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:01:53.899 INFO 42 --- [pool-ocp-schedules-1,,ecaa400c9e4b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:01:53.899 INFO 42 --- [pool-ocp-schedules-1,,ecaa400c9e4b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:01:54.253 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:01:54.261 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:01:54.828 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:54.830 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:01:55.349 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:01:55.618 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:01:55.970 INFO 42 --- [pool-ocp-schedules-1,,5b9ad8a9c22d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:01:56.696 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:56.701 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:57.898 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:57.898 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:57.898 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:01:57.899 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:01:58.027 INFO 42 --- [pool-ocp-schedules-13,,5b7ed9b1d1a7] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:01:58.028 INFO 42 --- [pool-ocp-schedules-13,,5b7ed9b1d1a7] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:01:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,8ecc253fc446] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:01:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,8ecc253fc446] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:01:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:01:58.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:01:58.797389+08:00, lastProcessTime=2022-12-08T16:01:48.788356+08:00 2022-12-08 16:01:58.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:01:58.797389+08:00, resultsCount=0 2022-12-08 16:01:58.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:01:58.797389+08:00, resultsCount=0 2022-12-08 16:01:58.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:01:58.797389+08:00 2022-12-08 16:01:59.523 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:01:59.702 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:01:59.707 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:01:59.719 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:01:59.986 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:02:00.574 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:02:00.580 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:02:00.888 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:01.041 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:01.043 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:01.386 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:02:01.602 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:01.0, nextRun=2022-12-08 16:02:00.0, currentDate=Thu Dec 08 16:02:01 CST 2022 2022-12-08 16:02:01.603 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:00:01.0, nextRunTime=2022-12-08 16:02:00.0} 2022-12-08 16:02:01.631 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:02:01.720 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:01:01.0, nextRun=2022-12-08 16:02:00.0, currentDate=Thu Dec 08 16:02:01 CST 2022 2022-12-08 16:02:01.721 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:01:01.0, nextRunTime=2022-12-08 16:02:00.0} 2022-12-08 16:02:01.740 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:02:01.741 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:02:01.742 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:02:01.809 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:01:01.0, nextRun=2022-12-08 16:02:00.0, currentDate=Thu Dec 08 16:02:01 CST 2022 2022-12-08 16:02:01.810 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:01:01.0, nextRunTime=2022-12-08 16:02:00.0} 2022-12-08 16:02:01.833 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:02:01.834 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:02:01.834 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:02:01.938 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:01:01.0, nextRun=2022-12-08 16:02:00.0, currentDate=Thu Dec 08 16:02:01 CST 2022 2022-12-08 16:02:01.939 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:01:01.0, nextRunTime=2022-12-08 16:02:00.0} 2022-12-08 16:02:01.962 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:02:01.962 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:02:01.962 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:02:02.037 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:01:31.0, nextRun=2022-12-08 16:02:00.0, currentDate=Thu Dec 08 16:02:02 CST 2022 2022-12-08 16:02:02.037 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:01:31.0, nextRunTime=2022-12-08 16:02:00.0} 2022-12-08 16:02:02.054 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:02:02.055 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:02:02.055 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:02:02.158 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:01:02.0, nextRun=2022-12-08 16:02:00.0, currentDate=Thu Dec 08 16:02:02 CST 2022 2022-12-08 16:02:02.159 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:01:02.0, nextRunTime=2022-12-08 16:02:00.0} 2022-12-08 16:02:02.180 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:02:02.180 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:02:02.181 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:02:02.459 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 497, operation:EXECUTE, state: RUNNING 2022-12-08 16:02:02.581 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=497, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:02:02.443+08:00, endTime=null} 2022-12-08 16:02:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,74278381d61f] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486580, interval=60 2022-12-08 16:02:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,74278381d61f] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486522, count=0, elapsed=1668816036114 2022-12-08 16:02:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,74e4b4dd817c] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486580, interval=60 2022-12-08 16:02:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,74e4b4dd817c] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486522, count=0, elapsed=1668816036118 2022-12-08 16:02:02.661 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 498, operation:EXECUTE, state: RUNNING 2022-12-08 16:02:02.708 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:02.712 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:02.768 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=498, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:02:02.643+08:00, endTime=null} 2022-12-08 16:02:02.836 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 499, operation:EXECUTE, state: RUNNING 2022-12-08 16:02:02.904 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=499, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:02:02.824+08:00, endTime=null} 2022-12-08 16:02:02.979 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 500, operation:EXECUTE, state: RUNNING 2022-12-08 16:02:03.072 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=500, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:02:02.964+08:00, endTime=null} 2022-12-08 16:02:03.155 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 501, operation:EXECUTE, state: RUNNING 2022-12-08 16:02:03.346 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=501, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:02:03.136+08:00, endTime=null} 2022-12-08 16:02:03.540 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:02:04.104 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:04.105 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:04.380 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:04.380 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:04.543 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:497, status:SUCCESS 2022-12-08 16:02:04.548 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:497, status:SUCCESS 2022-12-08 16:02:04.708 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:498, status:SUCCESS 2022-12-08 16:02:04.718 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:498, status:SUCCESS 2022-12-08 16:02:04.843 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:499, status:SUCCESS 2022-12-08 16:02:04.849 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:499, status:SUCCESS 2022-12-08 16:02:04.939 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:500, status:SUCCESS 2022-12-08 16:02:04.944 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:500, status:SUCCESS 2022-12-08 16:02:05.034 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:501, status:SUCCESS 2022-12-08 16:02:05.040 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:501, status:SUCCESS 2022-12-08 16:02:05.124 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:01:05.0, nextRun=2022-12-08 16:02:05.0, currentDate=Thu Dec 08 16:02:05 CST 2022 2022-12-08 16:02:05.125 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:01:05.0, nextRunTime=2022-12-08 16:02:05.0} 2022-12-08 16:02:05.141 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:02:05.142 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:02:05.142 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:02:05.448 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 502, operation:EXECUTE, state: RUNNING 2022-12-08 16:02:05.486 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=502, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:02:05.428+08:00, endTime=null} 2022-12-08 16:02:05.667 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:05.713 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:05.717 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:05.971 INFO 42 --- [pool-ocp-schedules-1,,e4aa4f3c83e6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:02:06.669 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:502, status:SUCCESS 2022-12-08 16:02:06.680 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:502, status:SUCCESS 2022-12-08 16:02:06.700 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:02:06.710 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:02:07.461 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:07.538 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:07.876 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:02:08.717 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:08.722 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:02:08.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:02:08.799063+08:00, lastProcessTime=2022-12-08T16:01:58.797389+08:00 2022-12-08 16:02:08.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:02:08.799063+08:00, resultsCount=0 2022-12-08 16:02:08.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:02:08.799063+08:00, resultsCount=0 2022-12-08 16:02:08.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:02:08.799063+08:00 2022-12-08 16:02:09.708 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:02:10.060 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:02:10.585 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:10.585 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:10.601 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:02:10.676 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:10.677 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:11.140 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:11.723 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:11.727 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:12.583 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:02:12.846 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:02:13.058 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:02:13.064 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:02:13.802 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:02:14.165 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:14.168 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:14.696 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:02:14.727 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:14.732 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:15.369 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:02:15.712 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:15.972 INFO 42 --- [pool-ocp-schedules-5,,6e27671e9ac9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:02:17.685 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:17.685 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:17.686 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:17.686 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:17.733 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:17.737 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:18.179 INFO 42 --- [pool-ocp-schedules-4,,57651e62d6df] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:02:18.180 INFO 42 --- [pool-ocp-schedules-4,,57651e62d6df] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:02:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:02:18.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:02:18.795303+08:00, lastProcessTime=2022-12-08T16:02:08.799063+08:00 2022-12-08 16:02:18.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:02:18.795303+08:00, resultsCount=0 2022-12-08 16:02:18.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:02:18.795303+08:00, resultsCount=0 2022-12-08 16:02:18.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:02:18.795303+08:00 2022-12-08 16:02:20.093 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:02:20.124 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:02:20.738 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:20.741 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:20.934 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:02:20.940 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:02:21.048 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:01:20.0, nextRun=2022-12-08 16:02:20.0, currentDate=Thu Dec 08 16:02:21 CST 2022 2022-12-08 16:02:21.048 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:01:20.0, nextRunTime=2022-12-08 16:02:20.0} 2022-12-08 16:02:21.071 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:21.071 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:21.078 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:02:21.079 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:02:21.079 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:02:21.269 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:21.596 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:02:21.739 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 503, operation:EXECUTE, state: RUNNING 2022-12-08 16:02:21.780 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=503, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:02:21.727+08:00, endTime=null} 2022-12-08 16:02:22.691 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:503, status:SUCCESS 2022-12-08 16:02:22.697 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:503, status:SUCCESS 2022-12-08 16:02:23.742 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:23.747 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:23.902 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:02:24.175 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:24.175 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:24.176 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:24.177 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:25.973 INFO 42 --- [pool-ocp-schedules-20,,a7d63d0976f9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:02:26.068 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:26.748 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:26.752 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:26.777 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:01:26.0, nextRun=2022-12-08 16:02:25.0, currentDate=Thu Dec 08 16:02:26 CST 2022 2022-12-08 16:02:26.778 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:01:26.0, nextRunTime=2022-12-08 16:02:25.0} 2022-12-08 16:02:26.815 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:02:26.816 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:02:26.816 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:02:27.253 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:02:27.259 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:02:27.374 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:27.376 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:27.887 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:02:27.930 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 504, operation:EXECUTE, state: RUNNING 2022-12-08 16:02:28.007 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=504, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:02:27.916+08:00, endTime=null} 2022-12-08 16:02:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:02:28.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:02:28.800042+08:00, lastProcessTime=2022-12-08T16:02:18.795303+08:00 2022-12-08 16:02:28.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:02:28.800042+08:00, resultsCount=0 2022-12-08 16:02:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:02:28.800042+08:00, resultsCount=0 2022-12-08 16:02:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:02:28.800042+08:00 2022-12-08 16:02:29.074 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:504, status:SUCCESS 2022-12-08 16:02:29.080 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:504, status:SUCCESS 2022-12-08 16:02:29.753 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:29.757 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:30.139 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:01:31.0, nextRun=2022-12-08 16:02:30.0, currentDate=Thu Dec 08 16:02:30 CST 2022 2022-12-08 16:02:30.140 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:01:31.0, nextRunTime=2022-12-08 16:02:30.0} 2022-12-08 16:02:30.163 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:02:30.324 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:02.0, nextRun=2022-12-08 16:02:30.0, currentDate=Thu Dec 08 16:02:30 CST 2022 2022-12-08 16:02:30.324 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:02:02.0, nextRunTime=2022-12-08 16:02:30.0} 2022-12-08 16:02:30.340 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:02:30.341 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:02:30.341 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:02:30.430 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:30.430 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:30.430 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:30.431 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:30.689 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:02:30.892 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:02:30.896 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:02:31.096 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T15:58:30.721, end=2022-12-08T16:00:30.988} 2022-12-08 16:02:31.101 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 505, operation:EXECUTE, state: RUNNING 2022-12-08 16:02:31.114 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:02:31.183 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=505, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:02:31.090+08:00, endTime=null} 2022-12-08 16:02:31.297 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:32.757 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:32.762 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:32.835 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:505, status:SUCCESS 2022-12-08 16:02:32.842 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:505, status:SUCCESS 2022-12-08 16:02:33.250 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:02:33.257 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:02:33.618 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:33.621 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:33.963 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:02:34.362 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:02:35.762 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:35.769 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:35.974 INFO 42 --- [pool-ocp-schedules-7,,8f16c9a2097e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:02:36.715 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:36.719 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:36.719 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:36.720 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:36.721 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:38.253 INFO 42 --- [pool-ocp-schedules-4,,0bb414a8fb4c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:02:38.254 INFO 42 --- [pool-ocp-schedules-4,,0bb414a8fb4c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:02:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:02:38.770 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:38.773 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:38.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:02:38.795575+08:00, lastProcessTime=2022-12-08T16:02:28.800042+08:00 2022-12-08 16:02:38.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:02:38.795575+08:00, resultsCount=0 2022-12-08 16:02:38.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:02:38.795575+08:00, resultsCount=0 2022-12-08 16:02:38.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:02:38.795575+08:00 2022-12-08 16:02:39.151 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:02:39.160 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:02:39.823 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:39.823 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:40.262 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:02:40.987 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:02:40.991 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:02:41.140 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:02:41.214 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T15:59:40+08:00, updateTime=2022-12-08T16:02:10+08:00, expireTime=null, isLeader=false} 2022-12-08 16:02:41.220 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:02:41.465 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:41.723 INFO 42 --- [http-nio-8080-exec-10,c75895d055b749b4,f334b9dff529] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=192.168.28.1, traceId=c75895d055b749b4, method=OffsetDateTime com.alipay.ocp.server.controller.InfoController.time(), args=] 2022-12-08 16:02:41.723 INFO 42 --- [http-nio-8080-exec-10,c75895d055b749b4,f334b9dff529] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=192.168.28.1, traceId=c75895d055b749b4, duration=2 ms] 2022-12-08 16:02:41.774 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:41.780 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:42.846 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:02:42.962 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:02:43.164 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:43.164 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:43.164 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:43.165 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:44.419 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:02:44.781 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:44.786 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:45.472 INFO 42 --- [pool-ocp-schedules-3,,713a03f119c6] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:02:45.499 INFO 42 --- [pool-ocp-schedules-3,,713a03f119c6] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:02:45.645 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:02:45.651 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:02:45.706 INFO 42 --- [pool-ocp-schedules-5,,57363ca5ecea] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:02:45.756 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:02:45.975 INFO 42 --- [pool-ocp-schedules-6,,0f13f94d5838] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:02:46.166 INFO 42 --- [pool-ocp-schedules-20,,ebbc6be94b5f] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:02:46.262 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:46.264 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:46.777 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:46.810 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:02:47.787 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:47.792 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:02:48.791 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:02:48.789593+08:00, lastProcessTime=2022-12-08T16:02:38.795575+08:00 2022-12-08 16:02:48.921 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:02:48.789593+08:00, resultsCount=0 2022-12-08 16:02:48.921 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:02:48.789593+08:00, resultsCount=0 2022-12-08 16:02:48.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:02:48.789593+08:00 2022-12-08 16:02:49.433 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:49.433 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:49.434 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:49.434 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:50.793 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:50.797 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:51.100 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:02:51.106 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:02:51.515 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:52.179 INFO 42 --- [pool-ocp-schedules-11,,e53d30a490ef] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:02:52.366 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:02:52.371 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:02:52.565 INFO 42 --- [pool-ocp-schedules-9,,36374629fe7e] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:02:52.656 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:52.657 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:52.990 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:02:52.999 INFO 42 --- [pool-ocp-schedules-6,,8d73241783b7] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:02:53.798 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:53.803 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:54.084 INFO 42 --- [pool-ocp-schedules-16,,87b377c19674] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:02:54.085 INFO 42 --- [pool-ocp-schedules-16,,87b377c19674] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:02:54.085 INFO 42 --- [pool-ocp-schedules-16,,87b377c19674] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:02:54.598 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:02:55.787 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:55.787 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:02:55.788 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:55.788 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:02:55.976 INFO 42 --- [pool-ocp-schedules-8,,807bc71c127f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:02:56.804 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:56.810 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:02:56.984 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:02:58.202 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:02:58.209 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:02:58.515 INFO 42 --- [pool-ocp-schedules-10,,968a575f51d2] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:02:58.516 INFO 42 --- [pool-ocp-schedules-10,,968a575f51d2] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:02:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,3572df06cc02] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:02:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,3572df06cc02] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:02:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:02:58.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:02:58.794145+08:00, lastProcessTime=2022-12-08T16:02:48.789593+08:00 2022-12-08 16:02:58.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:02:58.794145+08:00, resultsCount=0 2022-12-08 16:02:58.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:02:58.794145+08:00, resultsCount=0 2022-12-08 16:02:58.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:02:58.794145+08:00 2022-12-08 16:02:58.945 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:58.945 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:02:59.312 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:02:59.811 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:02:59.816 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:00.001 INFO 42 --- [pool-ocp-schedules-13,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 16:03:00.523 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:02.0, nextRun=2022-12-08 16:03:00.0, currentDate=Thu Dec 08 16:03:00 CST 2022 2022-12-08 16:03:00.524 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:02:02.0, nextRunTime=2022-12-08 16:03:00.0} 2022-12-08 16:03:00.541 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:03:00.542 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:03:00.542 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:03:00.644 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:02.0, nextRun=2022-12-08 16:03:00.0, currentDate=Thu Dec 08 16:03:00 CST 2022 2022-12-08 16:03:00.645 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:02:02.0, nextRunTime=2022-12-08 16:03:00.0} 2022-12-08 16:03:00.682 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:03:00.682 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:03:00.682 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:03:00.785 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:02.0, nextRun=2022-12-08 16:03:00.0, currentDate=Thu Dec 08 16:03:00 CST 2022 2022-12-08 16:03:00.787 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:02:02.0, nextRunTime=2022-12-08 16:03:00.0} 2022-12-08 16:03:00.815 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:03:00.816 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:03:00.816 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:03:00.825 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:03:00.895 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:30.0, nextRun=2022-12-08 16:03:00.0, currentDate=Thu Dec 08 16:03:00 CST 2022 2022-12-08 16:03:00.895 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:02:30.0, nextRunTime=2022-12-08 16:03:00.0} 2022-12-08 16:03:00.916 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:03:00.917 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:03:00.917 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:03:01.017 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:02.0, nextRun=2022-12-08 16:03:00.0, currentDate=Thu Dec 08 16:03:01 CST 2022 2022-12-08 16:03:01.018 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:02:02.0, nextRunTime=2022-12-08 16:03:00.0} 2022-12-08 16:03:01.037 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:03:01.037 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:03:01.037 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:03:01.213 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:03:01.217 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:03:01.664 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 506, operation:EXECUTE, state: RUNNING 2022-12-08 16:03:01.674 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:01.812 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=506, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:03:01.648+08:00, endTime=null} 2022-12-08 16:03:01.882 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 507, operation:EXECUTE, state: RUNNING 2022-12-08 16:03:02.061 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:02.062 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:02.064 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:02.065 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:02.095 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=507, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:03:01.869+08:00, endTime=null} 2022-12-08 16:03:02.175 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 508, operation:EXECUTE, state: RUNNING 2022-12-08 16:03:02.510 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=508, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:03:02.159+08:00, endTime=null} 2022-12-08 16:03:02.575 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 509, operation:EXECUTE, state: RUNNING 2022-12-08 16:03:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,1bacbc412fec] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486640, interval=60 2022-12-08 16:03:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,1bacbc412fec] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486582, count=0, elapsed=1668816096054 2022-12-08 16:03:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,703ad591802d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486640, interval=60 2022-12-08 16:03:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,703ad591802d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486582, count=0, elapsed=1668816096058 2022-12-08 16:03:02.825 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:02.830 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:03.130 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=509, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:03:02.564+08:00, endTime=null} 2022-12-08 16:03:03.390 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 510, operation:EXECUTE, state: RUNNING 2022-12-08 16:03:03.488 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=510, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:03:03.375+08:00, endTime=null} 2022-12-08 16:03:03.500 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:506, status:SUCCESS 2022-12-08 16:03:03.506 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:506, status:SUCCESS 2022-12-08 16:03:03.716 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:507, status:SUCCESS 2022-12-08 16:03:03.721 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:507, status:SUCCESS 2022-12-08 16:03:04.229 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:508, status:SUCCESS 2022-12-08 16:03:04.235 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:508, status:SUCCESS 2022-12-08 16:03:04.342 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:509, status:SUCCESS 2022-12-08 16:03:04.350 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:509, status:SUCCESS 2022-12-08 16:03:04.562 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:03:04.567 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:03:04.593 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:510, status:SUCCESS 2022-12-08 16:03:04.599 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:510, status:SUCCESS 2022-12-08 16:03:04.638 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:03:05.219 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:05.222 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:05.676 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:03:05.831 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:05.834 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:05.845 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:05.0, nextRun=2022-12-08 16:03:05.0, currentDate=Thu Dec 08 16:03:05 CST 2022 2022-12-08 16:03:05.846 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:02:05.0, nextRunTime=2022-12-08 16:03:05.0} 2022-12-08 16:03:05.867 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:03:05.868 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:03:05.868 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:03:05.977 INFO 42 --- [pool-ocp-schedules-3,,df7542df1ab0] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:03:06.612 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 511, operation:EXECUTE, state: RUNNING 2022-12-08 16:03:06.658 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=511, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:03:06.580+08:00, endTime=null} 2022-12-08 16:03:07.025 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:08.000 INFO 42 --- [pool-ocp-schedules-13,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 16:03:08.389 INFO 42 --- [pool-ocp-schedules-13,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 16:03:08.400 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:511, status:SUCCESS 2022-12-08 16:03:08.407 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:511, status:SUCCESS 2022-12-08 16:03:08.493 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:08.493 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:08.497 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:08.508 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:08.518 INFO 42 --- [pool-ocp-schedules-13,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 16:03:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:03:08.791 INFO 42 --- [pool-ocp-schedules-13,,] o.s.boot.SpringApplication : Started application in 8.719 seconds (JVM running for 2585.637) 2022-12-08 16:03:08.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:03:08.794061+08:00, lastProcessTime=2022-12-08T16:02:58.794145+08:00 2022-12-08 16:03:08.836 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:08.842 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:08.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:03:08.794061+08:00, resultsCount=0 2022-12-08 16:03:08.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:03:08.794061+08:00, resultsCount=0 2022-12-08 16:03:08.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:03:08.794061+08:00 2022-12-08 16:03:10.287 INFO 42 --- [pool-ocp-schedules-13,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T16:03:10.287+08:00 2022-12-08 16:03:11.018 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:03:11.024 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:03:11.423 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:03:11.428 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:03:11.472 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:03:11.810 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:11.843 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:11.848 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:11.855 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:11.855 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:12.233 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:03:12.962 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:03:13.121 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:03:13.218 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:00:12+08:00, updateTime=2022-12-08T16:02:42+08:00, expireTime=null, isLeader=false} 2022-12-08 16:03:13.228 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:03:14.696 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:03:14.848 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:14.853 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:15.228 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:15.228 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:15.229 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:15.230 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:15.861 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:03:15.978 INFO 42 --- [pool-ocp-schedules-15,,24559908db40] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:03:17.100 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:17.846 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:03:17.853 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:03:17.854 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:17.860 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:18.294 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:18.295 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:18.625 INFO 42 --- [pool-ocp-schedules-8,,3239185cdb37] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:03:18.626 INFO 42 --- [pool-ocp-schedules-8,,3239185cdb37] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:03:18.653 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:03:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:03:18.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:03:18.791698+08:00, lastProcessTime=2022-12-08T16:03:08.794061+08:00 2022-12-08 16:03:18.882 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:03:18.791698+08:00, resultsCount=0 2022-12-08 16:03:18.882 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:03:18.791698+08:00, resultsCount=0 2022-12-08 16:03:18.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:03:18.791698+08:00 2022-12-08 16:03:20.856 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:21.0, nextRun=2022-12-08 16:03:20.0, currentDate=Thu Dec 08 16:03:20 CST 2022 2022-12-08 16:03:20.857 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:02:21.0, nextRunTime=2022-12-08 16:03:20.0} 2022-12-08 16:03:20.861 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:20.865 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:20.875 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:03:20.876 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:03:20.876 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:03:21.402 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:21.402 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:21.403 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:21.403 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:21.472 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:03:21.482 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:03:21.850 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:21.939 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 512, operation:EXECUTE, state: RUNNING 2022-12-08 16:03:21.982 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=512, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:03:21.901+08:00, endTime=null} 2022-12-08 16:03:23.098 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:512, status:SUCCESS 2022-12-08 16:03:23.105 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:512, status:SUCCESS 2022-12-08 16:03:23.866 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:23.869 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:23.902 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:03:23.910 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:03:24.652 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:24.654 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:24.748 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:03:25.107 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:27.0, nextRun=2022-12-08 16:03:25.0, currentDate=Thu Dec 08 16:03:25 CST 2022 2022-12-08 16:03:25.108 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:02:27.0, nextRunTime=2022-12-08 16:03:25.0} 2022-12-08 16:03:25.137 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:03:25.164 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:03:25.164 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:03:25.164 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:03:25.979 INFO 42 --- [pool-ocp-schedules-11,,c8d744cb473b] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:03:26.099 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 513, operation:EXECUTE, state: RUNNING 2022-12-08 16:03:26.277 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=513, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:03:26.086+08:00, endTime=null} 2022-12-08 16:03:26.870 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:26.875 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:27.005 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:513, status:SUCCESS 2022-12-08 16:03:27.012 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:513, status:SUCCESS 2022-12-08 16:03:27.204 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:27.917 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:27.917 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:27.918 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:27.919 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:03:28.790 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:03:28.788962+08:00, lastProcessTime=2022-12-08T16:03:18.791698+08:00 2022-12-08 16:03:28.870 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:03:28.788962+08:00, resultsCount=0 2022-12-08 16:03:28.871 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:03:28.788962+08:00, resultsCount=0 2022-12-08 16:03:28.871 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:03:28.788962+08:00 2022-12-08 16:03:29.875 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:29.880 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:30.351 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:03:30.357 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:03:30.972 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:03:31.037 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:31.037 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:31.105 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:30.0, nextRun=2022-12-08 16:03:30.0, currentDate=Thu Dec 08 16:03:31 CST 2022 2022-12-08 16:03:31.106 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:02:30.0, nextRunTime=2022-12-08 16:03:30.0} 2022-12-08 16:03:31.129 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:03:31.195 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:03:31.316 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:03:01.0, nextRun=2022-12-08 16:03:30.0, currentDate=Thu Dec 08 16:03:31 CST 2022 2022-12-08 16:03:31.317 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:03:01.0, nextRunTime=2022-12-08 16:03:30.0} 2022-12-08 16:03:31.331 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:03:31.332 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:03:31.332 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:03:31.638 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:03:31.642 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:03:31.912 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:32.436 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 514, operation:EXECUTE, state: RUNNING 2022-12-08 16:03:32.505 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=514, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:03:32.424+08:00, endTime=null} 2022-12-08 16:03:32.880 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:32.886 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:33.517 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:514, status:SUCCESS 2022-12-08 16:03:33.523 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:514, status:SUCCESS 2022-12-08 16:03:34.163 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:34.163 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:34.163 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:34.163 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:35.034 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:03:35.887 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:35.891 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:35.980 INFO 42 --- [pool-ocp-schedules-14,,c61b1afe44d3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:03:36.718 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:03:36.729 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:03:37.252 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:37.396 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:37.397 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:37.578 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:03:38.693 INFO 42 --- [pool-ocp-schedules-19,,382f3676f5b9] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:03:38.694 INFO 42 --- [pool-ocp-schedules-19,,382f3676f5b9] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:03:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:03:38.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:03:38.796817+08:00, lastProcessTime=2022-12-08T16:03:28.788962+08:00 2022-12-08 16:03:38.892 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:38.896 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:38.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:03:38.796817+08:00, resultsCount=0 2022-12-08 16:03:38.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:03:38.796817+08:00, resultsCount=0 2022-12-08 16:03:38.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:03:38.796817+08:00 2022-12-08 16:03:40.303 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:03:40.317 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=14ms, period=120000ms 2022-12-08 16:03:40.462 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:40.463 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:40.575 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:40.576 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:41.527 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:03:41.710 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:03:41.714 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:03:41.897 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:41.908 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:42.137 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:43.121 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:03:43.192 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:03:43.198 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:03:43.233 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:00:42+08:00, updateTime=2022-12-08T16:03:12+08:00, expireTime=null, isLeader=false} 2022-12-08 16:03:43.239 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 16:03:43.479 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:03:43.573 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:43.916 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:44.319 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:03:44.909 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:44.918 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:45.068 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:03:45.471 INFO 42 --- [pool-ocp-schedules-19,,1f7a44109f67] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:03:45.514 INFO 42 --- [pool-ocp-schedules-19,,1f7a44109f67] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:03:45.708 INFO 42 --- [pool-ocp-schedules-6,,9f49e1491294] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:03:45.752 INFO 42 --- [pool-ocp-schedules-12,,d94af1fb5804] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:03:45.753 INFO 42 --- [pool-ocp-schedules-12,,d94af1fb5804] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:03:45.982 INFO 42 --- [pool-ocp-schedules-1,,cc6603bdd825] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:03:46.091 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:03:46.171 INFO 42 --- [pool-ocp-schedules-5,,1e5f7e0f7a3d] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:03:46.630 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:46.631 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:46.975 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:46.975 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:47.332 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:47.919 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:47.924 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:03:48.791 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:03:48.790345+08:00, lastProcessTime=2022-12-08T16:03:38.796817+08:00 2022-12-08 16:03:48.874 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:03:48.790345+08:00, resultsCount=0 2022-12-08 16:03:48.874 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:03:48.790345+08:00, resultsCount=0 2022-12-08 16:03:48.874 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:03:48.790345+08:00 2022-12-08 16:03:49.558 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:03:49.563 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:03:49.867 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:50.042 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:50.234 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:03:50.925 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:50.928 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:51.758 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:03:51.813 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:03:52.204 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:52.451 INFO 42 --- [pool-ocp-schedules-6,,8572c45ad7e6] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:03:52.917 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:52.917 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:52.955 INFO 42 --- [pool-ocp-schedules-8,,814be81ccafe] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:03:53.160 INFO 42 --- [pool-ocp-schedules-7,,295d77449ce7] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:03:53.227 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:53.228 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:53.929 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:53.933 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:54.489 INFO 42 --- [pool-ocp-schedules-3,,eccc98f9fae2] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:03:54.490 INFO 42 --- [pool-ocp-schedules-3,,eccc98f9fae2] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:03:54.490 INFO 42 --- [pool-ocp-schedules-3,,eccc98f9fae2] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:03:55.128 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:03:55.679 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:03:55.685 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:03:55.983 INFO 42 --- [pool-ocp-schedules-7,,90e9c9d9ce6d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:03:56.046 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:56.299 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:03:56.827 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:03:56.934 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:56.937 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:03:57.487 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:03:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,e6025288f06b] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:03:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,e6025288f06b] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:03:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:03:58.792 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:03:58.790624+08:00, lastProcessTime=2022-12-08T16:03:48.790345+08:00 2022-12-08 16:03:58.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:03:58.790624+08:00, resultsCount=0 2022-12-08 16:03:58.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:03:58.790624+08:00, resultsCount=0 2022-12-08 16:03:58.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:03:58.790624+08:00 2022-12-08 16:03:58.962 INFO 42 --- [pool-ocp-schedules-15,,698235eac9ee] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:03:58.962 INFO 42 --- [pool-ocp-schedules-15,,698235eac9ee] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:03:59.120 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:59.121 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:59.424 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:03:59.424 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:03:59.938 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:03:59.942 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:01.120 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:02:02.0, nextRun=2022-12-08 16:04:00.0, currentDate=Thu Dec 08 16:04:01 CST 2022 2022-12-08 16:04:01.121 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:02:02.0, nextRunTime=2022-12-08 16:04:00.0} 2022-12-08 16:04:01.131 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:04:01.146 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:04:01.758 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:03:01.0, nextRun=2022-12-08 16:04:00.0, currentDate=Thu Dec 08 16:04:01 CST 2022 2022-12-08 16:04:01.758 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:03:01.0, nextRunTime=2022-12-08 16:04:00.0} 2022-12-08 16:04:01.777 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:04:01.778 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:04:01.778 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:04:01.993 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:03:01.0, nextRun=2022-12-08 16:04:00.0, currentDate=Thu Dec 08 16:04:01 CST 2022 2022-12-08 16:04:01.994 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:03:01.0, nextRunTime=2022-12-08 16:04:00.0} 2022-12-08 16:04:02.026 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:04:02.026 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:04:02.027 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:04:02.044 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:04:02.048 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:04:02.060 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 515, operation:EXECUTE, state: RUNNING 2022-12-08 16:04:02.130 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:04:02.137 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:04:02.167 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:03:01.0, nextRun=2022-12-08 16:04:00.0, currentDate=Thu Dec 08 16:04:02 CST 2022 2022-12-08 16:04:02.168 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:03:01.0, nextRunTime=2022-12-08 16:04:00.0} 2022-12-08 16:04:02.186 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=515, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:04:02.048+08:00, endTime=null} 2022-12-08 16:04:02.204 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:04:02.204 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:04:02.205 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:04:02.238 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:02.313 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:03:31.0, nextRun=2022-12-08 16:04:00.0, currentDate=Thu Dec 08 16:04:02 CST 2022 2022-12-08 16:04:02.314 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:03:31.0, nextRunTime=2022-12-08 16:04:00.0} 2022-12-08 16:04:02.331 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:04:02.332 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:04:02.332 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:04:02.339 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:02.464 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:03:01.0, nextRun=2022-12-08 16:04:00.0, currentDate=Thu Dec 08 16:04:02 CST 2022 2022-12-08 16:04:02.464 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:03:01.0, nextRunTime=2022-12-08 16:04:00.0} 2022-12-08 16:04:02.482 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:04:02.482 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:04:02.483 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:04:02.519 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,9599004e55ed] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486700, interval=60 2022-12-08 16:04:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,9599004e55ed] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486642, count=0, elapsed=1668816155994 2022-12-08 16:04:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,3d61c559ea69] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486700, interval=60 2022-12-08 16:04:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,3d61c559ea69] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486642, count=0, elapsed=1668816155998 2022-12-08 16:04:02.776 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:04:02.943 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:02.948 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:03.272 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 516, operation:EXECUTE, state: RUNNING 2022-12-08 16:04:03.332 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=516, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:04:03.261+08:00, endTime=null} 2022-12-08 16:04:03.342 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:515, status:SUCCESS 2022-12-08 16:04:03.348 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:515, status:SUCCESS 2022-12-08 16:04:03.395 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 517, operation:EXECUTE, state: RUNNING 2022-12-08 16:04:03.488 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=517, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:04:03.378+08:00, endTime=null} 2022-12-08 16:04:03.538 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 518, operation:EXECUTE, state: RUNNING 2022-12-08 16:04:03.611 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=518, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:04:03.526+08:00, endTime=null} 2022-12-08 16:04:03.682 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 519, operation:EXECUTE, state: RUNNING 2022-12-08 16:04:03.713 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=519, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:04:03.651+08:00, endTime=null} 2022-12-08 16:04:05.132 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:516, status:SUCCESS 2022-12-08 16:04:05.143 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:516, status:SUCCESS 2022-12-08 16:04:05.272 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:517, status:SUCCESS 2022-12-08 16:04:05.279 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:517, status:SUCCESS 2022-12-08 16:04:05.362 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:05.363 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:05.395 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:04:05.498 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:518, status:SUCCESS 2022-12-08 16:04:05.512 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:518, status:SUCCESS 2022-12-08 16:04:05.525 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:03:06.0, nextRun=2022-12-08 16:04:05.0, currentDate=Thu Dec 08 16:04:05 CST 2022 2022-12-08 16:04:05.526 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:03:06.0, nextRunTime=2022-12-08 16:04:05.0} 2022-12-08 16:04:05.549 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:04:05.549 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:04:05.550 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:04:05.599 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:05.600 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:05.664 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:519, status:SUCCESS 2022-12-08 16:04:05.674 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:519, status:SUCCESS 2022-12-08 16:04:05.794 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 520, operation:EXECUTE, state: RUNNING 2022-12-08 16:04:05.837 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=520, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:04:05.781+08:00, endTime=null} 2022-12-08 16:04:05.949 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:05.953 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:05.984 INFO 42 --- [pool-ocp-schedules-7,,aa762d4d2eaa] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:04:07.340 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:520, status:SUCCESS 2022-12-08 16:04:07.346 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:520, status:SUCCESS 2022-12-08 16:04:07.521 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:08.112 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:04:08.118 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:04:08.494 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:08.682 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:04:08.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:04:08.791316+08:00, lastProcessTime=2022-12-08T16:03:58.790624+08:00 2022-12-08 16:04:08.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:04:08.791316+08:00, resultsCount=0 2022-12-08 16:04:08.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:04:08.791316+08:00, resultsCount=0 2022-12-08 16:04:08.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:04:08.791316+08:00 2022-12-08 16:04:08.953 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:08.957 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:09.207 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:04:11.626 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:11.626 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:11.707 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:04:11.791 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:11.792 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:11.958 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:11.962 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:12.162 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:04:12.181 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:04:12.394 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:13.321 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:04:13.526 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:04:14.348 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:04:14.354 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:04:14.963 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:14.967 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:14.987 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:15.043 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:15.479 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:04:15.605 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:04:15.985 INFO 42 --- [pool-ocp-schedules-1,,2ebfa988413a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:04:16.448 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:04:17.659 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:17.967 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:17.975 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:18.071 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:18.071 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:18.169 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:18.170 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:04:18.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:04:18.795232+08:00, lastProcessTime=2022-12-08T16:04:08.791316+08:00 2022-12-08 16:04:18.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:04:18.795232+08:00, resultsCount=0 2022-12-08 16:04:18.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:04:18.795232+08:00, resultsCount=0 2022-12-08 16:04:18.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:04:18.795232+08:00 2022-12-08 16:04:19.069 INFO 42 --- [pool-ocp-schedules-13,,72a78a2ad050] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:04:19.069 INFO 42 --- [pool-ocp-schedules-13,,72a78a2ad050] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:04:20.849 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:03:21.0, nextRun=2022-12-08 16:04:20.0, currentDate=Thu Dec 08 16:04:20 CST 2022 2022-12-08 16:04:20.850 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:03:21.0, nextRunTime=2022-12-08 16:04:20.0} 2022-12-08 16:04:20.869 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:04:20.870 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:04:20.870 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:04:20.976 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:20.979 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:20.999 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:04:21.005 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:04:21.150 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 521, operation:EXECUTE, state: RUNNING 2022-12-08 16:04:21.233 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:21.237 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=521, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:04:21.135+08:00, endTime=null} 2022-12-08 16:04:21.268 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:21.585 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:04:22.308 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:521, status:SUCCESS 2022-12-08 16:04:22.315 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:521, status:SUCCESS 2022-12-08 16:04:22.393 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:04:22.400 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:04:22.494 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:23.980 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:23.984 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:24.305 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:24.306 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:24.393 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:24.393 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:25.123 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:03:25.0, nextRun=2022-12-08 16:04:25.0, currentDate=Thu Dec 08 16:04:25 CST 2022 2022-12-08 16:04:25.124 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:03:25.0, nextRunTime=2022-12-08 16:04:25.0} 2022-12-08 16:04:25.180 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:04:25.180 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:04:25.181 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:04:25.403 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 522, operation:EXECUTE, state: RUNNING 2022-12-08 16:04:25.559 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:04:25.886 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=522, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:04:25.380+08:00, endTime=null} 2022-12-08 16:04:25.987 INFO 42 --- [pool-ocp-schedules-16,,90c9d8582b68] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:04:26.792 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:04:26.798 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:04:26.985 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:26.989 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:27.393 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:27.449 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:27.759 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:27.798 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:04:28.023 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:522, status:SUCCESS 2022-12-08 16:04:28.030 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:522, status:SUCCESS 2022-12-08 16:04:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:04:28.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:04:28.791219+08:00, lastProcessTime=2022-12-08T16:04:18.795232+08:00 2022-12-08 16:04:28.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:04:28.791219+08:00, resultsCount=0 2022-12-08 16:04:28.888 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:04:28.791219+08:00, resultsCount=0 2022-12-08 16:04:28.888 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:04:28.791219+08:00 2022-12-08 16:04:29.990 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:29.995 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:30.219 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:03:31.0, nextRun=2022-12-08 16:04:30.0, currentDate=Thu Dec 08 16:04:30 CST 2022 2022-12-08 16:04:30.220 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:03:31.0, nextRunTime=2022-12-08 16:04:30.0} 2022-12-08 16:04:30.248 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:04:30.339 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:02.0, nextRun=2022-12-08 16:04:30.0, currentDate=Thu Dec 08 16:04:30 CST 2022 2022-12-08 16:04:30.340 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:04:02.0, nextRunTime=2022-12-08 16:04:30.0} 2022-12-08 16:04:30.358 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:04:30.358 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:04:30.358 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:04:30.795 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:30.796 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:30.796 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:30.796 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:31.035 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 523, operation:EXECUTE, state: RUNNING 2022-12-08 16:04:31.130 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=523, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:04:31.017+08:00, endTime=null} 2022-12-08 16:04:31.327 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T16:00:30.988, end=2022-12-08T16:02:31.266} 2022-12-08 16:04:31.372 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:04:31.756 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:04:31.847 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:523, status:SUCCESS 2022-12-08 16:04:31.853 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:523, status:SUCCESS 2022-12-08 16:04:32.431 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:04:32.471 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:04:32.559 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:32.996 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:33.001 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:33.124 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:04:33.129 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:04:33.887 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:33.966 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:34.231 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:04:35.866 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:04:35.988 INFO 42 --- [pool-ocp-schedules-5,,60de37a9e1d1] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:04:36.001 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:36.005 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:37.228 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:37.229 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:37.230 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:37.231 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:37.869 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:04:38.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:04:38.797553+08:00, lastProcessTime=2022-12-08T16:04:28.791219+08:00 2022-12-08 16:04:38.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:04:38.797553+08:00, resultsCount=0 2022-12-08 16:04:38.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:04:38.797553+08:00, resultsCount=0 2022-12-08 16:04:38.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:04:38.797553+08:00 2022-12-08 16:04:39.006 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:39.011 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:39.203 INFO 42 --- [pool-ocp-schedules-5,,442b0e0102dc] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:04:39.204 INFO 42 --- [pool-ocp-schedules-5,,442b0e0102dc] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:04:39.647 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:04:39.657 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:04:40.331 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:40.331 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:40.760 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:04:42.011 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:42.016 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:42.022 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:04:42.533 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:04:42.632 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:02:41+08:00, updateTime=2022-12-08T16:04:11+08:00, expireTime=null, isLeader=false} 2022-12-08 16:04:42.641 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:04:42.739 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:04:43.228 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:43.438 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:04:43.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:43.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:43.479 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:43.479 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:43.580 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:04:45.017 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:45.021 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:45.472 INFO 42 --- [pool-ocp-schedules-6,,428ffdb81f38] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:04:45.507 INFO 42 --- [pool-ocp-schedules-6,,428ffdb81f38] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:04:45.710 INFO 42 --- [pool-ocp-schedules-5,,99247fd21121] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:04:45.989 INFO 42 --- [pool-ocp-schedules-9,,c809f8d8757e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:04:46.024 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:04:46.030 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:04:46.069 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:04:46.190 INFO 42 --- [pool-ocp-schedules-3,,55b2dddff77d] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:04:46.604 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:46.604 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:46.830 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:04:47.119 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:04:48.022 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:48.028 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:48.042 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:04:48.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:04:48.798889+08:00, lastProcessTime=2022-12-08T16:04:38.797553+08:00 2022-12-08 16:04:48.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:04:48.798889+08:00, resultsCount=0 2022-12-08 16:04:48.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:04:48.798889+08:00, resultsCount=0 2022-12-08 16:04:48.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:04:48.798889+08:00 2022-12-08 16:04:49.700 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:49.700 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:49.701 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:49.701 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:51.029 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:51.033 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:52.376 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:04:52.381 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:04:52.504 INFO 42 --- [pool-ocp-schedules-6,,c1c56edaecae] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:04:52.743 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:04:52.926 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:52.926 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:04:53.228 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:04:53.484 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:04:53.701 INFO 42 --- [pool-ocp-schedules-13,,2f3378375957] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:04:54.033 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:54.037 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:54.205 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:54.294 INFO 42 --- [pool-ocp-schedules-19,,9bf219ca7ab3] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:04:54.722 INFO 42 --- [pool-ocp-schedules-10,,730d330c8b33] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:04:54.723 INFO 42 --- [pool-ocp-schedules-10,,730d330c8b33] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:04:54.723 INFO 42 --- [pool-ocp-schedules-10,,730d330c8b33] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:04:55.990 INFO 42 --- [pool-ocp-schedules-17,,cfe3dfd3ee18] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:04:56.164 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:04:56.190 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:56.190 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:04:56.190 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:56.190 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:04:57.038 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:04:57.042 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:04:58.440 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:04:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,43e1291d60a2] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:04:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,43e1291d60a2] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:04:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:04:58.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:04:58.795732+08:00, lastProcessTime=2022-12-08T16:04:48.798889+08:00 2022-12-08 16:04:58.903 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:04:58.795732+08:00, resultsCount=0 2022-12-08 16:04:58.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:04:58.795732+08:00, resultsCount=0 2022-12-08 16:04:58.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:04:58.795732+08:00 2022-12-08 16:04:59.321 INFO 42 --- [pool-ocp-schedules-8,,d02e18f1578a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:04:59.322 INFO 42 --- [pool-ocp-schedules-8,,d02e18f1578a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:04:59.414 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:04:59.424 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:05:00.042 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:00.049 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:01.716 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:01.0, nextRun=2022-12-08 16:05:00.0, currentDate=Thu Dec 08 16:05:01 CST 2022 2022-12-08 16:05:01.717 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 16:00:01.0, nextRunTime=2022-12-08 16:05:00.0} 2022-12-08 16:05:01.733 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 16:05:01.734 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:01.734 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:02.093 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:05:02.383 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:02.384 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:02.578 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:01.0, nextRun=2022-12-08 16:05:00.0, currentDate=Thu Dec 08 16:05:02 CST 2022 2022-12-08 16:05:02.578 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 16:00:01.0, nextRunTime=2022-12-08 16:05:00.0} 2022-12-08 16:05:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,1ee5ecca2850] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486760, interval=60 2022-12-08 16:05:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,1ee5ecca2850] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486702, count=0, elapsed=1668816215933 2022-12-08 16:05:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,2cc76f8ae324] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486760, interval=60 2022-12-08 16:05:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,2cc76f8ae324] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486702, count=0, elapsed=1668816215938 2022-12-08 16:05:02.662 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 16:05:02.662 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 16:05:02.662 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:05:02.705 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 524, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:02.786 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:02.0, nextRun=2022-12-08 16:05:00.0, currentDate=Thu Dec 08 16:05:02 CST 2022 2022-12-08 16:05:02.787 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:04:02.0, nextRunTime=2022-12-08 16:05:00.0} 2022-12-08 16:05:02.794 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=524, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T16:05:02.691+08:00, endTime=null} 2022-12-08 16:05:02.807 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:05:02.808 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:02.808 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:02.921 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:02.0, nextRun=2022-12-08 16:05:00.0, currentDate=Thu Dec 08 16:05:02 CST 2022 2022-12-08 16:05:02.923 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:04:02.0, nextRunTime=2022-12-08 16:05:00.0} 2022-12-08 16:05:02.959 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:05:02.974 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:05:02.974 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:02.974 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:03.050 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:03.060 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:03.171 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:02.0, nextRun=2022-12-08 16:05:00.0, currentDate=Thu Dec 08 16:05:03 CST 2022 2022-12-08 16:05:03.172 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:04:02.0, nextRunTime=2022-12-08 16:05:00.0} 2022-12-08 16:05:03.196 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:05:03.196 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:03.196 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:03.294 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:30.0, nextRun=2022-12-08 16:05:00.0, currentDate=Thu Dec 08 16:05:03 CST 2022 2022-12-08 16:05:03.294 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:04:30.0, nextRunTime=2022-12-08 16:05:00.0} 2022-12-08 16:05:03.309 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:05:03.310 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:03.310 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:03.365 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:02.0, nextRun=2022-12-08 16:05:00.0, currentDate=Thu Dec 08 16:05:03 CST 2022 2022-12-08 16:05:03.365 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 16:00:02.0, nextRunTime=2022-12-08 16:05:00.0} 2022-12-08 16:05:03.384 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 16:05:03.385 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:03.385 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:03.454 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:02.0, nextRun=2022-12-08 16:05:00.0, currentDate=Thu Dec 08 16:05:03 CST 2022 2022-12-08 16:05:03.455 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:04:02.0, nextRunTime=2022-12-08 16:05:00.0} 2022-12-08 16:05:03.468 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:05:03.468 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:03.469 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:04.015 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 528, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:04.126 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=528, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:05:04.002+08:00, endTime=null} 2022-12-08 16:05:04.205 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 529, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:04.205 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:05:04.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:524, status:SUCCESS 2022-12-08 16:05:04.251 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:524, status:SUCCESS 2022-12-08 16:05:04.355 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=529, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T16:05:04.185+08:00, endTime=null} 2022-12-08 16:05:04.439 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 530, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:04.514 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:04.518 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=530, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:05:04.427+08:00, endTime=null} 2022-12-08 16:05:04.587 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 525, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:04.635 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=525, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:05:04.568+08:00, endTime=null} 2022-12-08 16:05:04.691 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 526, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:05.047 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=526, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:05:04.678+08:00, endTime=null} 2022-12-08 16:05:05.110 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 527, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:05.224 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=527, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:05:05.098+08:00, endTime=null} 2022-12-08 16:05:05.285 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:06.0, nextRun=2022-12-08 16:05:05.0, currentDate=Thu Dec 08 16:05:05 CST 2022 2022-12-08 16:05:05.285 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:04:06.0, nextRunTime=2022-12-08 16:05:05.0} 2022-12-08 16:05:05.304 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:05:05.305 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:05.305 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:05.654 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:05.654 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:05.659 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:05.659 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:05.706 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:525, status:SUCCESS 2022-12-08 16:05:05.712 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:525, status:SUCCESS 2022-12-08 16:05:05.789 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:526, status:SUCCESS 2022-12-08 16:05:05.795 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:526, status:SUCCESS 2022-12-08 16:05:05.894 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:527, status:SUCCESS 2022-12-08 16:05:05.899 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:527, status:SUCCESS 2022-12-08 16:05:05.973 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:528, status:SUCCESS 2022-12-08 16:05:05.981 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:528, status:SUCCESS 2022-12-08 16:05:05.991 INFO 42 --- [pool-ocp-schedules-8,,d0023fdc53ca] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:05:06.054 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:529, status:SUCCESS 2022-12-08 16:05:06.060 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:06.062 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:529, status:SUCCESS 2022-12-08 16:05:06.065 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:06.169 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:530, status:SUCCESS 2022-12-08 16:05:06.176 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:530, status:SUCCESS 2022-12-08 16:05:06.201 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:05:06.314 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 531, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:06.555 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=531, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:05:06.303+08:00, endTime=null} 2022-12-08 16:05:07.747 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:531, status:SUCCESS 2022-12-08 16:05:07.753 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:531, status:SUCCESS 2022-12-08 16:05:07.869 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:05:07.875 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:05:08.644 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:08.739 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:08.740 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:05:08.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:05:08.799651+08:00, lastProcessTime=2022-12-08T16:04:58.795732+08:00 2022-12-08 16:05:08.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:05:08.799651+08:00, resultsCount=0 2022-12-08 16:05:08.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:05:08.799651+08:00, resultsCount=0 2022-12-08 16:05:08.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:05:08.799651+08:00 2022-12-08 16:05:08.972 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:05:09.065 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:09.070 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:11.835 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:11.836 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:11.839 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:11.839 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:12.071 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:12.077 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:12.740 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:05:13.097 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:05:13.553 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:05:13.719 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:05:14.322 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:05:14.327 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:05:14.339 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:05:14.599 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:15.002 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:15.002 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:15.078 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:15.082 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:15.170 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:05:15.992 INFO 42 --- [pool-ocp-schedules-12,,24c0102702a3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:05:16.230 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:05:17.637 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:05:18.083 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:18.083 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:18.083 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:18.085 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:18.085 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:18.089 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:18.686 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:05:18.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:05:18.798838+08:00, lastProcessTime=2022-12-08T16:05:08.799651+08:00 2022-12-08 16:05:18.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:05:18.798838+08:00, resultsCount=0 2022-12-08 16:05:18.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:05:18.798838+08:00, resultsCount=0 2022-12-08 16:05:18.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:05:18.798838+08:00 2022-12-08 16:05:19.375 INFO 42 --- [pool-ocp-schedules-13,,15c1776cd675] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:05:19.376 INFO 42 --- [pool-ocp-schedules-13,,15c1776cd675] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:05:20.196 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:21.0, nextRun=2022-12-08 16:05:20.0, currentDate=Thu Dec 08 16:05:20 CST 2022 2022-12-08 16:05:20.197 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:04:21.0, nextRunTime=2022-12-08 16:05:20.0} 2022-12-08 16:05:20.220 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:05:20.221 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:20.222 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:20.584 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:05:20.594 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:05:20.789 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 532, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:20.851 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=532, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:05:20.774+08:00, endTime=null} 2022-12-08 16:05:21.090 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:21.094 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:21.158 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:21.161 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:21.713 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:05:21.905 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:532, status:SUCCESS 2022-12-08 16:05:21.911 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:532, status:SUCCESS 2022-12-08 16:05:23.174 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:05:24.095 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:24.100 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:24.248 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:24.249 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:24.249 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:24.250 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:24.599 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:05:24.671 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:25.994 INFO 42 --- [pool-ocp-schedules-14,,c9398cfbce43] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:05:26.052 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:25.0, nextRun=2022-12-08 16:05:25.0, currentDate=Thu Dec 08 16:05:26 CST 2022 2022-12-08 16:05:26.053 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:04:25.0, nextRunTime=2022-12-08 16:05:25.0} 2022-12-08 16:05:26.092 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:05:26.093 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:26.093 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:26.331 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:05:26.984 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:05:26.990 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:05:26.992 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 533, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:27.065 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=533, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:05:26.979+08:00, endTime=null} 2022-12-08 16:05:27.100 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:27.108 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:27.333 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:27.334 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:27.637 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:05:28.501 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:533, status:SUCCESS 2022-12-08 16:05:28.507 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:533, status:SUCCESS 2022-12-08 16:05:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:05:28.786 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:28.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:05:28.791733+08:00, lastProcessTime=2022-12-08T16:05:18.798838+08:00 2022-12-08 16:05:28.889 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:05:28.791733+08:00, resultsCount=0 2022-12-08 16:05:28.889 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:05:28.791733+08:00, resultsCount=0 2022-12-08 16:05:28.890 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:05:28.791733+08:00 2022-12-08 16:05:30.108 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:30.113 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:30.501 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:30.0, nextRun=2022-12-08 16:05:30.0, currentDate=Thu Dec 08 16:05:30 CST 2022 2022-12-08 16:05:30.502 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:04:30.0, nextRunTime=2022-12-08 16:05:30.0} 2022-12-08 16:05:30.523 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:05:30.559 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:30.559 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:30.560 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:30.560 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:30.737 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:03.0, nextRun=2022-12-08 16:05:30.0, currentDate=Thu Dec 08 16:05:30 CST 2022 2022-12-08 16:05:30.737 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:05:03.0, nextRunTime=2022-12-08 16:05:30.0} 2022-12-08 16:05:30.765 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:05:30.766 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:05:30.766 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:05:31.184 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 534, operation:EXECUTE, state: RUNNING 2022-12-08 16:05:31.280 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=534, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:05:31.170+08:00, endTime=null} 2022-12-08 16:05:32.708 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:05:32.715 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:534, status:SUCCESS 2022-12-08 16:05:32.730 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:534, status:SUCCESS 2022-12-08 16:05:33.030 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:05:33.045 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:05:33.114 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:33.120 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:33.310 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:05:33.688 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:33.690 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:34.158 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:05:34.671 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:05:34.745 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:35.995 INFO 42 --- [pool-ocp-schedules-1,,a772556f0536] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:05:36.121 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:36.126 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:36.559 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:05:36.762 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:36.762 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:36.762 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:36.763 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:05:38.814 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:05:38.813016+08:00, lastProcessTime=2022-12-08T16:05:28.791733+08:00 2022-12-08 16:05:38.851 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:38.941 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:05:38.813016+08:00, resultsCount=0 2022-12-08 16:05:38.941 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:05:38.813016+08:00, resultsCount=0 2022-12-08 16:05:38.942 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:05:38.813016+08:00 2022-12-08 16:05:39.127 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:39.131 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:39.356 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:05:39.362 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:05:39.443 INFO 42 --- [pool-ocp-schedules-15,,773e040c94c6] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:05:39.444 INFO 42 --- [pool-ocp-schedules-15,,773e040c94c6] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:05:39.895 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:39.897 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:39.945 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:05:40.190 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:05:40.205 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=15ms, period=120000ms 2022-12-08 16:05:42.132 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:42.136 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:42.865 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:05:42.941 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:42.942 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:42.942 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:42.942 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:43.427 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:05:43.614 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:05:43.759 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:05:44.702 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:05:44.775 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:45.137 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:45.142 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:45.336 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:05:45.343 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:05:45.473 INFO 42 --- [pool-ocp-schedules-14,,4f2575889914] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:05:45.473 INFO 42 --- [pool-ocp-schedules-10,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 16:05:45.519 INFO 42 --- [pool-ocp-schedules-14,,4f2575889914] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:05:45.711 INFO 42 --- [pool-ocp-schedules-17,,2b291d50b94e] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:05:45.754 INFO 42 --- [pool-ocp-schedules-13,,c0fd2a2c4203] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:05:45.755 INFO 42 --- [pool-ocp-schedules-13,,c0fd2a2c4203] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:05:45.996 INFO 42 --- [pool-ocp-schedules-2,,fd8540b8ed45] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:05:46.022 INFO 42 --- [pool-ocp-schedules-12,,288c244c3adc] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 16:05:46.051 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:46.052 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:46.195 INFO 42 --- [pool-ocp-schedules-8,,e0fb38f0cdd7] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 16:05:46.195 INFO 42 --- [pool-ocp-schedules-4,,f5bc6dbe8698] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:05:46.596 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:05:46.762 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:05:47.795 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:05:48.143 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:48.147 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:05:48.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:05:48.797126+08:00, lastProcessTime=2022-12-08T16:05:38.813016+08:00 2022-12-08 16:05:48.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:05:48.797126+08:00, resultsCount=0 2022-12-08 16:05:48.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:05:48.797126+08:00, resultsCount=0 2022-12-08 16:05:48.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:05:48.797126+08:00 2022-12-08 16:05:48.947 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:49.225 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:49.225 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:49.226 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:49.226 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:51.148 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:51.151 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:51.749 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:05:51.756 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:05:52.478 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:52.480 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:52.609 INFO 42 --- [pool-ocp-schedules-7,,941fd796221e] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:05:52.828 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:05:53.497 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:05:53.749 INFO 42 --- [pool-ocp-schedules-12,,009ed775774c] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:05:54.152 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:54.168 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:54.344 INFO 42 --- [pool-ocp-schedules-4,,47a9275148a7] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:05:54.743 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:05:54.923 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:54.974 INFO 42 --- [pool-ocp-schedules-10,,3b5e643402f9] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:05:54.975 INFO 42 --- [pool-ocp-schedules-10,,3b5e643402f9] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:05:54.975 INFO 42 --- [pool-ocp-schedules-10,,3b5e643402f9] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:05:55.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:55.549 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:55.603 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:05:55.603 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:05:55.997 INFO 42 --- [pool-ocp-schedules-10,,4f55b46afa3d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:05:56.793 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:05:57.169 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:05:57.177 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:05:58.025 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:05:58.031 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:05:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,6ded298a2dea] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:05:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,6ded298a2dea] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:05:58.743 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:58.745 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:05:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:05:58.811 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:05:58.809610+08:00, lastProcessTime=2022-12-08T16:05:48.797126+08:00 2022-12-08 16:05:58.932 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:05:58.809610+08:00, resultsCount=0 2022-12-08 16:05:58.932 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:05:58.809610+08:00, resultsCount=0 2022-12-08 16:05:58.932 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:05:58.809610+08:00 2022-12-08 16:05:59.154 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:05:59.372 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:05:59.507 INFO 42 --- [pool-ocp-schedules-4,,d57051faa5af] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:05:59.508 INFO 42 --- [pool-ocp-schedules-4,,d57051faa5af] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:06:00.001 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 16:06:00.178 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:00.184 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:00.772 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:04:01.0, nextRun=2022-12-08 16:06:00.0, currentDate=Thu Dec 08 16:06:00 CST 2022 2022-12-08 16:06:00.773 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:04:01.0, nextRunTime=2022-12-08 16:06:00.0} 2022-12-08 16:06:00.797 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:06:00.898 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:03.0, nextRun=2022-12-08 16:06:00.0, currentDate=Thu Dec 08 16:06:00 CST 2022 2022-12-08 16:06:00.899 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:05:03.0, nextRunTime=2022-12-08 16:06:00.0} 2022-12-08 16:06:00.917 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:06:00.918 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:06:00.918 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:06:01.010 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:03.0, nextRun=2022-12-08 16:06:00.0, currentDate=Thu Dec 08 16:06:01 CST 2022 2022-12-08 16:06:01.010 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:05:03.0, nextRunTime=2022-12-08 16:06:00.0} 2022-12-08 16:06:01.042 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:06:01.043 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:06:01.043 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:06:01.093 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:03.0, nextRun=2022-12-08 16:06:00.0, currentDate=Thu Dec 08 16:06:01 CST 2022 2022-12-08 16:06:01.094 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:05:03.0, nextRunTime=2022-12-08 16:06:00.0} 2022-12-08 16:06:01.117 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:06:01.118 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:06:01.118 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:06:01.184 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:31.0, nextRun=2022-12-08 16:06:00.0, currentDate=Thu Dec 08 16:06:01 CST 2022 2022-12-08 16:06:01.185 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:05:31.0, nextRunTime=2022-12-08 16:06:00.0} 2022-12-08 16:06:01.205 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:06:01.206 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:06:01.206 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:06:01.287 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:03.0, nextRun=2022-12-08 16:06:00.0, currentDate=Thu Dec 08 16:06:01 CST 2022 2022-12-08 16:06:01.287 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:05:03.0, nextRunTime=2022-12-08 16:06:00.0} 2022-12-08 16:06:01.310 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:06:01.310 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:06:01.311 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:06:01.714 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 535, operation:EXECUTE, state: RUNNING 2022-12-08 16:06:01.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:01.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:01.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:01.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:01.866 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=535, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:06:01.698+08:00, endTime=null} 2022-12-08 16:06:01.951 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 536, operation:EXECUTE, state: RUNNING 2022-12-08 16:06:02.208 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=536, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:06:01.938+08:00, endTime=null} 2022-12-08 16:06:02.545 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 537, operation:EXECUTE, state: RUNNING 2022-12-08 16:06:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,ff31480b83ec] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486820, interval=60 2022-12-08 16:06:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,ff31480b83ec] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486762, count=0, elapsed=1668816275873 2022-12-08 16:06:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,c6bf3d15d569] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486820, interval=60 2022-12-08 16:06:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,c6bf3d15d569] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486762, count=0, elapsed=1668816275878 2022-12-08 16:06:02.853 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=537, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:06:02.534+08:00, endTime=null} 2022-12-08 16:06:02.955 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 538, operation:EXECUTE, state: RUNNING 2022-12-08 16:06:03.023 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:06:03.184 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:03.195 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:03.241 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=538, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:06:02.922+08:00, endTime=null} 2022-12-08 16:06:03.317 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 539, operation:EXECUTE, state: RUNNING 2022-12-08 16:06:03.455 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=539, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:06:03.303+08:00, endTime=null} 2022-12-08 16:06:03.554 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:06:04.525 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:06:04.531 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:06:04.610 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:535, status:SUCCESS 2022-12-08 16:06:04.615 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:535, status:SUCCESS 2022-12-08 16:06:04.699 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:536, status:SUCCESS 2022-12-08 16:06:04.704 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:536, status:SUCCESS 2022-12-08 16:06:04.784 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:537, status:SUCCESS 2022-12-08 16:06:04.790 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:537, status:SUCCESS 2022-12-08 16:06:04.877 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:538, status:SUCCESS 2022-12-08 16:06:04.884 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:538, status:SUCCESS 2022-12-08 16:06:04.923 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:06:04.927 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:04.929 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:04.960 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:539, status:SUCCESS 2022-12-08 16:06:04.967 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:539, status:SUCCESS 2022-12-08 16:06:05.007 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:05.123 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:06:05.998 INFO 42 --- [pool-ocp-schedules-20,,71698c3b4d0c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:06:06.056 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:05.0, nextRun=2022-12-08 16:06:05.0, currentDate=Thu Dec 08 16:06:06 CST 2022 2022-12-08 16:06:06.057 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:05:05.0, nextRunTime=2022-12-08 16:06:05.0} 2022-12-08 16:06:06.072 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:06:06.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:06:06.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:06:06.196 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:06.200 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:06.558 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 540, operation:EXECUTE, state: RUNNING 2022-12-08 16:06:06.599 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=540, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:06:06.533+08:00, endTime=null} 2022-12-08 16:06:07.010 INFO 42 --- [pool-ocp-schedules-15,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 16:06:07.018 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:06:07.283 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:540, status:SUCCESS 2022-12-08 16:06:07.292 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:540, status:SUCCESS 2022-12-08 16:06:07.375 INFO 42 --- [pool-ocp-schedules-15,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 16:06:07.463 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 16:06:07.693 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : Started application in 7.631 seconds (JVM running for 2764.539) 2022-12-08 16:06:08.035 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:08.040 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:08.051 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:08.051 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:06:08.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:06:08.799437+08:00, lastProcessTime=2022-12-08T16:05:58.809610+08:00 2022-12-08 16:06:08.926 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:06:08.799437+08:00, resultsCount=0 2022-12-08 16:06:08.926 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:06:08.799437+08:00, resultsCount=0 2022-12-08 16:06:08.926 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:06:08.799437+08:00 2022-12-08 16:06:09.200 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:09.204 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:09.348 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T16:06:09.348+08:00 2022-12-08 16:06:09.406 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:10.582 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:06:10.587 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:06:11.120 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:11.120 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:11.335 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:06:12.205 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:12.211 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:12.908 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:06:13.601 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:06:13.668 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:06:13.833 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:06:14.226 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:14.226 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:14.227 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:14.227 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:14.971 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:06:15.052 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:15.212 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:15.216 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:16.000 INFO 42 --- [pool-ocp-schedules-4,,a0a49c1585d0] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:06:16.705 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:06:16.713 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:06:17.124 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:06:17.408 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:17.410 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:17.810 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:06:18.217 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:18.224 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:18.234 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:06:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:06:18.792 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:06:18.791074+08:00, lastProcessTime=2022-12-08T16:06:08.799437+08:00 2022-12-08 16:06:18.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:06:18.791074+08:00, resultsCount=0 2022-12-08 16:06:18.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:06:18.791074+08:00, resultsCount=0 2022-12-08 16:06:18.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:06:18.791074+08:00 2022-12-08 16:06:19.432 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:19.898 INFO 42 --- [pool-ocp-schedules-2,,aadc76dc6faf] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:06:19.898 INFO 42 --- [pool-ocp-schedules-2,,aadc76dc6faf] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:06:20.465 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:20.466 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:20.514 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:20.515 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:21.224 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:21.229 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:21.857 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:20.0, nextRun=2022-12-08 16:06:20.0, currentDate=Thu Dec 08 16:06:21 CST 2022 2022-12-08 16:06:21.858 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:05:20.0, nextRunTime=2022-12-08 16:06:20.0} 2022-12-08 16:06:21.878 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:06:21.878 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:06:21.879 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:06:22.601 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T16:00:22.299, end=2022-12-08T16:05:22.508} 2022-12-08 16:06:22.601 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T16:00:22.295, end=2022-12-08T16:05:22.477} 2022-12-08 16:06:22.632 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 16:06:22.632 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 16:06:22.896 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 541, operation:EXECUTE, state: RUNNING 2022-12-08 16:06:23.368 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=541, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:06:22.868+08:00, endTime=null} 2022-12-08 16:06:23.493 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:06:23.499 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:06:23.605 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:23.606 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:23.646 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:06:24.137 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:06:24.230 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:24.234 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:24.946 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:541, status:SUCCESS 2022-12-08 16:06:24.952 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:541, status:SUCCESS 2022-12-08 16:06:25.023 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:06:25.126 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:26.001 INFO 42 --- [pool-ocp-schedules-9,,b769331e9e3a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:06:26.464 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:26.0, nextRun=2022-12-08 16:06:25.0, currentDate=Thu Dec 08 16:06:26 CST 2022 2022-12-08 16:06:26.465 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:05:26.0, nextRunTime=2022-12-08 16:06:25.0} 2022-12-08 16:06:26.511 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:06:26.511 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:06:26.512 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:06:26.707 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:26.707 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:26.707 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:26.707 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:27.159 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:06:27.235 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:27.239 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:27.541 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 542, operation:EXECUTE, state: RUNNING 2022-12-08 16:06:28.101 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=542, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:06:27.525+08:00, endTime=null} 2022-12-08 16:06:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:06:28.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:06:28.793489+08:00, lastProcessTime=2022-12-08T16:06:18.791074+08:00 2022-12-08 16:06:28.876 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:06:28.793489+08:00, resultsCount=0 2022-12-08 16:06:28.877 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:06:28.793489+08:00, resultsCount=0 2022-12-08 16:06:28.877 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:06:28.793489+08:00 2022-12-08 16:06:29.401 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:06:29.406 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:06:29.499 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:542, status:SUCCESS 2022-12-08 16:06:29.506 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:542, status:SUCCESS 2022-12-08 16:06:29.780 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:29.781 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:29.898 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:30.052 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:06:30.240 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:30.244 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:31.164 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:31.0, nextRun=2022-12-08 16:06:30.0, currentDate=Thu Dec 08 16:06:31 CST 2022 2022-12-08 16:06:31.165 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:05:31.0, nextRunTime=2022-12-08 16:06:30.0} 2022-12-08 16:06:31.186 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:06:31.284 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:01.0, nextRun=2022-12-08 16:06:30.0, currentDate=Thu Dec 08 16:06:31 CST 2022 2022-12-08 16:06:31.284 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:06:01.0, nextRunTime=2022-12-08 16:06:30.0} 2022-12-08 16:06:31.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:06:31.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:06:31.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:06:31.969 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T16:02:31.266, end=2022-12-08T16:04:31.753} 2022-12-08 16:06:31.985 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:06:32.216 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 543, operation:EXECUTE, state: RUNNING 2022-12-08 16:06:32.289 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=543, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:06:32.204+08:00, endTime=null} 2022-12-08 16:06:32.861 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:32.861 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:32.881 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:32.882 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:33.245 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:33.249 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:33.289 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:06:33.737 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:06:33.816 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:543, status:SUCCESS 2022-12-08 16:06:33.822 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:543, status:SUCCESS 2022-12-08 16:06:35.121 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:06:35.367 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:35.466 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:06:35.475 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:06:35.982 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:36.002 INFO 42 --- [pool-ocp-schedules-20,,223a1ed7a4b4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:06:36.028 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:36.250 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:36.254 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:36.633 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:06:37.199 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:06:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:06:38.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:06:38.794637+08:00, lastProcessTime=2022-12-08T16:06:28.793489+08:00 2022-12-08 16:06:38.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:06:38.794637+08:00, resultsCount=0 2022-12-08 16:06:38.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:06:38.794637+08:00, resultsCount=0 2022-12-08 16:06:38.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:06:38.794637+08:00 2022-12-08 16:06:39.125 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:39.125 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:39.255 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:39.259 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:39.315 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:39.316 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:39.937 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:39.991 INFO 42 --- [pool-ocp-schedules-15,,dfc4793d2909] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:06:39.992 INFO 42 --- [pool-ocp-schedules-15,,dfc4793d2909] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:06:42.259 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:42.263 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:42.885 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:06:42.891 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:06:42.966 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:06:43.718 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:06:43.916 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:06:43.933 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:06:45.264 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:45.268 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:45.367 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:06:45.470 INFO 42 --- [pool-ocp-schedules-19,,9003508ca00c] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:06:45.498 INFO 42 --- [pool-ocp-schedules-19,,9003508ca00c] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:06:45.623 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:45.712 INFO 42 --- [pool-ocp-schedules-16,,d541876c3344] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:06:46.003 INFO 42 --- [pool-ocp-schedules-20,,22a9f0458eb8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:06:46.200 INFO 42 --- [pool-ocp-schedules-10,,f55f4fd4b751] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:06:47.246 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:06:48.269 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:06:49.156 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:49.159 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:06:49.168 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:52.169 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:52.562 WARN 42 --- [SimpleAsyncTaskExecutor-25474,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 16:06:53.231 WARN 42 --- [pool-ocp-schedules-11,,c9dcd2f1caa4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 16:06:54.170 WARN 42 --- [pool-3-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 16:06:54.246 WARN 42 --- [pool-ocp-schedules-19,,8a329ad4294b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 16:06:54.317 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:06:54.562 WARN 42 --- [SimpleAsyncTaskExecutor-25495,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 16:06:54.564 WARN 42 --- [SimpleAsyncTaskExecutor-25474,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2022-12-08 16:06:54.564 ERROR 42 --- [SimpleAsyncTaskExecutor-25474,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 16, maxActive 100, creating 1, createElapseMillis 5795 2022-12-08 16:06:54.570 ERROR 42 --- [SimpleAsyncTaskExecutor-25474,,] .a.i.SimpleAsyncUncaughtExceptionHandler : Unexpected exception occurred invoking async method: public void com.alipay.ocp.service.alarm.schedule.AlarmNotifier.doNotify() org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:448) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:572) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:360) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:99) ~[spring-tx-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.core.notification.NotificationFetcher$$EnhancerBySpringCGLIB$$d5f7ca2e.fetchWillBeSentNotification() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmNotifier.doNotify(AlarmNotifier.java:91) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmNotifier$$FastClassBySpringCGLIB$$fcf4f6ff.invoke() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:769) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:747) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:47) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:274) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:282) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:184) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:402) ~[spring-orm-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 16, maxActive 100, creating 1, createElapseMillis 5795 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final] ... 25 common frames omitted 2022-12-08 16:06:54.617 WARN 42 --- [pool-ocp-schedules-1,,e7c132a9c23d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2022-12-08 16:06:55.308 ERROR 42 --- [pool-ocp-schedules-11,,c9dcd2f1caa4] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.mybatis.spring.MyBatisSystemException: nested exception is org.apache.ibatis.exceptions.PersistenceException: ### Error querying database. Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 16, maxActive 100, creating 1, createElapseMillis 6464 ### The error may exist in URL [jar:file:/home/admin/ocp-server/lib/ocp-server-4.0.0-20220930.jar!/BOOT-INF/lib/ocp-core-4.0.0-20220930.jar!/sqlmap/meta/generated/Ocp2AlarmFilterDao.xml] ### The error may involve com.alipay.ocp.core.metadb.generated.mybatis.dao.Ocp2AlarmFilterDao.selectByExample ### The error occurred while executing a query ### Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 16, maxActive 100, creating 1, createElapseMillis 6464 at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:92) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at com.sun.proxy.$Proxy254.selectList(Unknown Source) ~[na:na] at org.mybatis.spring.SqlSessionTemplate.selectList(SqlSessionTemplate.java:223) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.binding.MapperMethod.executeForMany(MapperMethod.java:147) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:80) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) ~[mybatis-3.5.6.jar!/:3.5.6] at com.sun.proxy.$Proxy374.selectByExample(Unknown Source) ~[na:na] at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.sun.proxy.$Proxy375.selectByExample(Unknown Source) ~[na:na] at com.alipay.ocp.service.alarm.service.OcpAlarmFilterService.listByDoExample(OcpAlarmFilterService.java:206) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:200) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.service.OcpAlarmFilterService$$FastClassBySpringCGLIB$$ba56c8f0.invoke() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:685) ~[spring-aop-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.service.alarm.service.OcpAlarmFilterService$$EnhancerBySpringCGLIB$$1c4d9783.listAllActive() ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.service.OcpAlarmSearchService.refreshActiveAlarmStatus(OcpAlarmSearchService.java:137) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at com.alipay.ocp.service.alarm.schedule.AlarmSchedules.refreshActiveAlarmStatus(AlarmSchedules.java:65) ~[ocp-service-4.0.0-20220930.jar!/:4.0.0-20220930] at sun.reflect.GeneratedMethodAccessor705.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) ~[spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at com.alipay.ocp.core.thread.TraceDecorator.lambda$decorate$0(TraceDecorator.java:31) [ocp-core-4.0.0-20220930.jar!/:4.0.0-20220930] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_312] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_312] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312] Caused by: org.apache.ibatis.exceptions.PersistenceException: ### Error querying database. Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 16, maxActive 100, creating 1, createElapseMillis 6464 ### The error may exist in URL [jar:file:/home/admin/ocp-server/lib/ocp-server-4.0.0-20220930.jar!/BOOT-INF/lib/ocp-core-4.0.0-20220930.jar!/sqlmap/meta/generated/Ocp2AlarmFilterDao.xml] ### The error may involve com.alipay.ocp.core.metadb.generated.mybatis.dao.Ocp2AlarmFilterDao.selectByExample ### The error occurred while executing a query ### Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 16, maxActive 100, creating 1, createElapseMillis 6464 at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:149) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:140) ~[mybatis-3.5.6.jar!/:3.5.6] at sun.reflect.GeneratedMethodAccessor329.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_312] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_312] at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.4.jar!/:2.0.4] ... 39 common frames omitted Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 16, maxActive 100, creating 1, createElapseMillis 6464 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:82) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.mybatis.spring.transaction.SpringManagedTransaction.openConnection(SpringManagedTransaction.java:80) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.mybatis.spring.transaction.SpringManagedTransaction.getConnection(SpringManagedTransaction.java:67) ~[mybatis-spring-2.0.4.jar!/:2.0.4] at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:337) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:86) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:62) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:325) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:156) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:109) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:89) ~[mybatis-3.5.6.jar!/:3.5.6] at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:147) ~[mybatis-3.5.6.jar!/:3.5.6] ... 44 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 16, maxActive 100, creating 1, createElapseMillis 6464 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1775) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) ~[druid-1.2.8.jar!/:1.2.8] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.8.jar!/:1.2.8] at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:158) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:116) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:79) ~[spring-jdbc-5.2.4.RELEASE.jar!/:5.2.4.RELEASE] ... 54 common frames omitted 2022-12-08 16:06:55.568 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:55.653 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:06:55.651952+08:00, lastProcessTime=2022-12-08T16:06:38.794637+08:00 2022-12-08 16:06:55.738 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:06:55.651952+08:00, resultsCount=0 2022-12-08 16:06:55.739 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:06:55.651952+08:00, resultsCount=0 2022-12-08 16:06:55.739 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:06:55.651952+08:00 2022-12-08 16:06:56.005 INFO 42 --- [pool-ocp-schedules-9,,e02dde185716] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:06:56.213 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:06:56.413 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:57.188 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:06:57.266 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:06:57.421 INFO 42 --- [pool-ocp-schedules-10,,7ea7ca2bcc06] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:06:57.481 INFO 42 --- [pool-ocp-schedules-8,,c7558b3850c9] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:06:57.482 INFO 42 --- [pool-ocp-schedules-1,,e7c132a9c23d] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:06:57.506 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:06:57.522 INFO 42 --- [pool-ocp-schedules-7,,91a4b6e9285a] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:06:57.523 INFO 42 --- [pool-ocp-schedules-7,,91a4b6e9285a] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:06:57.523 INFO 42 --- [pool-ocp-schedules-7,,91a4b6e9285a] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:06:58.569 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:06:58.573 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:06:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,539cf7d48c2a] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:06:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,539cf7d48c2a] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:06:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:06:58.807 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:06:58.803733+08:00, lastProcessTime=2022-12-08T16:06:55.651952+08:00 2022-12-08 16:06:58.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:06:58.803733+08:00, resultsCount=0 2022-12-08 16:06:58.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:06:58.803733+08:00, resultsCount=0 2022-12-08 16:06:58.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:06:58.803733+08:00 2022-12-08 16:06:59.238 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:59.239 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:06:59.246 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:06:59.246 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:00.230 INFO 42 --- [pool-ocp-schedules-1,,2401135caae0] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:07:00.231 INFO 42 --- [pool-ocp-schedules-1,,2401135caae0] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:07:00.621 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:01.0, nextRun=2022-12-08 16:07:00.0, currentDate=Thu Dec 08 16:07:00 CST 2022 2022-12-08 16:07:00.622 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:06:01.0, nextRunTime=2022-12-08 16:07:00.0} 2022-12-08 16:07:00.637 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:07:00.637 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:07:00.638 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:07:00.992 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:01.0, nextRun=2022-12-08 16:07:00.0, currentDate=Thu Dec 08 16:07:00 CST 2022 2022-12-08 16:07:00.992 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:06:01.0, nextRunTime=2022-12-08 16:07:00.0} 2022-12-08 16:07:01.300 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:07:01.300 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:07:01.300 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:07:01.472 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:01.0, nextRun=2022-12-08 16:07:00.0, currentDate=Thu Dec 08 16:07:01 CST 2022 2022-12-08 16:07:01.472 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:06:01.0, nextRunTime=2022-12-08 16:07:00.0} 2022-12-08 16:07:01.496 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:07:01.496 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:07:01.497 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:07:01.542 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 544, operation:EXECUTE, state: RUNNING 2022-12-08 16:07:01.573 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:31.0, nextRun=2022-12-08 16:07:00.0, currentDate=Thu Dec 08 16:07:01 CST 2022 2022-12-08 16:07:01.573 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:01.574 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:06:31.0, nextRunTime=2022-12-08 16:07:00.0} 2022-12-08 16:07:01.577 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:01.588 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:07:01.589 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:07:01.589 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:07:01.646 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=544, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:07:01.529+08:00, endTime=null} 2022-12-08 16:07:01.708 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 545, operation:EXECUTE, state: RUNNING 2022-12-08 16:07:01.731 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:01.0, nextRun=2022-12-08 16:07:00.0, currentDate=Thu Dec 08 16:07:01 CST 2022 2022-12-08 16:07:01.732 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:06:01.0, nextRunTime=2022-12-08 16:07:00.0} 2022-12-08 16:07:01.749 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:07:01.749 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:07:01.749 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:07:01.854 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=545, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:07:01.694+08:00, endTime=null} 2022-12-08 16:07:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,e9cbd0537b64] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486880, interval=60 2022-12-08 16:07:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,e9cbd0537b64] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486822, count=0, elapsed=1668816335814 2022-12-08 16:07:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,9a5181a5dc9f] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486880, interval=60 2022-12-08 16:07:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,9a5181a5dc9f] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486822, count=0, elapsed=1668816335818 2022-12-08 16:07:02.677 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:07:02.685 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:07:02.963 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 546, operation:EXECUTE, state: RUNNING 2022-12-08 16:07:03.078 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=546, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:07:02.936+08:00, endTime=null} 2022-12-08 16:07:03.160 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 547, operation:EXECUTE, state: RUNNING 2022-12-08 16:07:03.210 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:544, status:SUCCESS 2022-12-08 16:07:03.217 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=547, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:07:03.147+08:00, endTime=null} 2022-12-08 16:07:03.217 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:544, status:SUCCESS 2022-12-08 16:07:03.294 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 548, operation:EXECUTE, state: RUNNING 2022-12-08 16:07:03.548 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:545, status:SUCCESS 2022-12-08 16:07:03.554 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:545, status:SUCCESS 2022-12-08 16:07:03.601 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=548, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:07:03.284+08:00, endTime=null} 2022-12-08 16:07:04.578 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:04.581 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:05.401 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:06.0, nextRun=2022-12-08 16:07:05.0, currentDate=Thu Dec 08 16:07:05 CST 2022 2022-12-08 16:07:05.402 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:06:06.0, nextRunTime=2022-12-08 16:07:05.0} 2022-12-08 16:07:05.417 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:07:05.418 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:07:05.418 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:07:05.451 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:546, status:SUCCESS 2022-12-08 16:07:05.472 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:546, status:SUCCESS 2022-12-08 16:07:05.549 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:547, status:SUCCESS 2022-12-08 16:07:05.556 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:05.557 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:547, status:SUCCESS 2022-12-08 16:07:05.559 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:05.688 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 549, operation:EXECUTE, state: RUNNING 2022-12-08 16:07:05.711 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:548, status:SUCCESS 2022-12-08 16:07:05.717 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:548, status:SUCCESS 2022-12-08 16:07:05.826 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:07:06.006 INFO 42 --- [pool-ocp-schedules-10,,78610a9dfe3a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:07:06.052 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=549, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:07:05.676+08:00, endTime=null} 2022-12-08 16:07:06.213 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:07:07.266 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:07.428 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:549, status:SUCCESS 2022-12-08 16:07:07.434 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:549, status:SUCCESS 2022-12-08 16:07:07.484 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:07:07.506 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:07:07.582 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:07.589 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:07.621 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:08.645 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:08.645 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:08.669 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:08.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:07:08.822 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:07:08.821033+08:00, lastProcessTime=2022-12-08T16:06:58.803733+08:00 2022-12-08 16:07:08.945 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:07:08.821033+08:00, resultsCount=0 2022-12-08 16:07:08.946 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:07:08.821033+08:00, resultsCount=0 2022-12-08 16:07:08.946 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:07:08.821033+08:00 2022-12-08 16:07:10.589 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:10.593 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:11.267 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:07:11.273 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:07:11.414 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:07:11.840 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:11.843 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:12.112 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:07:13.181 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:07:13.220 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:04:42+08:00, updateTime=2022-12-08T16:06:42+08:00, expireTime=null, isLeader=false} 2022-12-08 16:07:13.247 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:07:13.594 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:13.601 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:13.767 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:07:14.311 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:07:14.405 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:03:13+08:00, updateTime=2022-12-08T16:06:43+08:00, expireTime=null, isLeader=false} 2022-12-08 16:07:14.412 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:07:15.107 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:15.108 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:15.108 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:15.108 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:16.007 INFO 42 --- [pool-ocp-schedules-12,,53bb234c8bc3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:07:16.326 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:07:16.602 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:16.606 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:17.372 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:17.442 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:07:17.447 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:07:17.587 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:07:17.590 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:07:17.712 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:18.689 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:18.698 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:07:18.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:07:18.796511+08:00, lastProcessTime=2022-12-08T16:07:08.821033+08:00 2022-12-08 16:07:18.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:07:18.796511+08:00, resultsCount=0 2022-12-08 16:07:18.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:07:18.796511+08:00, resultsCount=0 2022-12-08 16:07:18.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:07:18.796511+08:00 2022-12-08 16:07:19.055 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:07:19.607 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:19.612 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:20.839 INFO 42 --- [pool-ocp-schedules-19,,5fe31fbe6774] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:07:20.840 INFO 42 --- [pool-ocp-schedules-19,,5fe31fbe6774] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:07:21.762 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:21.762 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:21.854 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:21.855 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:21.916 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:22.0, nextRun=2022-12-08 16:07:20.0, currentDate=Thu Dec 08 16:07:21 CST 2022 2022-12-08 16:07:21.917 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:06:22.0, nextRunTime=2022-12-08 16:07:20.0} 2022-12-08 16:07:21.933 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:07:21.934 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:07:21.934 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:07:22.316 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 550, operation:EXECUTE, state: RUNNING 2022-12-08 16:07:22.436 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=550, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:07:22.305+08:00, endTime=null} 2022-12-08 16:07:22.612 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:22.616 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:23.576 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:550, status:SUCCESS 2022-12-08 16:07:23.582 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:550, status:SUCCESS 2022-12-08 16:07:24.474 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:07:24.479 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:07:24.897 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:25.141 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:25.208 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:26.0, nextRun=2022-12-08 16:07:25.0, currentDate=Thu Dec 08 16:07:25 CST 2022 2022-12-08 16:07:25.208 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:06:26.0, nextRunTime=2022-12-08 16:07:25.0} 2022-12-08 16:07:25.337 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:07:25.338 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:07:25.338 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:07:25.617 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:25.622 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:25.681 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 551, operation:EXECUTE, state: RUNNING 2022-12-08 16:07:25.711 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:07:25.734 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=551, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:07:25.670+08:00, endTime=null} 2022-12-08 16:07:26.008 INFO 42 --- [pool-ocp-schedules-18,,fc2a1800ef81] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:07:26.364 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:07:27.014 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:07:27.448 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:27.542 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:551, status:SUCCESS 2022-12-08 16:07:27.548 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:551, status:SUCCESS 2022-12-08 16:07:27.707 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:07:27.915 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:07:28.039 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:28.201 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:28.201 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:28.622 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:28.627 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:28.641 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:28.641 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:07:28.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:07:28.799534+08:00, lastProcessTime=2022-12-08T16:07:18.796511+08:00 2022-12-08 16:07:28.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:07:28.799534+08:00, resultsCount=0 2022-12-08 16:07:28.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:07:28.799534+08:00, resultsCount=0 2022-12-08 16:07:28.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:07:28.799534+08:00 2022-12-08 16:07:30.469 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:31.0, nextRun=2022-12-08 16:07:30.0, currentDate=Thu Dec 08 16:07:30 CST 2022 2022-12-08 16:07:30.469 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:06:31.0, nextRunTime=2022-12-08 16:07:30.0} 2022-12-08 16:07:30.490 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:07:30.671 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:07:02.0, nextRun=2022-12-08 16:07:30.0, currentDate=Thu Dec 08 16:07:30 CST 2022 2022-12-08 16:07:30.672 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:07:02.0, nextRunTime=2022-12-08 16:07:30.0} 2022-12-08 16:07:30.696 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:07:30.696 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:07:30.696 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:07:30.866 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 552, operation:EXECUTE, state: RUNNING 2022-12-08 16:07:30.899 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:07:30.906 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:07:31.094 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=552, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:07:30.854+08:00, endTime=null} 2022-12-08 16:07:31.277 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:31.628 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:31.632 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:31.793 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:32.031 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:552, status:SUCCESS 2022-12-08 16:07:32.037 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:552, status:SUCCESS 2022-12-08 16:07:32.126 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:07:34.343 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:34.343 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:34.632 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:34.636 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:34.891 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:34.892 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:36.009 INFO 42 --- [pool-ocp-schedules-16,,a1fbbdeaa39c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:07:36.425 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:07:37.365 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:07:37.373 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:07:37.526 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:37.637 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:37.640 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:37.696 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:37.952 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:38.018 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:07:38.270 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:07:38.316 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:07:38.419 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:07:38.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:07:38.793956+08:00, lastProcessTime=2022-12-08T16:07:28.799534+08:00 2022-12-08 16:07:38.888 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:07:38.793956+08:00, resultsCount=0 2022-12-08 16:07:38.889 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:07:38.793956+08:00, resultsCount=0 2022-12-08 16:07:38.889 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:07:38.793956+08:00 2022-12-08 16:07:40.310 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:07:40.335 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=25ms, period=120000ms 2022-12-08 16:07:40.641 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:40.646 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:41.305 INFO 42 --- [pool-ocp-schedules-3,,4ab6062b8d8d] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:07:41.305 INFO 42 --- [pool-ocp-schedules-3,,4ab6062b8d8d] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:07:41.314 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:41.315 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:41.319 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:41.320 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:42.073 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:07:43.328 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:07:43.647 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:43.651 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:43.848 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:07:44.040 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:07:44.058 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:07:44.482 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:07:44.894 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:44.898 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:45.713 INFO 42 --- [pool-ocp-schedules-14,,b17bacbd2e7b] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:07:45.756 INFO 42 --- [pool-ocp-schedules-15,,8aa2b58f4412] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:07:45.757 INFO 42 --- [pool-ocp-schedules-15,,8aa2b58f4412] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:07:45.776 INFO 42 --- [pool-ocp-schedules-19,,7a9be246afc3] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:07:45.805 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:07:45.814 INFO 42 --- [pool-ocp-schedules-19,,7a9be246afc3] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:07:46.010 INFO 42 --- [pool-ocp-schedules-2,,97da4a44343e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:07:46.214 INFO 42 --- [pool-ocp-schedules-4,,7e17b18f4604] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:07:46.543 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:07:46.652 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:46.656 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:48.271 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:48.305 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:07:48.625 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:07:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:07:48.776 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:48.795 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:48.795 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:48.797 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:48.797 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:48.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:07:48.798190+08:00, lastProcessTime=2022-12-08T16:07:38.793956+08:00 2022-12-08 16:07:48.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:07:48.798190+08:00, resultsCount=0 2022-12-08 16:07:48.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:07:48.798190+08:00, resultsCount=0 2022-12-08 16:07:48.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:07:48.798190+08:00 2022-12-08 16:07:49.657 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:49.661 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:51.096 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:07:51.102 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:07:51.890 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:51.927 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:52.269 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:07:52.662 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:52.667 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:54.944 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:54.945 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:55.012 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:07:55.012 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:07:55.667 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:55.672 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:56.011 INFO 42 --- [pool-ocp-schedules-4,,3bc281984883] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:07:56.896 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:07:57.124 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:07:57.493 INFO 42 --- [pool-ocp-schedules-1,,a0c3413cbd78] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:07:57.571 INFO 42 --- [pool-ocp-schedules-20,,e57d919c774e] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:07:57.571 INFO 42 --- [pool-ocp-schedules-8,,6af98cc68bd5] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:07:57.608 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:07:57.615 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:07:57.771 INFO 42 --- [pool-ocp-schedules-10,,4cb625d696de] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:07:57.772 INFO 42 --- [pool-ocp-schedules-10,,4cb625d696de] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:07:57.772 INFO 42 --- [pool-ocp-schedules-10,,4cb625d696de] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:07:58.383 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:58.384 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:07:58.626 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:07:58.630 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:07:58.647 INFO 42 --- [pool-prometheus-cache-monitor1,,08c734b7faf3] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:07:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,08c734b7faf3] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:07:58.673 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:07:58.677 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:07:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:07:58.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:07:58.797327+08:00, lastProcessTime=2022-12-08T16:07:48.798190+08:00 2022-12-08 16:07:58.816 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:07:58.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:07:58.797327+08:00, resultsCount=0 2022-12-08 16:07:58.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:07:58.797327+08:00, resultsCount=0 2022-12-08 16:07:58.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:07:58.797327+08:00 2022-12-08 16:07:58.977 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:07:59.115 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:00.447 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:06:01.0, nextRun=2022-12-08 16:08:00.0, currentDate=Thu Dec 08 16:08:00 CST 2022 2022-12-08 16:08:00.448 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:06:01.0, nextRunTime=2022-12-08 16:08:00.0} 2022-12-08 16:08:00.483 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:08:00.651 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:07:01.0, nextRun=2022-12-08 16:08:00.0, currentDate=Thu Dec 08 16:08:00 CST 2022 2022-12-08 16:08:00.652 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:07:01.0, nextRunTime=2022-12-08 16:08:00.0} 2022-12-08 16:08:00.675 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:08:00.676 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:08:00.676 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:08:00.753 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:07:01.0, nextRun=2022-12-08 16:08:00.0, currentDate=Thu Dec 08 16:08:00 CST 2022 2022-12-08 16:08:00.753 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:07:01.0, nextRunTime=2022-12-08 16:08:00.0} 2022-12-08 16:08:00.779 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:08:00.779 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:08:00.779 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:08:01.095 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:07:01.0, nextRun=2022-12-08 16:08:00.0, currentDate=Thu Dec 08 16:08:01 CST 2022 2022-12-08 16:08:01.096 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:07:01.0, nextRunTime=2022-12-08 16:08:00.0} 2022-12-08 16:08:01.123 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:08:01.124 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:08:01.124 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:08:01.151 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 553, operation:EXECUTE, state: RUNNING 2022-12-08 16:08:01.543 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:01.543 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:01.544 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:01.544 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:01.636 INFO 42 --- [pool-ocp-schedules-10,,5cf7c12abe6c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:08:01.637 INFO 42 --- [pool-ocp-schedules-10,,5cf7c12abe6c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:08:01.639 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:07:31.0, nextRun=2022-12-08 16:08:00.0, currentDate=Thu Dec 08 16:08:01 CST 2022 2022-12-08 16:08:01.639 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:07:31.0, nextRunTime=2022-12-08 16:08:00.0} 2022-12-08 16:08:01.642 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=553, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:08:01.140+08:00, endTime=null} 2022-12-08 16:08:01.660 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:08:01.661 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:08:01.661 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:08:01.677 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:01.681 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:01.721 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 554, operation:EXECUTE, state: RUNNING 2022-12-08 16:08:01.794 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:07:02.0, nextRun=2022-12-08 16:08:00.0, currentDate=Thu Dec 08 16:08:01 CST 2022 2022-12-08 16:08:01.795 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:07:02.0, nextRunTime=2022-12-08 16:08:00.0} 2022-12-08 16:08:01.808 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=554, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:08:01.708+08:00, endTime=null} 2022-12-08 16:08:01.812 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:08:01.812 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:08:01.812 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:08:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,795bb146a7dd] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486940, interval=60 2022-12-08 16:08:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,795bb146a7dd] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486882, count=0, elapsed=1668816395754 2022-12-08 16:08:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,0f7b0b7b87bb] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670486940, interval=60 2022-12-08 16:08:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,0f7b0b7b87bb] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486882, count=0, elapsed=1668816395758 2022-12-08 16:08:02.896 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 555, operation:EXECUTE, state: RUNNING 2022-12-08 16:08:02.959 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=555, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:08:02.879+08:00, endTime=null} 2022-12-08 16:08:03.073 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 556, operation:EXECUTE, state: RUNNING 2022-12-08 16:08:03.161 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:553, status:SUCCESS 2022-12-08 16:08:03.168 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=556, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:08:03.054+08:00, endTime=null} 2022-12-08 16:08:03.172 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:553, status:SUCCESS 2022-12-08 16:08:03.251 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 557, operation:EXECUTE, state: RUNNING 2022-12-08 16:08:03.287 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:554, status:SUCCESS 2022-12-08 16:08:03.293 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:554, status:SUCCESS 2022-12-08 16:08:03.313 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=557, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:08:03.235+08:00, endTime=null} 2022-12-08 16:08:04.218 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:08:04.228 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:08:04.682 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:04.686 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:04.729 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:555, status:SUCCESS 2022-12-08 16:08:04.737 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:555, status:SUCCESS 2022-12-08 16:08:04.791 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:04.793 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:04.828 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:556, status:SUCCESS 2022-12-08 16:08:04.838 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:556, status:SUCCESS 2022-12-08 16:08:04.937 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:557, status:SUCCESS 2022-12-08 16:08:04.944 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:557, status:SUCCESS 2022-12-08 16:08:05.324 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:08:06.012 INFO 42 --- [pool-ocp-schedules-12,,ebf5f0af7fb2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:08:06.146 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:07:05.0, nextRun=2022-12-08 16:08:05.0, currentDate=Thu Dec 08 16:08:06 CST 2022 2022-12-08 16:08:06.147 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:07:05.0, nextRunTime=2022-12-08 16:08:05.0} 2022-12-08 16:08:06.166 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:08:06.166 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:08:06.167 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:08:06.446 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 558, operation:EXECUTE, state: RUNNING 2022-12-08 16:08:06.485 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=558, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:08:06.423+08:00, endTime=null} 2022-12-08 16:08:06.959 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:08:07.425 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:558, status:SUCCESS 2022-12-08 16:08:07.431 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:558, status:SUCCESS 2022-12-08 16:08:07.687 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:07.691 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:07.860 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:07.860 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:07.876 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:07.876 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:08:08.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:08:08.793518+08:00, lastProcessTime=2022-12-08T16:07:58.797327+08:00 2022-12-08 16:08:08.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:08:08.793518+08:00, resultsCount=0 2022-12-08 16:08:08.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:08:08.793518+08:00, resultsCount=0 2022-12-08 16:08:08.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:08:08.793518+08:00 2022-12-08 16:08:08.977 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:08.983 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:08:09.115 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:08:09.265 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:10.628 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:08:10.635 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:08:10.692 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:10.698 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:10.944 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:10.944 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:11.445 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:08:12.159 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:08:13.699 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:13.703 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:13.849 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:08:13.986 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:08:14.435 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:14.435 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:14.437 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:14.437 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:14.533 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:08:16.014 INFO 42 --- [pool-ocp-schedules-4,,94f830d12a8b] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:08:16.704 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:16.708 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:17.019 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:08:17.360 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:08:17.367 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:08:17.661 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:17.662 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:18.198 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:08:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:08:18.815 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:08:18.814488+08:00, lastProcessTime=2022-12-08T16:08:08.793518+08:00 2022-12-08 16:08:18.936 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:08:18.814488+08:00, resultsCount=0 2022-12-08 16:08:18.936 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:08:18.814488+08:00, resultsCount=0 2022-12-08 16:08:18.937 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:08:18.814488+08:00 2022-12-08 16:08:19.029 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:19.072 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:08:19.341 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:08:19.709 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:19.713 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:19.714 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:20.362 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:07:22.0, nextRun=2022-12-08 16:08:20.0, currentDate=Thu Dec 08 16:08:20 CST 2022 2022-12-08 16:08:20.363 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:07:22.0, nextRunTime=2022-12-08 16:08:20.0} 2022-12-08 16:08:20.384 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:08:20.384 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:08:20.385 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:08:20.765 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 559, operation:EXECUTE, state: RUNNING 2022-12-08 16:08:20.839 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=559, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:08:20.751+08:00, endTime=null} 2022-12-08 16:08:20.960 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:20.961 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:20.961 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:20.961 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:21.971 INFO 42 --- [pool-ocp-schedules-19,,cf15c2e80420] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:08:21.972 INFO 42 --- [pool-ocp-schedules-19,,cf15c2e80420] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:08:22.368 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:559, status:SUCCESS 2022-12-08 16:08:22.374 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:559, status:SUCCESS 2022-12-08 16:08:22.715 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:22.719 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:24.881 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:08:24.887 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:08:25.344 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:07:25.0, nextRun=2022-12-08 16:08:25.0, currentDate=Thu Dec 08 16:08:25 CST 2022 2022-12-08 16:08:25.345 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:07:25.0, nextRunTime=2022-12-08 16:08:25.0} 2022-12-08 16:08:25.387 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:08:25.387 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:08:25.388 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:08:25.720 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:25.724 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:26.012 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 560, operation:EXECUTE, state: RUNNING 2022-12-08 16:08:26.015 INFO 42 --- [pool-ocp-schedules-4,,408e160af31a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:08:26.071 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=560, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:08:25.985+08:00, endTime=null} 2022-12-08 16:08:26.868 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:560, status:SUCCESS 2022-12-08 16:08:26.876 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:560, status:SUCCESS 2022-12-08 16:08:27.224 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:08:27.508 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:08:27.822 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:27.823 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:28.304 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:08:28.725 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:28.729 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:08:28.791 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:08:28.789398+08:00, lastProcessTime=2022-12-08T16:08:18.814488+08:00 2022-12-08 16:08:28.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:08:28.789398+08:00, resultsCount=0 2022-12-08 16:08:28.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:08:28.789398+08:00, resultsCount=0 2022-12-08 16:08:28.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:08:28.789398+08:00 2022-12-08 16:08:29.341 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:29.348 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:08:29.713 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:08:29.962 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:30.541 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:07:30.0, nextRun=2022-12-08 16:08:30.0, currentDate=Thu Dec 08 16:08:30 CST 2022 2022-12-08 16:08:30.542 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:07:30.0, nextRunTime=2022-12-08 16:08:30.0} 2022-12-08 16:08:30.562 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:08:30.808 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:02.0, nextRun=2022-12-08 16:08:30.0, currentDate=Thu Dec 08 16:08:30 CST 2022 2022-12-08 16:08:30.809 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:08:02.0, nextRunTime=2022-12-08 16:08:30.0} 2022-12-08 16:08:30.826 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:08:30.827 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:08:30.827 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:08:31.196 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:31.197 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:31.200 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:31.200 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:31.217 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 561, operation:EXECUTE, state: RUNNING 2022-12-08 16:08:31.290 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=561, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:08:31.204+08:00, endTime=null} 2022-12-08 16:08:31.730 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:31.734 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:32.470 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T16:04:31.753, end=2022-12-08T16:06:32.299} 2022-12-08 16:08:32.488 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:08:32.755 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:561, status:SUCCESS 2022-12-08 16:08:32.766 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:561, status:SUCCESS 2022-12-08 16:08:34.312 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:08:34.321 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:08:34.735 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:34.741 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:36.016 INFO 42 --- [pool-ocp-schedules-6,,71547caa8f9b] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:08:37.571 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:08:37.742 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:37.746 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:37.786 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:37.789 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:38.076 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:08:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:08:38.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:08:38.796835+08:00, lastProcessTime=2022-12-08T16:08:28.789398+08:00 2022-12-08 16:08:38.918 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:08:38.796835+08:00, resultsCount=0 2022-12-08 16:08:38.918 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:08:38.796835+08:00, resultsCount=0 2022-12-08 16:08:38.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:08:38.796835+08:00 2022-12-08 16:08:39.517 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:39.522 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:08:39.936 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:08:40.442 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:40.747 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:40.752 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:40.912 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:40.912 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:40.913 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:40.913 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:42.440 INFO 42 --- [pool-ocp-schedules-8,,1fbc63839767] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:08:42.441 INFO 42 --- [pool-ocp-schedules-8,,1fbc63839767] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:08:42.509 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:08:43.335 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:08:43.342 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:08:43.752 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:43.762 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:43.937 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:08:44.240 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:08:44.264 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:44.268 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:44.328 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:03:43+08:00, updateTime=2022-12-08T16:08:13+08:00, expireTime=null, isLeader=false} 2022-12-08 16:08:44.335 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 16:08:44.665 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:08:44.828 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:08:45.473 INFO 42 --- [pool-ocp-schedules-14,,b15e38866ad2] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:08:45.506 INFO 42 --- [pool-ocp-schedules-14,,b15e38866ad2] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:08:45.715 INFO 42 --- [pool-ocp-schedules-5,,25da43ff2dee] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:08:46.017 INFO 42 --- [pool-ocp-schedules-1,,cd83f5821090] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:08:46.219 INFO 42 --- [pool-ocp-schedules-9,,24091c2e33ec] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:08:46.763 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:46.769 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:47.351 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:47.352 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:47.432 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:47.433 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:47.776 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:08:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:08:48.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:08:48.797723+08:00, lastProcessTime=2022-12-08T16:08:38.796835+08:00 2022-12-08 16:08:48.921 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:08:48.797723+08:00, resultsCount=0 2022-12-08 16:08:48.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:08:48.797723+08:00, resultsCount=0 2022-12-08 16:08:48.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:08:48.797723+08:00 2022-12-08 16:08:49.751 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:49.754 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:08:49.770 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:49.774 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:49.917 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:08:49.924 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:08:50.042 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:08:50.667 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:50.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:50.763 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:51.113 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:08:52.775 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:52.782 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:53.791 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:53.791 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:53.912 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:08:53.912 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:08:55.783 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:55.787 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:56.019 INFO 42 --- [pool-ocp-schedules-1,,894bcb63470c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:08:56.457 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:08:56.463 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:08:57.085 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:57.086 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:08:57.454 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:08:57.625 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:08:57.695 INFO 42 --- [pool-ocp-schedules-6,,7df41b1d567c] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:08:57.696 INFO 42 --- [pool-ocp-schedules-3,,b02cab0d05a8] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:08:57.696 INFO 42 --- [pool-ocp-schedules-19,,b072f0fceea7] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:08:57.859 INFO 42 --- [pool-ocp-schedules-5,,e07a4c873128] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:08:57.860 INFO 42 --- [pool-ocp-schedules-5,,e07a4c873128] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:08:57.861 INFO 42 --- [pool-ocp-schedules-5,,e07a4c873128] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:08:57.970 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:08:58.647 INFO 42 --- [pool-prometheus-cache-monitor1,,d2fe4bcfb399] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:08:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,d2fe4bcfb399] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:08:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:08:58.788 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:08:58.792 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:08:58.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:08:58.800816+08:00, lastProcessTime=2022-12-08T16:08:48.797723+08:00 2022-12-08 16:08:58.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:08:58.800816+08:00, resultsCount=0 2022-12-08 16:08:58.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:08:58.800816+08:00, resultsCount=0 2022-12-08 16:08:58.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:08:58.800816+08:00 2022-12-08 16:08:59.808 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:08:59.811 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:09:00.000 INFO 42 --- [pool-ocp-schedules-10,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 16:09:00.417 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:01.0, nextRun=2022-12-08 16:09:00.0, currentDate=Thu Dec 08 16:09:00 CST 2022 2022-12-08 16:09:00.418 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:08:01.0, nextRunTime=2022-12-08 16:09:00.0} 2022-12-08 16:09:00.440 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:09:00.441 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:09:00.441 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:09:00.444 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:00.444 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:00.445 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:00.445 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:00.455 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:09:00.503 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:01.0, nextRun=2022-12-08 16:09:00.0, currentDate=Thu Dec 08 16:09:00 CST 2022 2022-12-08 16:09:00.504 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:08:01.0, nextRunTime=2022-12-08 16:09:00.0} 2022-12-08 16:09:00.533 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:09:00.533 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:09:00.534 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:09:00.601 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:01.0, nextRun=2022-12-08 16:09:00.0, currentDate=Thu Dec 08 16:09:00 CST 2022 2022-12-08 16:09:00.602 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:08:01.0, nextRunTime=2022-12-08 16:09:00.0} 2022-12-08 16:09:00.624 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:09:00.624 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:09:00.624 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:09:00.684 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:31.0, nextRun=2022-12-08 16:09:00.0, currentDate=Thu Dec 08 16:09:00 CST 2022 2022-12-08 16:09:00.685 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:08:31.0, nextRunTime=2022-12-08 16:09:00.0} 2022-12-08 16:09:00.703 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:09:00.703 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:09:00.703 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:09:00.738 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 562, operation:EXECUTE, state: RUNNING 2022-12-08 16:09:00.779 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:00.792 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:02.0, nextRun=2022-12-08 16:09:00.0, currentDate=Thu Dec 08 16:09:00 CST 2022 2022-12-08 16:09:00.793 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:08:02.0, nextRunTime=2022-12-08 16:09:00.0} 2022-12-08 16:09:00.811 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:09:00.812 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:09:00.812 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:09:00.839 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=562, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:09:00.725+08:00, endTime=null} 2022-12-08 16:09:00.919 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 563, operation:EXECUTE, state: RUNNING 2022-12-08 16:09:01.108 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=563, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:09:00.908+08:00, endTime=null} 2022-12-08 16:09:01.793 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:01.797 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:02.200 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 564, operation:EXECUTE, state: RUNNING 2022-12-08 16:09:02.360 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=564, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:09:02.185+08:00, endTime=null} 2022-12-08 16:09:02.449 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 565, operation:EXECUTE, state: RUNNING 2022-12-08 16:09:02.503 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=565, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:09:02.435+08:00, endTime=null} 2022-12-08 16:09:02.511 INFO 42 --- [pool-ocp-schedules-19,,b066ff62af73] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:09:02.512 INFO 42 --- [pool-ocp-schedules-19,,b066ff62af73] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:09:02.586 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 566, operation:EXECUTE, state: RUNNING 2022-12-08 16:09:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,af3e4c72b782] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487000, interval=60 2022-12-08 16:09:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,af3e4c72b782] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486942, count=0, elapsed=1668816455693 2022-12-08 16:09:02.639 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=566, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:09:02.574+08:00, endTime=null} 2022-12-08 16:09:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,832efe63715c] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487000, interval=60 2022-12-08 16:09:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,832efe63715c] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670486942, count=0, elapsed=1668816455698 2022-12-08 16:09:02.658 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:09:02.672 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:09:03.103 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:562, status:SUCCESS 2022-12-08 16:09:03.159 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:562, status:SUCCESS 2022-12-08 16:09:03.378 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:563, status:SUCCESS 2022-12-08 16:09:03.385 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:563, status:SUCCESS 2022-12-08 16:09:03.526 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:03.527 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:03.572 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:564, status:SUCCESS 2022-12-08 16:09:03.578 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:564, status:SUCCESS 2022-12-08 16:09:03.755 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:565, status:SUCCESS 2022-12-08 16:09:03.760 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:565, status:SUCCESS 2022-12-08 16:09:03.872 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:566, status:SUCCESS 2022-12-08 16:09:03.877 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:566, status:SUCCESS 2022-12-08 16:09:03.930 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:09:04.798 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:04.802 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:05.155 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:06.0, nextRun=2022-12-08 16:09:05.0, currentDate=Thu Dec 08 16:09:05 CST 2022 2022-12-08 16:09:05.155 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:08:06.0, nextRunTime=2022-12-08 16:09:05.0} 2022-12-08 16:09:05.171 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:09:05.172 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:09:05.172 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:09:05.705 INFO 42 --- [http-nio-8080-exec-10,38aa1dc0baf2436a,4aa3ec0de963] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/tenants?null, client=192.168.28.1, traceId=38aa1dc0baf2436a, method=PaginatedResponse com.alipay.ocp.server.controller.ObTenantController.listAllTenants(Pageable,String,List,Boolean,String,Boolean,List), args=Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:09:05.785 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 567, operation:EXECUTE, state: RUNNING 2022-12-08 16:09:05.902 INFO 42 --- [http-nio-8080-exec-10,38aa1dc0baf2436a,4aa3ec0de963] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/tenants client=192.168.28.1, traceId=38aa1dc0baf2436a, duration=223 ms] 2022-12-08 16:09:05.977 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=567, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:09:05.732+08:00, endTime=null} 2022-12-08 16:09:06.020 INFO 42 --- [pool-ocp-schedules-6,,9a2b5aac5692] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:09:06.669 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:06.669 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:06.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:06.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:07.628 INFO 42 --- [pool-ocp-schedules-10,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 16:09:07.673 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:567, status:SUCCESS 2022-12-08 16:09:07.680 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:567, status:SUCCESS 2022-12-08 16:09:07.803 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:07.808 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:08.018 INFO 42 --- [pool-ocp-schedules-10,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 16:09:08.154 INFO 42 --- [pool-ocp-schedules-10,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 16:09:08.346 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:09:08.544 INFO 42 --- [pool-ocp-schedules-10,,] o.s.boot.SpringApplication : Started application in 8.47 seconds (JVM running for 2945.39) 2022-12-08 16:09:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:09:08.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:09:08.797960+08:00, lastProcessTime=2022-12-08T16:08:58.800816+08:00 2022-12-08 16:09:08.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:09:08.797960+08:00, resultsCount=0 2022-12-08 16:09:08.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:09:08.797960+08:00, resultsCount=0 2022-12-08 16:09:08.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:09:08.797960+08:00 2022-12-08 16:09:09.577 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:09:09.585 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:09:09.876 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:09.882 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:09.959 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:09.962 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:09:10.257 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:09:10.516 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:09:10.809 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:10.812 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:10.880 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:10.971 INFO 42 --- [pool-ocp-schedules-10,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T16:09:10.971+08:00 2022-12-08 16:09:11.446 INFO 42 --- [http-nio-8080-exec-3,2c7bb7549f3c4355,2882e9db76ab] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=ODP&type=TOP, client=192.168.28.1, traceId=2c7bb7549f3c4355, method=PaginatedResponse com.alipay.ocp.server.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 2000, sort: id: ASC],TOP,ODP,] 2022-12-08 16:09:11.461 INFO 42 --- [http-nio-8080-exec-5,79120c279d664c70,796953d1121d] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/clusters?page=1&size=10, client=192.168.28.1, traceId=79120c279d664c70, method=PaginatedResponse com.alipay.ocp.server.controller.ObproxyController.listObproxyClusters(Pageable,String), args=Page request [number: 0, size 10, sort: id: ASC],] 2022-12-08 16:09:11.671 INFO 42 --- [http-nio-8080-exec-5,79120c279d664c70,796953d1121d] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/clusters client=192.168.28.1, traceId=79120c279d664c70, duration=221 ms] 2022-12-08 16:09:12.512 INFO 42 --- [http-nio-8080-exec-10,b158ab6cd0ac4293,7b0f38421870] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/tenants?null, client=192.168.28.1, traceId=b158ab6cd0ac4293, method=PaginatedResponse com.alipay.ocp.server.controller.ObTenantController.listAllTenants(Pageable,String,List,Boolean,String,Boolean,List), args=Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:09:12.541 INFO 42 --- [http-nio-8080-exec-10,b158ab6cd0ac4293,7b0f38421870] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/tenants client=192.168.28.1, traceId=b158ab6cd0ac4293, duration=32 ms] 2022-12-08 16:09:12.586 INFO 42 --- [http-nio-8080-exec-3,2c7bb7549f3c4355,2882e9db76ab] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=192.168.28.1, traceId=2c7bb7549f3c4355, duration=1153 ms] 2022-12-08 16:09:12.722 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:09:12.989 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:12.990 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:12.996 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:12.997 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:13.813 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:13.818 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:14.106 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:09:14.139 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:07:13+08:00, updateTime=2022-12-08T16:08:43+08:00, expireTime=null, isLeader=false} 2022-12-08 16:09:14.146 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:09:14.419 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:09:15.325 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:09:15.354 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:07:14+08:00, updateTime=2022-12-08T16:08:44+08:00, expireTime=null, isLeader=false} 2022-12-08 16:09:15.361 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:09:15.506 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:09:15.512 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:09:16.022 INFO 42 --- [pool-ocp-schedules-7,,e10164c091c0] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:09:16.530 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:16.532 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:16.683 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:09:16.819 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:16.823 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:09:18.811 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:09:18.810107+08:00, lastProcessTime=2022-12-08T16:09:08.797960+08:00 2022-12-08 16:09:18.899 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:09:18.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:09:18.810107+08:00, resultsCount=0 2022-12-08 16:09:18.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:09:18.810107+08:00, resultsCount=0 2022-12-08 16:09:18.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:09:18.810107+08:00 2022-12-08 16:09:19.675 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:19.676 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:19.683 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:19.683 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:19.824 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:19.828 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:20.167 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:20.171 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:09:20.556 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:09:21.258 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:21.263 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:20.0, nextRun=2022-12-08 16:09:20.0, currentDate=Thu Dec 08 16:09:21 CST 2022 2022-12-08 16:09:21.263 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:08:20.0, nextRunTime=2022-12-08 16:09:20.0} 2022-12-08 16:09:21.288 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:09:21.289 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:09:21.289 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:09:22.083 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:09:22.090 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:09:22.264 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 568, operation:EXECUTE, state: RUNNING 2022-12-08 16:09:22.651 INFO 42 --- [pool-ocp-schedules-16,,897a0b851e5d] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:09:22.652 INFO 42 --- [pool-ocp-schedules-16,,897a0b851e5d] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:09:22.657 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=568, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:09:22.231+08:00, endTime=null} 2022-12-08 16:09:22.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:22.827 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:22.828 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:22.833 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:23.290 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:09:24.972 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:568, status:SUCCESS 2022-12-08 16:09:24.978 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:568, status:SUCCESS 2022-12-08 16:09:25.834 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:25.838 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:26.023 INFO 42 --- [pool-ocp-schedules-19,,f12bebde31e3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:09:26.031 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:26.032 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:26.044 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:26.044 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:26.520 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:25.0, nextRun=2022-12-08 16:09:25.0, currentDate=Thu Dec 08 16:09:26 CST 2022 2022-12-08 16:09:26.521 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:08:25.0, nextRunTime=2022-12-08 16:09:25.0} 2022-12-08 16:09:26.561 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:09:26.562 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:09:26.562 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:09:26.859 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 569, operation:EXECUTE, state: RUNNING 2022-12-08 16:09:26.888 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=569, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:09:26.846+08:00, endTime=null} 2022-12-08 16:09:27.729 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:569, status:SUCCESS 2022-12-08 16:09:27.736 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:569, status:SUCCESS 2022-12-08 16:09:27.853 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:09:28.708 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:09:28.714 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:09:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:09:28.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:09:28.794685+08:00, lastProcessTime=2022-12-08T16:09:18.810107+08:00 2022-12-08 16:09:28.839 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:28.851 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:28.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:09:28.794685+08:00, resultsCount=0 2022-12-08 16:09:28.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:09:28.794685+08:00, resultsCount=0 2022-12-08 16:09:28.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:09:28.794685+08:00 2022-12-08 16:09:29.135 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:09:29.417 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:29.421 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:30.025 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:09:30.546 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:30.551 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:09:30.648 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:09:30.807 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:31.0, nextRun=2022-12-08 16:09:30.0, currentDate=Thu Dec 08 16:09:30 CST 2022 2022-12-08 16:09:30.808 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:08:31.0, nextRunTime=2022-12-08 16:09:30.0} 2022-12-08 16:09:30.831 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:09:31.227 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:09:01.0, nextRun=2022-12-08 16:09:30.0, currentDate=Thu Dec 08 16:09:31 CST 2022 2022-12-08 16:09:31.228 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:09:01.0, nextRunTime=2022-12-08 16:09:30.0} 2022-12-08 16:09:31.245 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:09:31.245 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:09:31.245 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:09:31.340 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:31.851 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:31.856 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:32.007 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 570, operation:EXECUTE, state: RUNNING 2022-12-08 16:09:32.237 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=570, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:09:31.996+08:00, endTime=null} 2022-12-08 16:09:32.552 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:32.552 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:32.552 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:32.552 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:34.218 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:570, status:SUCCESS 2022-12-08 16:09:34.226 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:570, status:SUCCESS 2022-12-08 16:09:34.856 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:34.861 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:36.024 INFO 42 --- [pool-ocp-schedules-20,,62b8a4d47986] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:09:36.116 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:09:36.134 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:09:37.862 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:37.867 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:09:38.814 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:09:38.812602+08:00, lastProcessTime=2022-12-08T16:09:28.794685+08:00 2022-12-08 16:09:38.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:09:38.812602+08:00, resultsCount=0 2022-12-08 16:09:38.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:09:38.812602+08:00, resultsCount=0 2022-12-08 16:09:38.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:09:38.812602+08:00 2022-12-08 16:09:39.091 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:39.092 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:39.194 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:09:39.309 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:09:40.337 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:09:40.351 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=14ms, period=120000ms 2022-12-08 16:09:40.648 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:40.652 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:09:40.736 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:09:40.868 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:40.871 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:41.633 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:42.148 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:42.149 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:42.149 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:42.149 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:42.733 INFO 42 --- [pool-ocp-schedules-8,,629a7600d826] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:09:42.733 INFO 42 --- [pool-ocp-schedules-8,,629a7600d826] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:09:42.992 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:09:43.872 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:43.883 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:44.232 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:09:44.495 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:09:44.500 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:09:44.722 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:09:45.401 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:09:45.472 INFO 42 --- [pool-ocp-schedules-7,,e471d22d0f6c] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:09:45.512 INFO 42 --- [pool-ocp-schedules-7,,e471d22d0f6c] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:09:45.520 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:45.522 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:45.615 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:09:45.716 INFO 42 --- [pool-ocp-schedules-8,,38568716f135] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:09:45.757 INFO 42 --- [pool-ocp-schedules-5,,b50e071fb768] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:09:45.758 INFO 42 --- [pool-ocp-schedules-5,,b50e071fb768] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:09:46.025 INFO 42 --- [pool-ocp-schedules-17,,f597c9b1afbe] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:09:46.224 INFO 42 --- [pool-ocp-schedules-9,,93b8cf4c8420] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:09:46.884 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:46.888 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:48.614 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:48.614 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:48.614 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:48.614 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:09:48.792 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:09:48.790890+08:00, lastProcessTime=2022-12-08T16:09:38.812602+08:00 2022-12-08 16:09:48.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:09:48.790890+08:00, resultsCount=0 2022-12-08 16:09:48.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:09:48.790890+08:00, resultsCount=0 2022-12-08 16:09:48.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:09:48.790890+08:00 2022-12-08 16:09:49.222 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:09:49.889 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:49.892 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:50.736 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:50.740 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:09:50.977 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:09:51.039 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:09:51.050 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:09:51.674 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:09:51.797 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:51.798 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:52.244 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:09:52.894 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:52.898 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:55.104 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:55.104 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:09:55.104 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:55.105 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:09:55.899 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:55.913 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:56.027 INFO 42 --- [pool-ocp-schedules-13,,dbf65226ef81] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:09:57.479 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:09:57.486 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:09:57.773 INFO 42 --- [pool-ocp-schedules-2,,d888d5582dac] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:09:57.824 INFO 42 --- [pool-ocp-schedules-9,,5c6fbae74f6e] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:09:57.824 INFO 42 --- [pool-ocp-schedules-4,,49d3711ac2e1] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:09:58.124 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:09:58.220 INFO 42 --- [pool-ocp-schedules-11,,edfa43909dc8] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:09:58.221 INFO 42 --- [pool-ocp-schedules-11,,edfa43909dc8] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:09:58.221 INFO 42 --- [pool-ocp-schedules-11,,edfa43909dc8] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:09:58.264 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:58.267 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:09:58.610 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:09:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,1e63dac2b88c] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:09:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,1e63dac2b88c] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:09:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:09:58.804 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:09:58.802412+08:00, lastProcessTime=2022-12-08T16:09:48.790890+08:00 2022-12-08 16:09:58.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:09:58.802412+08:00, resultsCount=0 2022-12-08 16:09:58.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:09:58.802412+08:00, resultsCount=0 2022-12-08 16:09:58.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:09:58.802412+08:00 2022-12-08 16:09:58.914 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:09:58.918 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:09:59.564 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:10:00.591 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:01.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:00 CST 2022 2022-12-08 16:10:00.592 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=12, name=Refresh agent config, templateName=RefreshAgentConfigSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 16:00:01.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:00.610 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Refresh agent config, nodeCount=1, taskCount=1 2022-12-08 16:10:00.611 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:00.611 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Refresh agent config, taskDefinitionId=12, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:00.677 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:08:00.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:00 CST 2022 2022-12-08 16:10:00.678 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:08:00.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:00.698 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:10:00.790 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:00:01.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:00 CST 2022 2022-12-08 16:10:00.791 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=15, name=Sync system event, templateName=SyncSystemEventSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 16:00:01.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:00.805 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:00.809 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:10:00.811 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync system event 2022-12-08 16:10:00.987 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:02.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:00 CST 2022 2022-12-08 16:10:00.987 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 16:05:02.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:01.005 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 16:10:01.006 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:01.006 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:01.043 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 571, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:01.082 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:10:01.216 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:03.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:01 CST 2022 2022-12-08 16:10:01.216 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=571, name=Refresh all agent config, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.RefreshAllAgentConfigTask, seriesId=0, startTime=2022-12-08T16:10:01.019+08:00, endTime=null} 2022-12-08 16:10:01.216 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 16:05:03.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:01.245 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 16:10:01.245 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 16:10:01.324 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:09:00.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:01 CST 2022 2022-12-08 16:10:01.325 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:09:00.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:01.337 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:01.337 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:01.340 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:10:01.341 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:01.341 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:01.422 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:01.422 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:01.459 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:09:01.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:01 CST 2022 2022-12-08 16:10:01.460 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:09:01.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:01.483 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:10:01.484 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:01.484 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:01.805 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:01.919 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:01.923 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:01.942 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:09:01.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:01 CST 2022 2022-12-08 16:10:01.943 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:09:01.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:01.967 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:10:01.968 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:01.968 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:02.287 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:09:31.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:02 CST 2022 2022-12-08 16:10:02.287 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:09:31.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:02.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:10:02.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:02.301 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:02.337 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 572, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:02.437 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:05:03.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:02 CST 2022 2022-12-08 16:10:02.438 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 16:05:03.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:02.455 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 16:10:02.455 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:02.455 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:02.504 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=572, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T16:10:02.320+08:00, endTime=null} 2022-12-08 16:10:02.562 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 573, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,33d814a17d8b] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487060, interval=60 2022-12-08 16:10:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,33d814a17d8b] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487002, count=0, elapsed=1668816515634 2022-12-08 16:10:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,de86c78e855f] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487060, interval=60 2022-12-08 16:10:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,de86c78e855f] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487002, count=0, elapsed=1668816515638 2022-12-08 16:10:02.716 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=573, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:10:02.551+08:00, endTime=null} 2022-12-08 16:10:02.717 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:09:01.0, nextRun=2022-12-08 16:10:00.0, currentDate=Thu Dec 08 16:10:02 CST 2022 2022-12-08 16:10:02.718 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:09:01.0, nextRunTime=2022-12-08 16:10:00.0} 2022-12-08 16:10:02.746 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:10:02.746 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:02.746 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:02.800 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 574, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:02.833 INFO 42 --- [pool-ocp-schedules-9,,2a21bce06449] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:10:02.834 INFO 42 --- [pool-ocp-schedules-9,,2a21bce06449] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:10:02.860 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:571, status:SUCCESS 2022-12-08 16:10:02.867 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:571, status:SUCCESS 2022-12-08 16:10:02.943 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=574, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:10:02.784+08:00, endTime=null} 2022-12-08 16:10:03.037 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 575, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:03.561 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=575, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:10:03.023+08:00, endTime=null} 2022-12-08 16:10:03.856 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:10:03.865 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:10:04.471 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:04.654 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 576, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:04.745 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=576, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:10:04.631+08:00, endTime=null} 2022-12-08 16:10:04.820 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 577, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:04.837 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:04.924 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:04.928 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:04.956 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=577, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T16:10:04.806+08:00, endTime=null} 2022-12-08 16:10:04.967 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:572, status:SUCCESS 2022-12-08 16:10:04.972 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:572, status:SUCCESS 2022-12-08 16:10:04.976 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:10:05.034 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 578, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:05.110 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:573, status:SUCCESS 2022-12-08 16:10:05.126 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:573, status:SUCCESS 2022-12-08 16:10:05.139 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=578, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:10:05.023+08:00, endTime=null} 2022-12-08 16:10:05.285 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:574, status:SUCCESS 2022-12-08 16:10:05.291 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:574, status:SUCCESS 2022-12-08 16:10:05.818 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:575, status:SUCCESS 2022-12-08 16:10:05.839 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:575, status:SUCCESS 2022-12-08 16:10:05.863 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:09:05.0, nextRun=2022-12-08 16:10:05.0, currentDate=Thu Dec 08 16:10:05 CST 2022 2022-12-08 16:10:05.864 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:09:05.0, nextRunTime=2022-12-08 16:10:05.0} 2022-12-08 16:10:05.881 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:10:05.882 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:05.882 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:05.951 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:576, status:SUCCESS 2022-12-08 16:10:05.958 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:576, status:SUCCESS 2022-12-08 16:10:06.028 INFO 42 --- [pool-ocp-schedules-12,,25577b3cf17c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:10:06.053 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:577, status:SUCCESS 2022-12-08 16:10:06.064 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:577, status:SUCCESS 2022-12-08 16:10:06.172 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:578, status:SUCCESS 2022-12-08 16:10:06.179 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:578, status:SUCCESS 2022-12-08 16:10:06.236 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 579, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:06.271 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=579, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:10:06.224+08:00, endTime=null} 2022-12-08 16:10:07.379 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:579, status:SUCCESS 2022-12-08 16:10:07.385 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:579, status:SUCCESS 2022-12-08 16:10:07.692 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:07.692 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:07.928 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:07.933 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:07.966 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:07.966 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:10:08.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:10:08.793115+08:00, lastProcessTime=2022-12-08T16:09:58.802412+08:00 2022-12-08 16:10:08.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:10:08.793115+08:00, resultsCount=0 2022-12-08 16:10:08.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:10:08.793115+08:00, resultsCount=0 2022-12-08 16:10:08.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:10:08.793115+08:00 2022-12-08 16:10:09.588 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:10:10.549 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:10:10.555 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:10:10.738 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:10.904 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:10.934 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:10.939 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:10.971 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:10:11.094 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:11.208 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:10:11.286 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:10:12.283 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:13.227 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:10:13.889 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:13.890 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:13.939 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:13.944 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:14.283 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:14.283 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:14.306 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:10:14.754 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:10:15.437 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:10:16.030 INFO 42 --- [pool-ocp-schedules-12,,f24b714b7488] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:10:16.596 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:10:16.605 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:10:16.945 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:16.948 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:16.972 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:17.358 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:17.795 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:10:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:10:18.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:10:18.794780+08:00, lastProcessTime=2022-12-08T16:10:08.793115+08:00 2022-12-08 16:10:18.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:10:18.794780+08:00, resultsCount=0 2022-12-08 16:10:18.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:10:18.794780+08:00, resultsCount=0 2022-12-08 16:10:18.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:10:18.794780+08:00 2022-12-08 16:10:19.636 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:10:19.949 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:19.954 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:20.284 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:20.284 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:20.581 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:09:21.0, nextRun=2022-12-08 16:10:20.0, currentDate=Thu Dec 08 16:10:20 CST 2022 2022-12-08 16:10:20.581 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:09:21.0, nextRunTime=2022-12-08 16:10:20.0} 2022-12-08 16:10:20.599 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:10:20.599 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:20.600 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:20.667 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:20.668 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:21.144 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:21.205 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:10:21.408 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:10:21.565 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 580, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:21.589 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=580, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:10:21.553+08:00, endTime=null} 2022-12-08 16:10:22.392 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:580, status:SUCCESS 2022-12-08 16:10:22.404 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:580, status:SUCCESS 2022-12-08 16:10:22.486 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:22.883 INFO 42 --- [pool-ocp-schedules-7,,af5df556b198] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:10:22.884 INFO 42 --- [pool-ocp-schedules-7,,af5df556b198] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:10:22.954 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:22.959 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:23.000 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:10:23.007 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:10:23.339 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:23.776 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:24.113 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:10:25.034 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:09:27.0, nextRun=2022-12-08 16:10:25.0, currentDate=Thu Dec 08 16:10:25 CST 2022 2022-12-08 16:10:25.035 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:09:27.0, nextRunTime=2022-12-08 16:10:25.0} 2022-12-08 16:10:25.081 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:10:25.082 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:25.082 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:25.701 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 581, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:25.904 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=581, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:10:25.686+08:00, endTime=null} 2022-12-08 16:10:25.960 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:25.964 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:26.031 INFO 42 --- [pool-ocp-schedules-6,,a6d833804e8d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:10:26.425 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:26.426 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:26.902 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:26.902 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:27.388 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:581, status:SUCCESS 2022-12-08 16:10:27.395 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:581, status:SUCCESS 2022-12-08 16:10:28.271 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:10:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:10:28.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:10:28.798241+08:00, lastProcessTime=2022-12-08T16:10:18.794780+08:00 2022-12-08 16:10:28.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:10:28.798241+08:00, resultsCount=0 2022-12-08 16:10:28.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:10:28.798241+08:00, resultsCount=0 2022-12-08 16:10:28.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:10:28.798241+08:00 2022-12-08 16:10:28.965 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:28.979 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:29.407 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:10:29.414 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:10:29.646 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:29.662 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:10:30.072 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:30.209 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:10:31.001 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:09:31.0, nextRun=2022-12-08 16:10:30.0, currentDate=Thu Dec 08 16:10:31 CST 2022 2022-12-08 16:10:31.002 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:09:31.0, nextRunTime=2022-12-08 16:10:30.0} 2022-12-08 16:10:31.021 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:10:31.178 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:31.238 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:10:31.397 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:02.0, nextRun=2022-12-08 16:10:30.0, currentDate=Thu Dec 08 16:10:31 CST 2022 2022-12-08 16:10:31.397 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:10:02.0, nextRunTime=2022-12-08 16:10:30.0} 2022-12-08 16:10:31.417 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:10:31.417 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:31.418 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:31.466 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:10:31.983 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:31.998 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:32.076 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 582, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:32.156 INFO 42 --- [http-nio-8080-exec-1,9b69b14d02ae4c61,7fa5332fac00] c.a.o.server.trace.RequestTracingAspect : API: [POST /api/v2/obproxy/password?null, client=192.168.28.62, traceId=9b69b14d02ae4c61, method=SuccessResponse com.alipay.ocp.server.controller.ObproxyController.updateProxyroPasswd(UpdateObproxySysUserPasswordParam), args=UpdateObproxySysUserPasswordParam(username=proxyro, password=xxx] 2022-12-08 16:10:32.192 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=582, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:10:32.059+08:00, endTime=null} 2022-12-08 16:10:32.374 INFO 42 --- [http-nio-8080-exec-1,9b69b14d02ae4c61,7fa5332fac00] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Update obproxy proxyro user password, nodeCount=4, taskCount=4 2022-12-08 16:10:32.376 INFO 42 --- [http-nio-8080-exec-1,9b69b14d02ae4c61,7fa5332fac00] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:10:32.376 INFO 42 --- [http-nio-8080-exec-1,9b69b14d02ae4c61,7fa5332fac00] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Update obproxy proxyro user password, taskDefinitionId=-1, state=RUNNING, operation=EXECUTE} 2022-12-08 16:10:32.534 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:32.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:32.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:33.098 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T16:06:32.299, end=2022-12-08T16:08:32.933} 2022-12-08 16:10:33.106 INFO 42 --- [http-nio-8080-exec-1,9b69b14d02ae4c61,7fa5332fac00] c.a.o.server.trace.RequestTracingAspect : API OK: [POST /api/v2/obproxy/password client=192.168.28.62, traceId=9b69b14d02ae4c61, duration=1073 ms] 2022-12-08 16:10:33.112 INFO 42 --- [http-nio-8080-exec-1,9b69b14d02ae4c61,7fa5332fac00] c.a.ocp.service.audit.AuditEventService : begin create audit event, param:CreateAuditEventParam(operationEvent=UPDATE_OBPROXY_PROXYRO_PASSWORD, eventType=OB_PROXY_CLUSTER_MANAGEMENT, methodSignature=com.alipay.ocp.server.controller.ObproxyController.updateProxyroPasswd, resourceType=OB_PROXY_CLUSTER, resourceId=null, resourceName=proxyro, parentResource=null, operatorId=100, operatorName=admin, status=UNFINISHED, failedReason=null, taskId=583, eventInfo={"param":{"password":"******","username":"proxyro"}}, executionType=NEW, requestUrl=http://192.168.28.62:8080/api/v2/obproxy/password, clientIp=192.168.28.62, serverIp=192.168.28.62, startTime=2022-12-08T16:10:32.152+08:00, endTime=null) 2022-12-08 16:10:33.154 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:10:33.204 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:33.204 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:33.339 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 584, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:33.522 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:582, status:SUCCESS 2022-12-08 16:10:33.527 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:582, status:SUCCESS 2022-12-08 16:10:34.242 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=584, name=Prepare update obproxy proxyro user password, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.PrepareUpdateObproxySysUserPasswordTask, seriesId=0, startTime=2022-12-08T16:10:33.330+08:00, endTime=null} 2022-12-08 16:10:34.998 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:35.005 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:36.033 INFO 42 --- [pool-ocp-schedules-2,,1dfa7ff3796c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:10:36.222 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:10:36.267 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:10:37.249 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:38.006 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:38.011 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:38.412 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 586, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:38.535 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=586, name=Update obproxy proxyro user password, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.UpdateSysUserPasswordInObproxyTask, seriesId=2, startTime=2022-12-08T16:10:38.399+08:00, endTime=null} 2022-12-08 16:10:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:10:38.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:10:38.793819+08:00, lastProcessTime=2022-12-08T16:10:28.798241+08:00 2022-12-08 16:10:38.980 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:10:38.793819+08:00, resultsCount=0 2022-12-08 16:10:38.995 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:10:38.793819+08:00, resultsCount=0 2022-12-08 16:10:38.996 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:10:38.793819+08:00 2022-12-08 16:10:39.273 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:39.449 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:10:39.857 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:10:40.398 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:40.398 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:40.657 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 583, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:40.694 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=583, name=Update Obproxy proxyro user password in OB, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.UpdateSysUserPasswordInObTask, seriesId=1, startTime=2022-12-08T16:10:40.645+08:00, endTime=null} 2022-12-08 16:10:41.012 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:41.016 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:41.466 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:41.470 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:10:41.663 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:10:41.794 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 585, operation:EXECUTE, state: RUNNING 2022-12-08 16:10:41.998 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=585, name=Update obproxy proxyro user status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.UpdateObproxyNewPasswordAndSysUserStatusTask, seriesId=3, startTime=2022-12-08T16:10:41.782+08:00, endTime=null} 2022-12-08 16:10:42.373 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:42.374 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:42.603 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:43.333 INFO 42 --- [pool-ocp-schedules-19,,ae34a06510ab] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:10:43.334 INFO 42 --- [pool-ocp-schedules-19,,ae34a06510ab] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:10:43.345 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:10:43.985 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:583, status:SUCCESS 2022-12-08 16:10:44.017 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:44.021 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:44.346 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:10:44.643 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:10:44.651 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:10:44.838 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:10:45.467 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:10:45.472 INFO 42 --- [pool-ocp-schedules-3,,7fac3198d5d6] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:10:45.474 INFO 42 --- [pool-ocp-schedules-16,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 16:10:45.484 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:45.519 INFO 42 --- [pool-ocp-schedules-3,,7fac3198d5d6] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:10:45.717 INFO 42 --- [pool-ocp-schedules-13,,d6f5caa71ca3] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:10:46.048 INFO 42 --- [pool-ocp-schedules-9,,ee8684d4f470] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 16:10:46.154 INFO 42 --- [pool-ocp-schedules-5,,e9c89b39765c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:10:46.247 INFO 42 --- [pool-ocp-schedules-15,,82135e4c3d35] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:10:46.896 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:47.022 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:47.027 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:47.267 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:10:48.669 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:48.670 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:48.814 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:10:48.850 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:10:48.849918+08:00, lastProcessTime=2022-12-08T16:10:38.793819+08:00 2022-12-08 16:10:48.987 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:10:48.849918+08:00, resultsCount=0 2022-12-08 16:10:48.987 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:10:48.849918+08:00, resultsCount=0 2022-12-08 16:10:48.987 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:10:48.849918+08:00 2022-12-08 16:10:49.918 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:10:49.971 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:49.971 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:50.027 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:50.034 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:51.505 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:51.545 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:10:51.939 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:10:52.555 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:10:52.562 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:10:52.653 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:10:53.036 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:53.040 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:53.042 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:54.926 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:10:55.189 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:10:56.041 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:56.045 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:56.129 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:56.130 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:56.156 INFO 42 --- [pool-ocp-schedules-3,,8e5af1b73548] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:10:57.824 INFO 42 --- [pool-ocp-schedules-12,,fc6583f2349c] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:10:57.900 INFO 42 --- [pool-ocp-schedules-19,,3c187a9f44c8] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:10:57.902 INFO 42 --- [pool-ocp-schedules-9,,68cb0a8279ca] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:10:58.160 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:10:58.160 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:10:58.312 INFO 42 --- [pool-ocp-schedules-18,,49d0941f85f8] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:10:58.313 INFO 42 --- [pool-ocp-schedules-18,,49d0941f85f8] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:10:58.313 INFO 42 --- [pool-ocp-schedules-18,,49d0941f85f8] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:10:58.405 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:10:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,88307a8240be] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:10:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,88307a8240be] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:10:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:10:58.803 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:10:58.801631+08:00, lastProcessTime=2022-12-08T16:10:48.849918+08:00 2022-12-08 16:10:58.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:10:58.801631+08:00, resultsCount=0 2022-12-08 16:10:58.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:10:58.801631+08:00, resultsCount=0 2022-12-08 16:10:58.898 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:10:58.801631+08:00 2022-12-08 16:10:59.046 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:10:59.050 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:10:59.987 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:11:00.579 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:11:00.586 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:11:01.169 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:01.0, nextRun=2022-12-08 16:11:00.0, currentDate=Thu Dec 08 16:11:01 CST 2022 2022-12-08 16:11:01.170 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:10:01.0, nextRunTime=2022-12-08 16:11:00.0} 2022-12-08 16:11:01.188 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:11:01.188 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:11:01.188 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:11:01.234 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:01.0, nextRun=2022-12-08 16:11:00.0, currentDate=Thu Dec 08 16:11:01 CST 2022 2022-12-08 16:11:01.235 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:10:01.0, nextRunTime=2022-12-08 16:11:00.0} 2022-12-08 16:11:01.243 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:01.302 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:11:01.304 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:11:01.304 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:11:01.328 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 587, operation:EXECUTE, state: RUNNING 2022-12-08 16:11:01.363 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:02.0, nextRun=2022-12-08 16:11:00.0, currentDate=Thu Dec 08 16:11:01 CST 2022 2022-12-08 16:11:01.363 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:10:02.0, nextRunTime=2022-12-08 16:11:00.0} 2022-12-08 16:11:01.386 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=587, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:11:01.317+08:00, endTime=null} 2022-12-08 16:11:01.386 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:11:01.387 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:11:01.387 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:11:01.450 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:31.0, nextRun=2022-12-08 16:11:00.0, currentDate=Thu Dec 08 16:11:01 CST 2022 2022-12-08 16:11:01.450 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:10:31.0, nextRunTime=2022-12-08 16:11:00.0} 2022-12-08 16:11:01.466 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:11:01.466 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:11:01.466 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:11:01.547 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:03.0, nextRun=2022-12-08 16:11:00.0, currentDate=Thu Dec 08 16:11:01 CST 2022 2022-12-08 16:11:01.548 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:10:03.0, nextRunTime=2022-12-08 16:11:00.0} 2022-12-08 16:11:01.561 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:01.563 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:11:01.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:11:01.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:11:01.595 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:11:01.984 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:11:02.051 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:02.055 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:02.376 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:584, status:SUCCESS 2022-12-08 16:11:02.385 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:584, status:SUCCESS 2022-12-08 16:11:02.466 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 588, operation:EXECUTE, state: RUNNING 2022-12-08 16:11:02.519 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=588, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:11:02.451+08:00, endTime=null} 2022-12-08 16:11:02.604 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 589, operation:EXECUTE, state: RUNNING 2022-12-08 16:11:02.633 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,6af82046dd3d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487120, interval=60 2022-12-08 16:11:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,6af82046dd3d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487062, count=0, elapsed=1668816575573 2022-12-08 16:11:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,b00606bf17ae] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487120, interval=60 2022-12-08 16:11:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,b00606bf17ae] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487062, count=0, elapsed=1668816575578 2022-12-08 16:11:02.684 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:02.692 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=589, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:11:02.570+08:00, endTime=null} 2022-12-08 16:11:02.737 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:11:02.766 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 590, operation:EXECUTE, state: RUNNING 2022-12-08 16:11:02.891 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=590, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:11:02.753+08:00, endTime=null} 2022-12-08 16:11:02.972 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 591, operation:EXECUTE, state: RUNNING 2022-12-08 16:11:03.077 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=591, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:11:02.953+08:00, endTime=null} 2022-12-08 16:11:03.565 INFO 42 --- [pool-ocp-schedules-13,,d87eb5afb716] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:11:03.566 INFO 42 --- [pool-ocp-schedules-13,,d87eb5afb716] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:11:03.822 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:585, status:SUCCESS 2022-12-08 16:11:03.833 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:585, status:SUCCESS 2022-12-08 16:11:03.963 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:586, status:SUCCESS 2022-12-08 16:11:03.968 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:586, status:SUCCESS 2022-12-08 16:11:04.061 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:587, status:SUCCESS 2022-12-08 16:11:04.066 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:587, status:SUCCESS 2022-12-08 16:11:04.181 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:588, status:SUCCESS 2022-12-08 16:11:04.193 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:588, status:SUCCESS 2022-12-08 16:11:04.292 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:11:04.293 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:11:05.056 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:05.060 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:05.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:11:05.722 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:11:05.918 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:06.0, nextRun=2022-12-08 16:11:05.0, currentDate=Thu Dec 08 16:11:05 CST 2022 2022-12-08 16:11:05.919 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:10:06.0, nextRunTime=2022-12-08 16:11:05.0} 2022-12-08 16:11:05.932 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:11:05.932 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:11:05.933 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:11:06.157 INFO 42 --- [pool-ocp-schedules-17,,49b222cf9dee] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:11:06.232 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 592, operation:EXECUTE, state: RUNNING 2022-12-08 16:11:06.282 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=592, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:11:06.221+08:00, endTime=null} 2022-12-08 16:11:08.054 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:589, status:SUCCESS 2022-12-08 16:11:08.060 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:589, status:SUCCESS 2022-12-08 16:11:08.061 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:08.065 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:08.160 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:11:08.166 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:11:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:11:08.807 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:11:08.802917+08:00, lastProcessTime=2022-12-08T16:10:58.801631+08:00 2022-12-08 16:11:08.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:11:08.802917+08:00, resultsCount=0 2022-12-08 16:11:08.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:11:08.802917+08:00, resultsCount=0 2022-12-08 16:11:08.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:11:08.802917+08:00 2022-12-08 16:11:09.162 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:10.026 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:11:10.891 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:11.066 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:11.068 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:11:11.069 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:11.598 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:11.665 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:11:12.211 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:11:12.266 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:11:12.267 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:11:12.746 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:13.462 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:11:14.064 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:11:14.064 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:11:14.070 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:14.074 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:14.560 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:11:14.874 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:11:15.573 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:11:16.157 INFO 42 --- [pool-ocp-schedules-14,,f32f740d169a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:11:16.794 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:11:16.804 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:11:17.074 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:17.078 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:17.180 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:11:18.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:11:18.793579+08:00, lastProcessTime=2022-12-08T16:11:08.802917+08:00 2022-12-08 16:11:18.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:11:18.793579+08:00, resultsCount=0 2022-12-08 16:11:18.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:11:18.793579+08:00, resultsCount=0 2022-12-08 16:11:18.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:11:18.793579+08:00 2022-12-08 16:11:19.046 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:19.455 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:11:20.079 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:20.083 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:20.216 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:11:20.233 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:11:20.234 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:11:20.357 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:21.0, nextRun=2022-12-08 16:11:20.0, currentDate=Thu Dec 08 16:11:20 CST 2022 2022-12-08 16:11:20.358 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:10:21.0, nextRunTime=2022-12-08 16:11:20.0} 2022-12-08 16:11:20.377 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:11:20.378 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:11:20.378 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:11:21.537 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 593, operation:EXECUTE, state: RUNNING 2022-12-08 16:11:21.687 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:21.742 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:11:21.762 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=593, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:11:21.526+08:00, endTime=null} 2022-12-08 16:11:22.233 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:11:22.234 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:11:22.564 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:11:22.762 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T16:05:22.508, end=2022-12-08T16:10:22.727} 2022-12-08 16:11:22.762 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T16:05:22.477, end=2022-12-08T16:10:22.727} 2022-12-08 16:11:22.800 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 16:11:22.800 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 16:11:22.885 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:23.084 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:23.089 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:23.274 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:590, status:SUCCESS 2022-12-08 16:11:23.281 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:590, status:SUCCESS 2022-12-08 16:11:23.688 INFO 42 --- [pool-ocp-schedules-16,,25ac28b0fd65] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:11:23.688 INFO 42 --- [pool-ocp-schedules-16,,25ac28b0fd65] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:11:24.577 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:11:24.584 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:11:25.170 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:25.0, nextRun=2022-12-08 16:11:25.0, currentDate=Thu Dec 08 16:11:25 CST 2022 2022-12-08 16:11:25.171 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:10:25.0, nextRunTime=2022-12-08 16:11:25.0} 2022-12-08 16:11:25.212 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:11:25.213 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:11:25.213 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:11:25.352 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:25.874 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 594, operation:EXECUTE, state: RUNNING 2022-12-08 16:11:26.090 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:26.159 INFO 42 --- [pool-ocp-schedules-1,,0137dbd34bfd] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:11:26.262 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:26.688 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=594, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:11:25.862+08:00, endTime=null} 2022-12-08 16:11:26.705 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:27.066 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:11:28.305 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:591, status:SUCCESS 2022-12-08 16:11:28.311 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:591, status:SUCCESS 2022-12-08 16:11:28.488 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:11:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:11:28.803 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:11:28.799284+08:00, lastProcessTime=2022-12-08T16:11:18.793579+08:00 2022-12-08 16:11:28.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:11:28.799284+08:00, resultsCount=0 2022-12-08 16:11:28.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:11:28.799284+08:00, resultsCount=0 2022-12-08 16:11:28.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:11:28.799284+08:00 2022-12-08 16:11:29.263 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:29.267 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:29.280 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:11:29.281 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:11:30.059 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:11:30.060 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:11:30.265 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:11:30.697 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:31.0, nextRun=2022-12-08 16:11:30.0, currentDate=Thu Dec 08 16:11:30 CST 2022 2022-12-08 16:11:30.698 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:10:31.0, nextRunTime=2022-12-08 16:11:30.0} 2022-12-08 16:11:30.721 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:11:30.788 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:11:01.0, nextRun=2022-12-08 16:11:30.0, currentDate=Thu Dec 08 16:11:30 CST 2022 2022-12-08 16:11:30.789 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:11:01.0, nextRunTime=2022-12-08 16:11:30.0} 2022-12-08 16:11:30.806 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:11:30.808 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:11:30.808 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:11:31.753 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:31.814 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:11:31.826 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 595, operation:EXECUTE, state: RUNNING 2022-12-08 16:11:31.866 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=595, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:11:31.814+08:00, endTime=null} 2022-12-08 16:11:32.268 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:32.274 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:32.589 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:11:33.139 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:11:33.146 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:11:33.168 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:33.326 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:592, status:SUCCESS 2022-12-08 16:11:33.333 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:592, status:SUCCESS 2022-12-08 16:11:35.275 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:35.279 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:35.485 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:36.160 INFO 42 --- [pool-ocp-schedules-1,,2f094dc7c22f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:11:38.280 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:38.284 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:11:38.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:11:38.795028+08:00, lastProcessTime=2022-12-08T16:11:28.799284+08:00 2022-12-08 16:11:38.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:11:38.795028+08:00, resultsCount=0 2022-12-08 16:11:38.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:11:38.795028+08:00, resultsCount=0 2022-12-08 16:11:38.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:11:38.795028+08:00 2022-12-08 16:11:40.190 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:11:40.209 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=19ms, period=120000ms 2022-12-08 16:11:40.309 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:11:41.285 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:41.290 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:41.781 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:41.847 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:11:42.901 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:11:43.280 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:43.586 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 16:11:43.677 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:11:43.767 INFO 42 --- [pool-ocp-schedules-1,,544e6368ddbe] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:11:43.768 INFO 42 --- [pool-ocp-schedules-1,,544e6368ddbe] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:11:44.291 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:44.297 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:44.626 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:11:45.127 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:11:45.187 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:08:44+08:00, updateTime=2022-12-08T16:11:14+08:00, expireTime=null, isLeader=false} 2022-12-08 16:11:45.195 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 16:11:45.471 INFO 42 --- [pool-ocp-schedules-16,,a3c2e02fbc45] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:11:45.516 INFO 42 --- [pool-ocp-schedules-16,,a3c2e02fbc45] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:11:45.611 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:11:45.719 INFO 42 --- [pool-ocp-schedules-18,,c8b950065632] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:11:45.759 INFO 42 --- [pool-ocp-schedules-1,,3b37bbee2e4c] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:11:45.760 INFO 42 --- [pool-ocp-schedules-1,,3b37bbee2e4c] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:11:46.161 INFO 42 --- [pool-ocp-schedules-19,,53d79a2c9b0c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:11:46.253 INFO 42 --- [pool-ocp-schedules-12,,86038896989c] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:11:47.298 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:47.303 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:48.699 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:11:48.717 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:11:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:11:48.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:11:48.798963+08:00, lastProcessTime=2022-12-08T16:11:38.795028+08:00 2022-12-08 16:11:48.889 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:11:48.798963+08:00, resultsCount=0 2022-12-08 16:11:48.890 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:11:48.798963+08:00, resultsCount=0 2022-12-08 16:11:48.890 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:11:48.798963+08:00 2022-12-08 16:11:50.304 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:50.309 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:50.494 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:11:51.274 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:51.799 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:52.107 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:11:52.218 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:52.221 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:11:52.967 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:11:53.310 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:53.314 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:53.372 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:11:54.603 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:11:54.604 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:11:54.841 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:11:54.842 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:11:56.162 INFO 42 --- [pool-ocp-schedules-1,,84b0a263cebd] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:11:56.315 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:56.319 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:11:57.737 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:11:57.743 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:11:57.908 INFO 42 --- [pool-ocp-schedules-17,,0b9e8d3b5db7] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:11:57.944 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:58.015 INFO 42 --- [pool-ocp-schedules-2,,22ac42f64415] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:11:58.015 INFO 42 --- [pool-ocp-schedules-6,,3d6a3cd6f197] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:11:58.016 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:11:58.365 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:11:58.515 INFO 42 --- [pool-ocp-schedules-20,,814bfc890e01] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:11:58.516 INFO 42 --- [pool-ocp-schedules-20,,814bfc890e01] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:11:58.516 INFO 42 --- [pool-ocp-schedules-20,,814bfc890e01] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:11:58.647 INFO 42 --- [pool-prometheus-cache-monitor1,,c6b772deb4b9] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:11:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,c6b772deb4b9] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:11:58.739 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:11:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:11:58.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:11:58.794675+08:00, lastProcessTime=2022-12-08T16:11:48.798963+08:00 2022-12-08 16:11:58.890 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:11:58.794675+08:00, resultsCount=0 2022-12-08 16:11:58.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:11:58.794675+08:00, resultsCount=0 2022-12-08 16:11:58.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:11:58.794675+08:00 2022-12-08 16:11:59.320 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:11:59.325 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:00.004 INFO 42 --- [pool-ocp-schedules-14,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 16:12:00.577 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:12:00.996 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:01.0, nextRun=2022-12-08 16:12:00.0, currentDate=Thu Dec 08 16:12:00 CST 2022 2022-12-08 16:12:00.997 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:10:01.0, nextRunTime=2022-12-08 16:12:00.0} 2022-12-08 16:12:01.019 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:12:01.061 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:01.062 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:01.096 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:01.096 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:01.098 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:11:01.0, nextRun=2022-12-08 16:12:00.0, currentDate=Thu Dec 08 16:12:01 CST 2022 2022-12-08 16:12:01.099 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:11:01.0, nextRunTime=2022-12-08 16:12:00.0} 2022-12-08 16:12:01.113 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:12:01.113 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:12:01.113 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:12:01.205 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:11:01.0, nextRun=2022-12-08 16:12:00.0, currentDate=Thu Dec 08 16:12:01 CST 2022 2022-12-08 16:12:01.206 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:11:01.0, nextRunTime=2022-12-08 16:12:00.0} 2022-12-08 16:12:01.228 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:12:01.229 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:12:01.229 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:12:01.564 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:11:01.0, nextRun=2022-12-08 16:12:00.0, currentDate=Thu Dec 08 16:12:01 CST 2022 2022-12-08 16:12:01.565 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:11:01.0, nextRunTime=2022-12-08 16:12:00.0} 2022-12-08 16:12:01.591 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:12:01.591 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:12:01.591 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:12:01.616 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 596, operation:EXECUTE, state: RUNNING 2022-12-08 16:12:01.644 INFO 42 --- [http-nio-8080-exec-10,0ff60924f3e745e7,85b548a45e7e] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/clusters?page=1&size=10, client=192.168.28.1, traceId=0ff60924f3e745e7, method=PaginatedResponse com.alipay.ocp.server.controller.ObproxyController.listObproxyClusters(Pageable,String), args=Page request [number: 0, size 10, sort: id: ASC],] 2022-12-08 16:12:01.644 INFO 42 --- [http-nio-8080-exec-5,8850a54817564abb,e35d4e97e774] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=ODP&type=TOP, client=192.168.28.1, traceId=8850a54817564abb, method=PaginatedResponse com.alipay.ocp.server.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 2000, sort: id: ASC],TOP,ODP,] 2022-12-08 16:12:01.663 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:11:31.0, nextRun=2022-12-08 16:12:00.0, currentDate=Thu Dec 08 16:12:01 CST 2022 2022-12-08 16:12:01.663 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:11:31.0, nextRunTime=2022-12-08 16:12:00.0} 2022-12-08 16:12:01.688 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:12:01.688 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:12:01.689 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:12:01.690 INFO 42 --- [http-nio-8080-exec-10,0ff60924f3e745e7,85b548a45e7e] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/clusters client=192.168.28.1, traceId=0ff60924f3e745e7, duration=50 ms] 2022-12-08 16:12:01.712 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=596, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:12:01.603+08:00, endTime=null} 2022-12-08 16:12:01.737 INFO 42 --- [http-nio-8080-exec-5,8850a54817564abb,e35d4e97e774] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=192.168.28.1, traceId=8850a54817564abb, duration=102 ms] 2022-12-08 16:12:01.770 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:11:02.0, nextRun=2022-12-08 16:12:00.0, currentDate=Thu Dec 08 16:12:01 CST 2022 2022-12-08 16:12:01.771 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:11:02.0, nextRunTime=2022-12-08 16:12:00.0} 2022-12-08 16:12:01.775 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 597, operation:EXECUTE, state: RUNNING 2022-12-08 16:12:01.802 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:12:01.802 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:12:01.802 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:12:01.824 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=597, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:12:01.759+08:00, endTime=null} 2022-12-08 16:12:02.269 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:02.277 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:12:02.331 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:02.343 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:02.469 INFO 42 --- [http-nio-8080-exec-2,1021e102458d4351,f9fe63297317] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=current_session_server&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=1021e102458d4351, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,current_session_server,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:02.482 INFO 42 --- [http-nio-8080-exec-9,e713f7374984489b,81b38b48012c] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=request_total&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=e713f7374984489b, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,request_total,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:02.483 INFO 42 --- [http-nio-8080-exec-4,be88b40b249f4f02,e49d649c8c5f] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=transaction_total&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=be88b40b249f4f02, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,transaction_total,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:02.482 INFO 42 --- [http-nio-8080-exec-3,3c5f5bd6b9a04e2b,4245c2ff786c] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=current_session_client&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=3c5f5bd6b9a04e2b, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,current_session_client,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:02.540 INFO 42 --- [http-nio-8080-exec-4,be88b40b249f4f02,e49d649c8c5f] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:02.546 INFO 42 --- [http-nio-8080-exec-3,3c5f5bd6b9a04e2b,4245c2ff786c] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:02.549 INFO 42 --- [http-nio-8080-exec-2,1021e102458d4351,f9fe63297317] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:02.552 INFO 42 --- [http-nio-8080-exec-9,e713f7374984489b,81b38b48012c] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:02.621 INFO 42 --- [http-nio-8080-exec-4,be88b40b249f4f02,e49d649c8c5f] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:02.622 INFO 42 --- [http-nio-8080-exec-2,1021e102458d4351,f9fe63297317] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:02.623 INFO 42 --- [http-nio-8080-exec-3,3c5f5bd6b9a04e2b,4245c2ff786c] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:02.628 INFO 42 --- [http-nio-8080-exec-9,e713f7374984489b,81b38b48012c] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,64790ebc98c0] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487180, interval=60 2022-12-08 16:12:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,64790ebc98c0] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487122, count=0, elapsed=1668816635513 2022-12-08 16:12:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,d700adc89482] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487180, interval=60 2022-12-08 16:12:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,d700adc89482] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487122, count=0, elapsed=1668816635518 2022-12-08 16:12:02.681 INFO 42 --- [http-nio-8080-exec-2,1021e102458d4351,f9fe63297317] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=1021e102458d4351, duration=686 ms] 2022-12-08 16:12:02.681 INFO 42 --- [http-nio-8080-exec-3,3c5f5bd6b9a04e2b,4245c2ff786c] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=3c5f5bd6b9a04e2b, duration=713 ms] 2022-12-08 16:12:02.681 INFO 42 --- [http-nio-8080-exec-9,e713f7374984489b,81b38b48012c] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=e713f7374984489b, duration=699 ms] 2022-12-08 16:12:02.681 INFO 42 --- [http-nio-8080-exec-4,be88b40b249f4f02,e49d649c8c5f] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=be88b40b249f4f02, duration=721 ms] 2022-12-08 16:12:02.951 INFO 42 --- [http-nio-8080-exec-7,ea701e8411e64570,1d530b690d25] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=current_session_client&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=ea701e8411e64570, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,current_session_client,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:02.977 INFO 42 --- [http-nio-8080-exec-7,ea701e8411e64570,1d530b690d25] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:03.002 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:12:03.008 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 598, operation:EXECUTE, state: RUNNING 2022-12-08 16:12:03.020 INFO 42 --- [http-nio-8080-exec-7,ea701e8411e64570,1d530b690d25] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:03.020 INFO 42 --- [http-nio-8080-exec-8,a0f41f7115974dea,1f7129b9c5c9] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=transaction_total&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=a0f41f7115974dea, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,transaction_total,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:03.045 INFO 42 --- [http-nio-8080-exec-8,a0f41f7115974dea,1f7129b9c5c9] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:03.055 INFO 42 --- [http-nio-8080-exec-6,4bbe2c01f92e4db4,17e00fdb0959] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=current_session_server&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=4bbe2c01f92e4db4, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,current_session_server,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:03.062 INFO 42 --- [http-nio-8080-exec-7,ea701e8411e64570,1d530b690d25] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=ea701e8411e64570, duration=128 ms] 2022-12-08 16:12:03.067 INFO 42 --- [http-nio-8080-exec-8,a0f41f7115974dea,1f7129b9c5c9] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:03.071 INFO 42 --- [http-nio-8080-exec-6,4bbe2c01f92e4db4,17e00fdb0959] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:03.097 INFO 42 --- [http-nio-8080-exec-6,4bbe2c01f92e4db4,17e00fdb0959] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:03.102 INFO 42 --- [http-nio-8080-exec-8,a0f41f7115974dea,1f7129b9c5c9] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=a0f41f7115974dea, duration=97 ms] 2022-12-08 16:12:03.427 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:03.435 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=598, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:12:02.973+08:00, endTime=null} 2022-12-08 16:12:03.449 INFO 42 --- [http-nio-8080-exec-6,4bbe2c01f92e4db4,17e00fdb0959] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=4bbe2c01f92e4db4, duration=411 ms] 2022-12-08 16:12:03.536 INFO 42 --- [http-nio-8080-exec-1,29a5ee8d0c734b87,4625ea0b97bd] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=request_total&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=29a5ee8d0c734b87, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,request_total,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:03.554 INFO 42 --- [http-nio-8080-exec-1,29a5ee8d0c734b87,4625ea0b97bd] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:03.576 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 599, operation:EXECUTE, state: RUNNING 2022-12-08 16:12:03.581 INFO 42 --- [http-nio-8080-exec-1,29a5ee8d0c734b87,4625ea0b97bd] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:03.605 INFO 42 --- [http-nio-8080-exec-1,29a5ee8d0c734b87,4625ea0b97bd] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=29a5ee8d0c734b87, duration=80 ms] 2022-12-08 16:12:03.614 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:593, status:SUCCESS 2022-12-08 16:12:03.623 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:593, status:SUCCESS 2022-12-08 16:12:03.645 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:12:03.651 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:12:03.669 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=599, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:12:03.554+08:00, endTime=null} 2022-12-08 16:12:03.732 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 600, operation:EXECUTE, state: RUNNING 2022-12-08 16:12:03.748 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:594, status:SUCCESS 2022-12-08 16:12:03.754 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:594, status:SUCCESS 2022-12-08 16:12:03.777 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=600, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:12:03.723+08:00, endTime=null} 2022-12-08 16:12:03.833 INFO 42 --- [pool-ocp-schedules-1,,ea4f455165d2] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:12:03.833 INFO 42 --- [pool-ocp-schedules-1,,ea4f455165d2] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:12:04.125 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:04.175 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:04.266 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:12:04.398 INFO 42 --- [http-nio-8080-exec-10,b0ca6d2d9d6a4b56,7d4d64cbdbed] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/clusters?page=1&size=10, client=192.168.28.1, traceId=b0ca6d2d9d6a4b56, method=PaginatedResponse com.alipay.ocp.server.controller.ObproxyController.listObproxyClusters(Pageable,String), args=Page request [number: 0, size 10, sort: id: ASC],] 2022-12-08 16:12:04.406 INFO 42 --- [http-nio-8080-exec-10,b0ca6d2d9d6a4b56,7d4d64cbdbed] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/clusters client=192.168.28.1, traceId=b0ca6d2d9d6a4b56, duration=12 ms] 2022-12-08 16:12:04.850 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 15:12:05.0, nextRun=2022-12-08 16:12:04.0, currentDate=Thu Dec 08 16:12:04 CST 2022 2022-12-08 16:12:04.850 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1, name=Partitioning daemon, templateName=PartitioningDaemonSchedule, scheduleRule=4 12 */1 * * *, lastRunTime=2022-12-08 15:12:05.0, nextRunTime=2022-12-08 16:12:04.0} 2022-12-08 16:12:04.870 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Partition rollover daemon, nodeCount=1, taskCount=1 2022-12-08 16:12:04.870 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:12:04.870 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Partition rollover daemon, taskDefinitionId=1, state=RUNNING, operation=EXECUTE} 2022-12-08 16:12:05.032 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:595, status:SUCCESS 2022-12-08 16:12:05.039 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:595, status:SUCCESS 2022-12-08 16:12:05.112 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:596, status:SUCCESS 2022-12-08 16:12:05.118 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:596, status:SUCCESS 2022-12-08 16:12:05.229 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:597, status:SUCCESS 2022-12-08 16:12:05.235 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:597, status:SUCCESS 2022-12-08 16:12:05.344 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:05.349 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:05.872 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 601, operation:EXECUTE, state: RUNNING 2022-12-08 16:12:05.921 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=601, name=Partition rollover daemon, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.partitioning.PartitioningDaemonSchedule$Task, seriesId=0, startTime=2022-12-08T16:12:05.861+08:00, endTime=null} 2022-12-08 16:12:06.163 INFO 42 --- [pool-ocp-schedules-3,,f652b35ab0cb] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:12:06.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:11:06.0, nextRun=2022-12-08 16:12:05.0, currentDate=Thu Dec 08 16:12:06 CST 2022 2022-12-08 16:12:06.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:11:06.0, nextRunTime=2022-12-08 16:12:05.0} 2022-12-08 16:12:06.259 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:12:06.260 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:12:06.260 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:12:06.429 INFO 42 --- [pool-ocp-schedules-14,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 16:12:06.835 INFO 42 --- [pool-ocp-schedules-14,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 16:12:06.949 INFO 42 --- [pool-ocp-schedules-14,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 16:12:07.018 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 602, operation:EXECUTE, state: RUNNING 2022-12-08 16:12:07.046 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=602, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:12:06.994+08:00, endTime=null} 2022-12-08 16:12:07.206 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:07.206 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:07.225 INFO 42 --- [pool-ocp-schedules-14,,] o.s.boot.SpringApplication : Started application in 7.149 seconds (JVM running for 3124.071) 2022-12-08 16:12:07.255 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:07.255 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:07.592 INFO 42 --- [http-nio-8080-exec-5,26d58bd1f5b84707,f705e655c017] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=entry_total_table&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=26d58bd1f5b84707, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,entry_total_table,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:07.605 INFO 42 --- [http-nio-8080-exec-3,1707576e08604998,af4d07a59e6b] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=request_cost&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=1707576e08604998, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,request_cost,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:07.646 INFO 42 --- [http-nio-8080-exec-5,26d58bd1f5b84707,f705e655c017] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:07.653 INFO 42 --- [http-nio-8080-exec-4,39f67c6db2f54209,917494751eeb] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=request_byte&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=39f67c6db2f54209, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,request_byte,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:07.677 INFO 42 --- [http-nio-8080-exec-3,1707576e08604998,af4d07a59e6b] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:07.685 INFO 42 --- [http-nio-8080-exec-5,26d58bd1f5b84707,f705e655c017] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:07.692 INFO 42 --- [http-nio-8080-exec-4,39f67c6db2f54209,917494751eeb] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:07.709 INFO 42 --- [http-nio-8080-exec-3,1707576e08604998,af4d07a59e6b] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:07.716 INFO 42 --- [http-nio-8080-exec-4,39f67c6db2f54209,917494751eeb] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:07.739 INFO 42 --- [http-nio-8080-exec-5,26d58bd1f5b84707,f705e655c017] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=26d58bd1f5b84707, duration=164 ms] 2022-12-08 16:12:07.754 INFO 42 --- [http-nio-8080-exec-3,1707576e08604998,af4d07a59e6b] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=1707576e08604998, duration=185 ms] 2022-12-08 16:12:07.766 INFO 42 --- [http-nio-8080-exec-4,39f67c6db2f54209,917494751eeb] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=39f67c6db2f54209, duration=123 ms] 2022-12-08 16:12:08.349 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:08.586 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:08.620 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:599, status:SUCCESS 2022-12-08 16:12:08.627 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:599, status:SUCCESS 2022-12-08 16:12:08.646 INFO 42 --- [http-nio-8080-exec-2,39ca837b7e0543ed,31b244f2f69b] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=entry_total_table&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=39ca837b7e0543ed, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,entry_total_table,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:08.673 INFO 42 --- [http-nio-8080-exec-2,39ca837b7e0543ed,31b244f2f69b] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:08.689 INFO 42 --- [http-nio-8080-exec-2,39ca837b7e0543ed,31b244f2f69b] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:08.723 INFO 42 --- [http-nio-8080-exec-2,39ca837b7e0543ed,31b244f2f69b] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=39ca837b7e0543ed, duration=90 ms] 2022-12-08 16:12:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:12:08.840 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:12:08.836739+08:00, lastProcessTime=2022-12-08T16:11:58.794675+08:00 2022-12-08 16:12:08.860 INFO 42 --- [http-nio-8080-exec-9,6fb4c1f463784faa,5bb80ae7dc31] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=request_byte&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=6fb4c1f463784faa, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,request_byte,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:08.893 INFO 42 --- [http-nio-8080-exec-9,6fb4c1f463784faa,5bb80ae7dc31] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:08.922 INFO 42 --- [http-nio-8080-exec-9,6fb4c1f463784faa,5bb80ae7dc31] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:08.928 INFO 42 --- [pool-ocp-schedules-14,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T16:12:08.928+08:00 2022-12-08 16:12:08.948 INFO 42 --- [http-nio-8080-exec-8,d3d8b1afab254e2b,b302fac9b0a7] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A11%3A46.872%2B08%3A00&endTime=2022-12-08T16%3A11%3A46.872%2B08%3A00&interval=60&metrics=request_cost&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=d3d8b1afab254e2b, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:11:46.872+08:00,2022-12-08T16:11:46.872+08:00,request_cost,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:12:08.966 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:12:08.836739+08:00, resultsCount=0 2022-12-08 16:12:08.967 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:12:08.836739+08:00, resultsCount=0 2022-12-08 16:12:08.967 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:12:08.836739+08:00 2022-12-08 16:12:08.982 INFO 42 --- [http-nio-8080-exec-8,d3d8b1afab254e2b,b302fac9b0a7] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:12:08.991 INFO 42 --- [http-nio-8080-exec-9,6fb4c1f463784faa,5bb80ae7dc31] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=6fb4c1f463784faa, duration=141 ms] 2022-12-08 16:12:09.001 INFO 42 --- [http-nio-8080-exec-8,d3d8b1afab254e2b,b302fac9b0a7] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:12:09.278 INFO 42 --- [http-nio-8080-exec-8,d3d8b1afab254e2b,b302fac9b0a7] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=d3d8b1afab254e2b, duration=339 ms] 2022-12-08 16:12:09.467 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:12:09.473 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:12:09.878 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:598, status:SUCCESS 2022-12-08 16:12:09.884 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:598, status:SUCCESS 2022-12-08 16:12:10.263 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:10.353 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:10.550 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:12:10.644 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:12:11.586 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:11.591 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:11.954 INFO 42 --- [http-nio-8080-exec-4,e558d8345ac94433,e653535013a6] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/regions?null, client=192.168.28.1, traceId=e558d8345ac94433, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listRegions(Pageable), args=Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:12:11.967 INFO 42 --- [http-nio-8080-exec-10,a26861972af04c13,62fa780c0391] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/hostTypes?null, client=192.168.28.1, traceId=a26861972af04c13, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listHostTypes(Pageable), args=Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:12:11.968 INFO 42 --- [http-nio-8080-exec-3,62b5600ac21d4d0d,d55c42a41a03] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/idcs?null, client=192.168.28.1, traceId=62b5600ac21d4d0d, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listIdcs(Pageable,Boolean), args=Page request [number: 0, size 2000, sort: id: DESC],false,] 2022-12-08 16:12:11.984 INFO 42 --- [http-nio-8080-exec-8,988b18d3db0240bb,1cc845fa1c13] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/hosts?page=1&size=10, client=192.168.28.1, traceId=988b18d3db0240bb, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listHosts(List,String,List,List,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2022-12-08 16:12:12.034 WARN 42 --- [http-nio-8080-exec-8,988b18d3db0240bb,1cc845fa1c13] o.h.h.internal.ast.QueryTranslatorImpl : HHH000104: firstResult/maxResults specified with collection fetch; applying in memory! 2022-12-08 16:12:12.037 INFO 42 --- [http-nio-8080-exec-3,62b5600ac21d4d0d,d55c42a41a03] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/idcs client=192.168.28.1, traceId=62b5600ac21d4d0d, duration=93 ms] 2022-12-08 16:12:12.070 INFO 42 --- [http-nio-8080-exec-10,a26861972af04c13,62fa780c0391] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hostTypes client=192.168.28.1, traceId=a26861972af04c13, duration=124 ms] 2022-12-08 16:12:12.115 INFO 42 --- [http-nio-8080-exec-4,e558d8345ac94433,e653535013a6] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/regions client=192.168.28.1, traceId=e558d8345ac94433, duration=170 ms] 2022-12-08 16:12:12.185 INFO 42 --- [http-nio-8080-exec-8,988b18d3db0240bb,1cc845fa1c13] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hosts client=192.168.28.1, traceId=988b18d3db0240bb, duration=212 ms] 2022-12-08 16:12:12.343 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:12.358 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:12:13.266 INFO 42 --- [http-nio-8080-exec-2,331daf0dc1194215,ce14e8b67f9b] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/tenants?null, client=192.168.28.1, traceId=331daf0dc1194215, method=PaginatedResponse com.alipay.ocp.server.controller.ObTenantController.listAllTenants(Pageable,String,List,Boolean,String,Boolean,List), args=Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:12:13.290 INFO 42 --- [http-nio-8080-exec-2,331daf0dc1194215,ce14e8b67f9b] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/tenants client=192.168.28.1, traceId=331daf0dc1194215, duration=28 ms] 2022-12-08 16:12:13.377 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:13.377 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:13.423 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:12:13.442 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:13.442 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:13.526 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:13.905 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:12:14.471 INFO 42 --- [http-nio-8080-exec-6,5ee220691eb64f0e,918f927c6d02] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=5ee220691eb64f0e, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:12:14.517 INFO 42 --- [http-nio-8080-exec-6,5ee220691eb64f0e,918f927c6d02] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=5ee220691eb64f0e, duration=48 ms] 2022-12-08 16:12:14.592 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:14.596 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:14.677 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:12:15.285 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:12:15.710 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:12:15.736 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:12:15.743 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:12:16.164 INFO 42 --- [pool-ocp-schedules-2,,bcf4e7b33bad] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:12:16.540 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:16.541 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:16.827 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:12:16.919 INFO 42 --- [http-nio-8080-exec-7,f152549cc5534b83,04a4625f5ec0] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/hosts?null, client=192.168.28.1, traceId=f152549cc5534b83, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listHosts(List,String,List,List,Pageable), args=Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:12:16.933 WARN 42 --- [http-nio-8080-exec-7,f152549cc5534b83,04a4625f5ec0] o.h.h.internal.ast.QueryTranslatorImpl : HHH000104: firstResult/maxResults specified with collection fetch; applying in memory! 2022-12-08 16:12:16.956 INFO 42 --- [http-nio-8080-exec-7,f152549cc5534b83,04a4625f5ec0] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hosts client=192.168.28.1, traceId=f152549cc5534b83, duration=39 ms] 2022-12-08 16:12:17.006 INFO 42 --- [http-nio-8080-exec-1,eb70478b0fe3480d,fd11ee088d11] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms?page=1&size=10&isSubscribedByMe=false&collapsed=false, client=192.168.28.1, traceId=eb70478b0fe3480d, method=ResponseEntity com.alipay.ocp.server.controller.AlarmController.fetchAlarms(Integer,Integer,String,String,String,Integer,String,String,String,String,String,String,String,String,OffsetDateTime,OffsetDateTime,Boolean,String,String), args=1,10,false,] 2022-12-08 16:12:17.521 INFO 42 --- [http-nio-8080-exec-1,eb70478b0fe3480d,fd11ee088d11] c.a.o.s.a.service.OcpAlarmSearchService : sortedAlarm size=0, alarmHistory size=0 2022-12-08 16:12:17.538 INFO 42 --- [http-nio-8080-exec-1,eb70478b0fe3480d,fd11ee088d11] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms client=192.168.28.1, traceId=eb70478b0fe3480d, duration=610 ms] 2022-12-08 16:12:17.597 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:17.601 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:12:18.840 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:12:18.838660+08:00, lastProcessTime=2022-12-08T16:12:08.836739+08:00 2022-12-08 16:12:18.971 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:12:18.838660+08:00, resultsCount=0 2022-12-08 16:12:18.971 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:12:18.838660+08:00, resultsCount=0 2022-12-08 16:12:18.972 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:12:18.838660+08:00 2022-12-08 16:12:19.600 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:19.600 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:19.600 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:19.601 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:19.984 INFO 42 --- [http-nio-8080-exec-3,49d9337eefd4467f,def0ad8f277b] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/properties?null, client=192.168.28.1, traceId=49d9337eefd4467f, method=PaginatedResponse com.alipay.ocp.server.controller.PropertyController.findNonFatalProperties(String,Pageable), args=Page request [number: 0, size 2000, sort: key: ASC],] 2022-12-08 16:12:20.099 INFO 42 --- [http-nio-8080-exec-3,49d9337eefd4467f,def0ad8f277b] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/properties client=192.168.28.1, traceId=49d9337eefd4467f, duration=119 ms] 2022-12-08 16:12:20.589 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:11:20.0, nextRun=2022-12-08 16:12:20.0, currentDate=Thu Dec 08 16:12:20 CST 2022 2022-12-08 16:12:20.590 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:11:20.0, nextRunTime=2022-12-08 16:12:20.0} 2022-12-08 16:12:20.601 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:20.605 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:20.608 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:12:20.608 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:12:20.608 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:12:20.671 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:12:20.800 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 603, operation:EXECUTE, state: RUNNING 2022-12-08 16:12:21.142 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=603, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:12:20.789+08:00, endTime=null} 2022-12-08 16:12:21.704 INFO 42 --- [http-nio-8080-exec-4,b0f26183c57e4488,a309092196b7] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/users?page=1&size=10, client=192.168.28.1, traceId=b0f26183c57e4488, method=PaginatedResponse com.alipay.ocp.server.controller.IamController.listUsers(Pageable,String), args=Page request [number: 0, size 10, sort: id: DESC],] 2022-12-08 16:12:21.775 INFO 42 --- [http-nio-8080-exec-4,b0f26183c57e4488,a309092196b7] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/users client=192.168.28.1, traceId=b0f26183c57e4488, duration=79 ms] 2022-12-08 16:12:22.119 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:12:22.126 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:12:22.169 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:600, status:SUCCESS 2022-12-08 16:12:22.175 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:600, status:SUCCESS 2022-12-08 16:12:22.432 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:22.435 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:12:22.780 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:22.787 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:22.845 INFO 42 --- [http-nio-8080-exec-1,948351c256dd4869,cda138a08c6e] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=948351c256dd4869, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:12:22.892 INFO 42 --- [http-nio-8080-exec-1,948351c256dd4869,cda138a08c6e] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=948351c256dd4869, duration=50 ms] 2022-12-08 16:12:23.232 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:12:23.526 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:12:23.606 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:23.610 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:23.905 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:24.926 INFO 42 --- [pool-ocp-schedules-18,,16d5aefe1098] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:12:24.927 INFO 42 --- [pool-ocp-schedules-18,,16d5aefe1098] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:12:26.049 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:26.050 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:26.051 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:26.051 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:26.165 INFO 42 --- [pool-ocp-schedules-9,,ed6b3c69e75e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:12:26.530 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:11:25.0, nextRun=2022-12-08 16:12:25.0, currentDate=Thu Dec 08 16:12:26 CST 2022 2022-12-08 16:12:26.530 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:11:25.0, nextRunTime=2022-12-08 16:12:25.0} 2022-12-08 16:12:26.568 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:12:26.568 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:12:26.568 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:12:26.611 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:26.616 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:27.290 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 604, operation:EXECUTE, state: RUNNING 2022-12-08 16:12:27.353 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=604, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:12:27.277+08:00, endTime=null} 2022-12-08 16:12:28.530 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:12:28.536 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:12:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:12:28.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:12:28.801292+08:00, lastProcessTime=2022-12-08T16:12:18.838660+08:00 2022-12-08 16:12:28.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:12:28.801292+08:00, resultsCount=0 2022-12-08 16:12:28.915 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:12:28.801292+08:00, resultsCount=0 2022-12-08 16:12:28.916 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:12:28.801292+08:00 2022-12-08 16:12:29.132 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:29.135 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:29.212 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:12:29.264 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:601, status:SUCCESS 2022-12-08 16:12:29.274 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:601, status:SUCCESS 2022-12-08 16:12:29.337 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:12:29.617 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:29.621 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:30.720 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:12:31.020 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:11:31.0, nextRun=2022-12-08 16:12:30.0, currentDate=Thu Dec 08 16:12:31 CST 2022 2022-12-08 16:12:31.020 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:11:31.0, nextRunTime=2022-12-08 16:12:30.0} 2022-12-08 16:12:31.041 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:12:31.125 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:02.0, nextRun=2022-12-08 16:12:30.0, currentDate=Thu Dec 08 16:12:31 CST 2022 2022-12-08 16:12:31.125 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:12:02.0, nextRunTime=2022-12-08 16:12:30.0} 2022-12-08 16:12:31.142 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:12:31.142 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:12:31.142 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:12:31.859 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 605, operation:EXECUTE, state: RUNNING 2022-12-08 16:12:31.967 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=605, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:12:31.842+08:00, endTime=null} 2022-12-08 16:12:32.320 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:32.320 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:32.322 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:32.322 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:32.622 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:32.626 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:32.845 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:32.850 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:12:33.564 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:602, status:SUCCESS 2022-12-08 16:12:33.569 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:602, status:SUCCESS 2022-12-08 16:12:33.584 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T16:08:32.933, end=2022-12-08T16:10:33.558} 2022-12-08 16:12:33.605 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:12:33.606 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:12:34.555 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:12:34.561 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:12:34.927 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:35.413 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:35.420 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:35.627 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:35.631 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:35.643 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:12:36.166 INFO 42 --- [pool-ocp-schedules-12,,23e4684e96ef] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:12:38.504 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:38.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:38.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:38.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:38.632 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:38.635 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:12:38.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:12:38.795032+08:00, lastProcessTime=2022-12-08T16:12:28.801292+08:00 2022-12-08 16:12:38.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:12:38.795032+08:00, resultsCount=0 2022-12-08 16:12:38.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:12:38.795032+08:00, resultsCount=0 2022-12-08 16:12:38.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:12:38.795032+08:00 2022-12-08 16:12:40.807 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:12:40.814 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:12:40.918 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:12:41.636 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:41.636 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:41.636 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:41.642 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:41.923 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:12:42.875 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:42.927 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:12:43.633 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:12:44.307 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:12:44.643 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:44.648 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:44.725 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:44.725 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:44.725 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:44.726 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:44.779 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:12:44.954 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:45.117 INFO 42 --- [pool-ocp-schedules-2,,b00b4eb508e6] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:12:45.118 INFO 42 --- [pool-ocp-schedules-2,,b00b4eb508e6] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:12:45.367 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:12:45.472 INFO 42 --- [pool-ocp-schedules-10,,130e83f0ecf7] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:12:45.502 INFO 42 --- [pool-ocp-schedules-10,,130e83f0ecf7] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:12:45.720 INFO 42 --- [pool-ocp-schedules-15,,d6940ec3c5ec] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:12:45.749 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:12:46.167 INFO 42 --- [pool-ocp-schedules-7,,298e36236375] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:12:46.258 INFO 42 --- [pool-ocp-schedules-9,,c650399330f0] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:12:47.089 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:12:47.096 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:12:47.649 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:47.668 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:47.828 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:47.828 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:48.211 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:12:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:12:48.803 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:12:48.801460+08:00, lastProcessTime=2022-12-08T16:12:38.795032+08:00 2022-12-08 16:12:48.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:12:48.801460+08:00, resultsCount=0 2022-12-08 16:12:48.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:12:48.801460+08:00, resultsCount=0 2022-12-08 16:12:48.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:12:48.801460+08:00 2022-12-08 16:12:50.669 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:50.673 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:50.904 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:50.904 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:50.932 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:50.932 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:50.963 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:12:53.149 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:53.152 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:12:53.487 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:12:53.494 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:12:53.674 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:53.678 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:53.765 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:12:53.970 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:54.218 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:12:54.614 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:12:55.118 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:12:56.168 INFO 42 --- [pool-ocp-schedules-16,,353fe81c7243] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:12:56.679 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:56.683 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:57.046 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:57.046 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:57.272 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:12:57.272 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:12:57.991 INFO 42 --- [pool-ocp-schedules-8,,154c5ea00258] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:12:58.079 INFO 42 --- [pool-ocp-schedules-16,,90199179fd2f] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:12:58.115 INFO 42 --- [pool-ocp-schedules-7,,8b1e66160447] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:12:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,9b9aeb941b8f] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:12:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,9b9aeb941b8f] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:12:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:12:58.809 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:12:58.805045+08:00, lastProcessTime=2022-12-08T16:12:48.801460+08:00 2022-12-08 16:12:58.880 INFO 42 --- [pool-ocp-schedules-14,,d60fdaa2e01b] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:12:58.881 INFO 42 --- [pool-ocp-schedules-14,,d60fdaa2e01b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:12:58.881 INFO 42 --- [pool-ocp-schedules-14,,d60fdaa2e01b] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:12:58.938 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:12:58.805045+08:00, resultsCount=0 2022-12-08 16:12:58.939 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:12:58.805045+08:00, resultsCount=0 2022-12-08 16:12:58.939 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:12:58.805045+08:00 2022-12-08 16:12:59.389 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:12:59.684 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:12:59.688 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:12:59.752 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:12:59.758 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:13:00.129 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:00.566 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:00.739 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:01.0, nextRun=2022-12-08 16:13:00.0, currentDate=Thu Dec 08 16:13:00 CST 2022 2022-12-08 16:13:00.740 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:12:01.0, nextRunTime=2022-12-08 16:13:00.0} 2022-12-08 16:13:00.759 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:13:00.759 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:13:00.760 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:13:00.843 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:13:01.230 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:01.0, nextRun=2022-12-08 16:13:00.0, currentDate=Thu Dec 08 16:13:01 CST 2022 2022-12-08 16:13:01.231 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:12:01.0, nextRunTime=2022-12-08 16:13:00.0} 2022-12-08 16:13:01.242 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:13:01.253 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:13:01.254 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:13:01.254 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:13:01.491 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:02.0, nextRun=2022-12-08 16:13:00.0, currentDate=Thu Dec 08 16:13:01 CST 2022 2022-12-08 16:13:01.492 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:12:02.0, nextRunTime=2022-12-08 16:13:00.0} 2022-12-08 16:13:01.513 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:13:01.513 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:13:01.513 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:13:01.542 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 606, operation:EXECUTE, state: RUNNING 2022-12-08 16:13:01.679 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:31.0, nextRun=2022-12-08 16:13:00.0, currentDate=Thu Dec 08 16:13:01 CST 2022 2022-12-08 16:13:01.679 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:12:31.0, nextRunTime=2022-12-08 16:13:00.0} 2022-12-08 16:13:01.680 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=606, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:13:01.530+08:00, endTime=null} 2022-12-08 16:13:01.695 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:13:01.696 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:13:01.696 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:13:01.751 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 607, operation:EXECUTE, state: RUNNING 2022-12-08 16:13:01.807 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:02.0, nextRun=2022-12-08 16:13:00.0, currentDate=Thu Dec 08 16:13:01 CST 2022 2022-12-08 16:13:01.808 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:12:02.0, nextRunTime=2022-12-08 16:13:00.0} 2022-12-08 16:13:01.823 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:13:01.824 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:13:01.824 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:13:01.844 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=607, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:13:01.739+08:00, endTime=null} 2022-12-08 16:13:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,71f21432793f] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487240, interval=60 2022-12-08 16:13:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,71f21432793f] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487182, count=0, elapsed=1668816695454 2022-12-08 16:13:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,1cc34b927c74] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487240, interval=60 2022-12-08 16:13:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,1cc34b927c74] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487182, count=0, elapsed=1668816695458 2022-12-08 16:13:02.653 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:603, status:SUCCESS 2022-12-08 16:13:02.660 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:603, status:SUCCESS 2022-12-08 16:13:02.689 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:02.694 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:02.784 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:604, status:SUCCESS 2022-12-08 16:13:02.790 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:604, status:SUCCESS 2022-12-08 16:13:03.013 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 608, operation:EXECUTE, state: RUNNING 2022-12-08 16:13:03.151 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=608, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:13:02.992+08:00, endTime=null} 2022-12-08 16:13:03.179 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:03.180 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:03.190 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:03.212 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:13:03.232 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 609, operation:EXECUTE, state: RUNNING 2022-12-08 16:13:03.325 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=609, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:13:03.219+08:00, endTime=null} 2022-12-08 16:13:03.377 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 610, operation:EXECUTE, state: RUNNING 2022-12-08 16:13:03.484 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=610, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:13:03.368+08:00, endTime=null} 2022-12-08 16:13:03.665 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:03.669 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:03.800 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:13:04.296 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:605, status:SUCCESS 2022-12-08 16:13:04.302 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:605, status:SUCCESS 2022-12-08 16:13:04.392 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:606, status:SUCCESS 2022-12-08 16:13:04.397 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:606, status:SUCCESS 2022-12-08 16:13:04.592 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:607, status:SUCCESS 2022-12-08 16:13:04.596 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:607, status:SUCCESS 2022-12-08 16:13:05.144 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:05.200 INFO 42 --- [pool-ocp-schedules-11,,b4d26a9293fa] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:13:05.201 INFO 42 --- [pool-ocp-schedules-11,,b4d26a9293fa] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:13:05.695 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:05.699 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:05.950 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:06.0, nextRun=2022-12-08 16:13:05.0, currentDate=Thu Dec 08 16:13:05 CST 2022 2022-12-08 16:13:05.950 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:12:06.0, nextRunTime=2022-12-08 16:13:05.0} 2022-12-08 16:13:05.967 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:13:05.968 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:13:05.968 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:13:06.169 INFO 42 --- [pool-ocp-schedules-18,,b5993c5787ab] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:13:06.587 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:13:06.593 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:13:06.593 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 611, operation:EXECUTE, state: RUNNING 2022-12-08 16:13:06.998 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:07.000 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=611, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:13:06.581+08:00, endTime=null} 2022-12-08 16:13:08.384 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:608, status:SUCCESS 2022-12-08 16:13:08.391 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:608, status:SUCCESS 2022-12-08 16:13:08.700 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:08.706 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:13:08.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:13:08.799152+08:00, lastProcessTime=2022-12-08T16:12:58.805045+08:00 2022-12-08 16:13:08.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:13:08.799152+08:00, resultsCount=0 2022-12-08 16:13:08.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:13:08.799152+08:00, resultsCount=0 2022-12-08 16:13:08.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:13:08.799152+08:00 2022-12-08 16:13:09.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:10.065 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:13:11.487 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:13:11.707 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:11.713 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:12.253 INFO 42 --- [http-nio-8080-exec-9,07c7ed6b986a46a7,390b7bc6fa20] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=ODP&type=TOP, client=192.168.28.1, traceId=07c7ed6b986a46a7, method=PaginatedResponse com.alipay.ocp.server.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 2000, sort: id: ASC],TOP,ODP,] 2022-12-08 16:13:12.264 INFO 42 --- [http-nio-8080-exec-5,ffd5f294aec14986,684d3c69a1b9] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/clusters?page=1&size=10, client=192.168.28.1, traceId=ffd5f294aec14986, method=PaginatedResponse com.alipay.ocp.server.controller.ObproxyController.listObproxyClusters(Pageable,String), args=Page request [number: 0, size 10, sort: id: ASC],] 2022-12-08 16:13:12.271 INFO 42 --- [http-nio-8080-exec-5,ffd5f294aec14986,684d3c69a1b9] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/clusters client=192.168.28.1, traceId=ffd5f294aec14986, duration=9 ms] 2022-12-08 16:13:12.367 INFO 42 --- [http-nio-8080-exec-9,07c7ed6b986a46a7,390b7bc6fa20] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=192.168.28.1, traceId=07c7ed6b986a46a7, duration=117 ms] 2022-12-08 16:13:12.571 INFO 42 --- [http-nio-8080-exec-10,6591af5416fe48f1,667cf2cd10a8] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A12%3A57.495%2B08%3A00&endTime=2022-12-08T16%3A12%3A57.495%2B08%3A00&interval=60&metrics=current_session_server&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=6591af5416fe48f1, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:12:57.495+08:00,2022-12-08T16:12:57.495+08:00,current_session_server,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:13:12.579 INFO 42 --- [http-nio-8080-exec-3,a827ed6fb5e74304,9156382fde4e] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A12%3A57.495%2B08%3A00&endTime=2022-12-08T16%3A12%3A57.495%2B08%3A00&interval=60&metrics=transaction_total&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=a827ed6fb5e74304, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:12:57.495+08:00,2022-12-08T16:12:57.495+08:00,transaction_total,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:13:12.589 INFO 42 --- [http-nio-8080-exec-2,2467fee3a1864262,c2908479144b] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A12%3A57.495%2B08%3A00&endTime=2022-12-08T16%3A12%3A57.495%2B08%3A00&interval=60&metrics=request_total&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=2467fee3a1864262, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:12:57.495+08:00,2022-12-08T16:12:57.495+08:00,request_total,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:13:12.593 INFO 42 --- [http-nio-8080-exec-7,390e6e835d4443d1,8473b3ce6c54] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A12%3A57.495%2B08%3A00&endTime=2022-12-08T16%3A12%3A57.495%2B08%3A00&interval=60&metrics=current_session_client&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=390e6e835d4443d1, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:12:57.495+08:00,2022-12-08T16:12:57.495+08:00,current_session_client,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:13:12.599 INFO 42 --- [http-nio-8080-exec-3,a827ed6fb5e74304,9156382fde4e] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:13:12.599 INFO 42 --- [http-nio-8080-exec-10,6591af5416fe48f1,667cf2cd10a8] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:13:12.607 INFO 42 --- [http-nio-8080-exec-2,2467fee3a1864262,c2908479144b] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:13:12.608 INFO 42 --- [http-nio-8080-exec-7,390e6e835d4443d1,8473b3ce6c54] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:13:12.618 INFO 42 --- [http-nio-8080-exec-3,a827ed6fb5e74304,9156382fde4e] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:13:12.618 INFO 42 --- [http-nio-8080-exec-10,6591af5416fe48f1,667cf2cd10a8] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:13:12.623 INFO 42 --- [http-nio-8080-exec-7,390e6e835d4443d1,8473b3ce6c54] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:13:12.623 INFO 42 --- [http-nio-8080-exec-2,2467fee3a1864262,c2908479144b] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:13:12.652 INFO 42 --- [http-nio-8080-exec-3,a827ed6fb5e74304,9156382fde4e] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=a827ed6fb5e74304, duration=86 ms] 2022-12-08 16:13:12.654 INFO 42 --- [http-nio-8080-exec-10,6591af5416fe48f1,667cf2cd10a8] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=6591af5416fe48f1, duration=96 ms] 2022-12-08 16:13:12.655 INFO 42 --- [http-nio-8080-exec-7,390e6e835d4443d1,8473b3ce6c54] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=390e6e835d4443d1, duration=72 ms] 2022-12-08 16:13:12.657 INFO 42 --- [http-nio-8080-exec-2,2467fee3a1864262,c2908479144b] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=2467fee3a1864262, duration=82 ms] 2022-12-08 16:13:12.682 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:12.683 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:13.208 INFO 42 --- [http-nio-8080-exec-6,797086aea7b642a5,081fe17d8498] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A12%3A57.495%2B08%3A00&endTime=2022-12-08T16%3A12%3A57.495%2B08%3A00&interval=60&metrics=transaction_total&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=797086aea7b642a5, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:12:57.495+08:00,2022-12-08T16:12:57.495+08:00,transaction_total,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:13:13.222 INFO 42 --- [http-nio-8080-exec-6,797086aea7b642a5,081fe17d8498] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:13:13.245 INFO 42 --- [http-nio-8080-exec-6,797086aea7b642a5,081fe17d8498] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:13:13.270 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:13.273 INFO 42 --- [http-nio-8080-exec-6,797086aea7b642a5,081fe17d8498] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=797086aea7b642a5, duration=76 ms] 2022-12-08 16:13:13.275 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:13:13.282 INFO 42 --- [http-nio-8080-exec-8,e52b81b763574f9e,6f80d7867e90] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A12%3A57.495%2B08%3A00&endTime=2022-12-08T16%3A12%3A57.495%2B08%3A00&interval=60&metrics=request_total&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=e52b81b763574f9e, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:12:57.495+08:00,2022-12-08T16:12:57.495+08:00,request_total,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:13:13.299 INFO 42 --- [http-nio-8080-exec-8,e52b81b763574f9e,6f80d7867e90] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:13:13.321 INFO 42 --- [http-nio-8080-exec-8,e52b81b763574f9e,6f80d7867e90] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:13:13.351 INFO 42 --- [http-nio-8080-exec-8,e52b81b763574f9e,6f80d7867e90] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=e52b81b763574f9e, duration=79 ms] 2022-12-08 16:13:13.382 INFO 42 --- [http-nio-8080-exec-4,c56d8875df0f4add,4b5bd165c59a] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A12%3A57.495%2B08%3A00&endTime=2022-12-08T16%3A12%3A57.495%2B08%3A00&interval=60&metrics=current_session_client&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=c56d8875df0f4add, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:12:57.495+08:00,2022-12-08T16:12:57.495+08:00,current_session_client,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:13:13.394 INFO 42 --- [http-nio-8080-exec-4,c56d8875df0f4add,4b5bd165c59a] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:13:13.414 INFO 42 --- [http-nio-8080-exec-4,c56d8875df0f4add,4b5bd165c59a] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:13:13.437 INFO 42 --- [http-nio-8080-exec-4,c56d8875df0f4add,4b5bd165c59a] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=c56d8875df0f4add, duration=65 ms] 2022-12-08 16:13:13.713 INFO 42 --- [http-nio-8080-exec-1,30efcb3827bf4ed4,06dd90f84b4f] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2022-12-08T15%3A12%3A57.495%2B08%3A00&endTime=2022-12-08T16%3A12%3A57.495%2B08%3A00&interval=60&metrics=current_session_server&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5, client=192.168.28.1, traceId=30efcb3827bf4ed4, method=IterableResponse com.alipay.ocp.server.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Integer,String), args=2022-12-08T15:12:57.495+08:00,2022-12-08T16:12:57.495+08:00,current_session_server,app,obproxy_cluster,60,5,app:ODP,] 2022-12-08 16:13:13.727 INFO 42 --- [http-nio-8080-exec-1,30efcb3827bf4ed4,06dd90f84b4f] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2022-12-08 16:13:13.745 INFO 42 --- [http-nio-8080-exec-1,30efcb3827bf4ed4,06dd90f84b4f] c.a.o.s.o.ob.ObAuthorizedFacadeImpl : readable tenant ids:[] 2022-12-08 16:13:13.776 INFO 42 --- [http-nio-8080-exec-1,30efcb3827bf4ed4,06dd90f84b4f] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.28.1, traceId=30efcb3827bf4ed4, duration=72 ms] 2022-12-08 16:13:13.889 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:13:14.427 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:13:14.714 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:14.718 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:14.867 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:13:15.201 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:15.350 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:13:15.357 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:13:15.407 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:13:15.776 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:13:16.170 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:16.170 INFO 42 --- [pool-ocp-schedules-3,,3af63555bab3] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:13:16.679 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:16.966 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:13:17.176 INFO 42 --- [http-nio-8080-exec-2,597c7965145f450d,ed5476bef2a5] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=192.168.28.1, traceId=597c7965145f450d, method=SuccessResponse com.alipay.ocp.server.controller.ProfileController.userInfo(), args=] 2022-12-08 16:13:17.176 INFO 42 --- [http-nio-8080-exec-7,9116ddda66764818,69e8b089fab5] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=9116ddda66764818, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 16:13:17.182 INFO 42 --- [http-nio-8080-exec-7,9116ddda66764818,69e8b089fab5] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=9116ddda66764818, duration=7 ms] 2022-12-08 16:13:17.184 INFO 42 --- [http-nio-8080-exec-10,dac2b0898b724ca8,1b98da63e813] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=192.168.28.1, traceId=dac2b0898b724ca8, method=Map com.alipay.ocp.server.controller.InfoController.info(), args=] 2022-12-08 16:13:17.184 INFO 42 --- [http-nio-8080-exec-10,dac2b0898b724ca8,1b98da63e813] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=192.168.28.1, traceId=dac2b0898b724ca8, duration=1 ms] 2022-12-08 16:13:17.218 INFO 42 --- [http-nio-8080-exec-2,597c7965145f450d,ed5476bef2a5] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=192.168.28.1, traceId=597c7965145f450d, duration=43 ms] 2022-12-08 16:13:17.316 INFO 42 --- [http-nio-8080-exec-4,824eb332108a41cb,d20950d3d26f] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=192.168.28.1, traceId=824eb332108a41cb, method=SuccessResponse com.alipay.ocp.server.controller.PropertyController.getSystemInfo(), args=] 2022-12-08 16:13:17.317 INFO 42 --- [http-nio-8080-exec-4,824eb332108a41cb,d20950d3d26f] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=192.168.28.1, traceId=824eb332108a41cb, duration=2 ms] 2022-12-08 16:13:17.371 INFO 42 --- [http-nio-8080-exec-6,bbd19e3fde0f494c,996307af2d13] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/mc/info?null, client=192.168.28.1, traceId=bbd19e3fde0f494c, method=SuccessResponse com.alipay.ocp.server.controller.OcpMultiClusterInfoController.info(), args=] 2022-12-08 16:13:17.372 INFO 42 --- [http-nio-8080-exec-6,bbd19e3fde0f494c,996307af2d13] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/mc/info client=192.168.28.1, traceId=bbd19e3fde0f494c, duration=2 ms] 2022-12-08 16:13:17.421 INFO 42 --- [http-nio-8080-exec-8,fb6b1e0d88d94dfb,3caeacce6520] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/maz/state?null, client=192.168.28.1, traceId=fb6b1e0d88d94dfb, method=SuccessResponse com.alipay.ocp.server.controller.MultiAzoneController.state(), args=] 2022-12-08 16:13:17.426 INFO 42 --- [http-nio-8080-exec-8,fb6b1e0d88d94dfb,3caeacce6520] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/maz/state client=192.168.28.1, traceId=fb6b1e0d88d94dfb, duration=6 ms] 2022-12-08 16:13:17.524 INFO 42 --- [http-nio-8080-exec-1,ef425e501af941e1,fa6b00b57e02] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=192.168.28.1, traceId=ef425e501af941e1, method=OffsetDateTime com.alipay.ocp.server.controller.InfoController.time(), args=] 2022-12-08 16:13:17.525 INFO 42 --- [http-nio-8080-exec-1,ef425e501af941e1,fa6b00b57e02] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=192.168.28.1, traceId=ef425e501af941e1, duration=2 ms] 2022-12-08 16:13:17.620 INFO 42 --- [http-nio-8080-exec-9,764c595b639e4db8,b2ed9f070218] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=764c595b639e4db8, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:17.693 INFO 42 --- [http-nio-8080-exec-9,764c595b639e4db8,b2ed9f070218] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=764c595b639e4db8, duration=76 ms] 2022-12-08 16:13:17.719 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:17.723 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:17.730 INFO 42 --- [http-nio-8080-exec-3,d837123376b9497e,d0c5d20b2aec] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/software-packages?type=OBPROXY_INSTALL_PACKAGE&withInstallationData=true, client=192.168.28.1, traceId=d837123376b9497e, method=PaginatedResponse com.alipay.ocp.server.controller.SoftwarePackageController.listPackages(String,List,List,List,List,boolean,Pageable), args=[OBPROXY_INSTALL_PACKAGE],true,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:17.834 INFO 42 --- [http-nio-8080-exec-7,894aae3e6330454c,d881d7bc6cfa] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/idcs?null, client=192.168.28.1, traceId=894aae3e6330454c, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listIdcs(Pageable,Boolean), args=Page request [number: 0, size 2000, sort: id: DESC],false,] 2022-12-08 16:13:17.861 INFO 42 --- [http-nio-8080-exec-7,894aae3e6330454c,d881d7bc6cfa] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/idcs client=192.168.28.1, traceId=894aae3e6330454c, duration=30 ms] 2022-12-08 16:13:17.862 INFO 42 --- [http-nio-8080-exec-8,b9a3eaf52d1e4a6b,361227f4983f] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/hostTypes?null, client=192.168.28.1, traceId=b9a3eaf52d1e4a6b, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listHostTypes(Pageable), args=Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:17.958 INFO 42 --- [http-nio-8080-exec-8,b9a3eaf52d1e4a6b,361227f4983f] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hostTypes client=192.168.28.1, traceId=b9a3eaf52d1e4a6b, duration=98 ms] 2022-12-08 16:13:18.012 INFO 42 --- [http-nio-8080-exec-3,d837123376b9497e,d0c5d20b2aec] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/software-packages client=192.168.28.1, traceId=d837123376b9497e, duration=298 ms] 2022-12-08 16:13:18.035 INFO 42 --- [http-nio-8080-exec-9,82091c03bd0d47f2,1381ab94e431] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/hosts?status=ONLINE&status=AVAILABLE&excludedServiceType=OB_PROXY, client=192.168.28.1, traceId=82091c03bd0d47f2, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listHosts(List,String,List,List,Pageable), args=[ONLINE, AVAILABLE],[OB_PROXY],Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:18.094 WARN 42 --- [http-nio-8080-exec-9,82091c03bd0d47f2,1381ab94e431] o.h.h.internal.ast.QueryTranslatorImpl : HHH000104: firstResult/maxResults specified with collection fetch; applying in memory! 2022-12-08 16:13:18.137 INFO 42 --- [http-nio-8080-exec-10,8b879ac4d94c4760,0ea71a1a3c75] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/parameterInfo?null, client=192.168.28.1, traceId=8b879ac4d94c4760, method=IterableResponse com.alipay.ocp.server.controller.ObproxyController.listObproxyParameterInfo(String,String), args=] 2022-12-08 16:13:18.186 INFO 42 --- [http-nio-8080-exec-1,8c2298e2bb9c47e6,87db29baf44f] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=8c2298e2bb9c47e6, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:18.243 INFO 42 --- [http-nio-8080-exec-9,82091c03bd0d47f2,1381ab94e431] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hosts client=192.168.28.1, traceId=82091c03bd0d47f2, duration=213 ms] 2022-12-08 16:13:18.274 INFO 42 --- [http-nio-8080-exec-2,ea3b68f6b700476f,d96a764cfa09] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/idcs?null, client=192.168.28.1, traceId=ea3b68f6b700476f, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listIdcs(Pageable,Boolean), args=Page request [number: 0, size 2000, sort: id: DESC],false,] 2022-12-08 16:13:18.281 INFO 42 --- [http-nio-8080-exec-1,8c2298e2bb9c47e6,87db29baf44f] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=8c2298e2bb9c47e6, duration=97 ms] 2022-12-08 16:13:18.285 INFO 42 --- [http-nio-8080-exec-4,e63586e3b0be4a92,171d0e57dfec] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/hostTypes?null, client=192.168.28.1, traceId=e63586e3b0be4a92, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listHostTypes(Pageable), args=Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:18.290 INFO 42 --- [http-nio-8080-exec-2,ea3b68f6b700476f,d96a764cfa09] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/idcs client=192.168.28.1, traceId=ea3b68f6b700476f, duration=18 ms] 2022-12-08 16:13:18.293 INFO 42 --- [http-nio-8080-exec-10,8b879ac4d94c4760,0ea71a1a3c75] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/parameterInfo client=192.168.28.1, traceId=8b879ac4d94c4760, duration=170 ms] 2022-12-08 16:13:18.301 INFO 42 --- [http-nio-8080-exec-4,e63586e3b0be4a92,171d0e57dfec] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hostTypes client=192.168.28.1, traceId=e63586e3b0be4a92, duration=18 ms] 2022-12-08 16:13:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:13:18.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:13:18.792391+08:00, lastProcessTime=2022-12-08T16:13:08.799152+08:00 2022-12-08 16:13:18.833 INFO 42 --- [http-nio-8080-exec-5,b6c81d9ae19340c9,b77a316f7c8d] c.a.o.server.trace.RequestTracingAspect : API: [GET /error?null, client=192.168.28.1, traceId=b6c81d9ae19340c9, method=ModelAndView com.alipay.ocp.server.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2022-12-08 16:13:18.834 WARN 42 --- [http-nio-8080-exec-5,b6c81d9ae19340c9,b77a316f7c8d] c.a.o.s.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/obproxy/clusters/undefined, client=192.168.28.1, traceId=b6c81d9ae19340c9] 2022-12-08 16:13:18.835 INFO 42 --- [http-nio-8080-exec-5,b6c81d9ae19340c9,b77a316f7c8d] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /error client=192.168.28.1, traceId=b6c81d9ae19340c9, duration=3 ms] 2022-12-08 16:13:18.889 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:13:18.792391+08:00, resultsCount=0 2022-12-08 16:13:18.890 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:13:18.792391+08:00, resultsCount=0 2022-12-08 16:13:18.890 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:13:18.792391+08:00 2022-12-08 16:13:19.220 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:19.220 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:19.789 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:19.789 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:20.724 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:20.727 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:20.862 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:21.0, nextRun=2022-12-08 16:13:20.0, currentDate=Thu Dec 08 16:13:20 CST 2022 2022-12-08 16:13:20.862 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:12:21.0, nextRunTime=2022-12-08 16:13:20.0} 2022-12-08 16:13:20.878 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:13:20.879 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:13:20.879 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:13:21.317 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 612, operation:EXECUTE, state: RUNNING 2022-12-08 16:13:21.390 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=612, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:13:21.306+08:00, endTime=null} 2022-12-08 16:13:21.997 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:609, status:SUCCESS 2022-12-08 16:13:22.003 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:609, status:SUCCESS 2022-12-08 16:13:22.118 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:13:22.137 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:13:22.142 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:13:22.563 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:22.845 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:23.257 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:13:23.338 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:23.344 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:13:23.728 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:23.732 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:23.980 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:13:25.235 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:25.374 INFO 42 --- [pool-ocp-schedules-8,,a7b9d8c485fd] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:13:25.375 INFO 42 --- [pool-ocp-schedules-8,,a7b9d8c485fd] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:13:25.532 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:27.0, nextRun=2022-12-08 16:13:25.0, currentDate=Thu Dec 08 16:13:25 CST 2022 2022-12-08 16:13:25.533 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:12:27.0, nextRunTime=2022-12-08 16:13:25.0} 2022-12-08 16:13:25.577 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:13:25.577 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:13:25.578 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:13:25.692 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:25.693 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:25.894 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:25.895 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:26.172 INFO 42 --- [pool-ocp-schedules-12,,2e3c301cd016] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:13:26.403 INFO 42 --- [http-nio-8080-exec-8,e47d9a97f3814ec6,d43b94044402] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=192.168.28.1, traceId=e47d9a97f3814ec6, method=Map com.alipay.ocp.server.controller.InfoController.info(), args=] 2022-12-08 16:13:26.404 INFO 42 --- [http-nio-8080-exec-8,e47d9a97f3814ec6,d43b94044402] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=192.168.28.1, traceId=e47d9a97f3814ec6, duration=2 ms] 2022-12-08 16:13:26.404 INFO 42 --- [http-nio-8080-exec-6,45c59d82fb594a89,dcc8e45c0242] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=192.168.28.1, traceId=45c59d82fb594a89, method=SuccessResponse com.alipay.ocp.server.controller.ProfileController.userInfo(), args=] 2022-12-08 16:13:26.409 INFO 42 --- [http-nio-8080-exec-3,f5a1cf08e5cc4b93,553bdf7888ed] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=192.168.28.1, traceId=f5a1cf08e5cc4b93, method=SuccessResponse com.alipay.ocp.server.controller.PropertyController.getSystemInfo(), args=] 2022-12-08 16:13:26.410 INFO 42 --- [http-nio-8080-exec-3,f5a1cf08e5cc4b93,553bdf7888ed] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=192.168.28.1, traceId=f5a1cf08e5cc4b93, duration=2 ms] 2022-12-08 16:13:26.411 INFO 42 --- [http-nio-8080-exec-9,027ffef1d8824a72,8039b11eef2c] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/mc/info?null, client=192.168.28.1, traceId=027ffef1d8824a72, method=SuccessResponse com.alipay.ocp.server.controller.OcpMultiClusterInfoController.info(), args=] 2022-12-08 16:13:26.411 INFO 42 --- [http-nio-8080-exec-9,027ffef1d8824a72,8039b11eef2c] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/mc/info client=192.168.28.1, traceId=027ffef1d8824a72, duration=1 ms] 2022-12-08 16:13:26.421 INFO 42 --- [http-nio-8080-exec-7,fe8c2b3858354e48,2365480e7e7f] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/loginKey?null, client=192.168.28.1, traceId=fe8c2b3858354e48, method=SuccessResponse com.alipay.ocp.server.controller.InfoController.getLoginKey(), args=] 2022-12-08 16:13:26.421 INFO 42 --- [http-nio-8080-exec-1,12085c572fff45b8,a8d262549603] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/maz/state?null, client=192.168.28.1, traceId=12085c572fff45b8, method=SuccessResponse com.alipay.ocp.server.controller.MultiAzoneController.state(), args=] 2022-12-08 16:13:26.422 INFO 42 --- [http-nio-8080-exec-7,fe8c2b3858354e48,2365480e7e7f] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/loginKey client=192.168.28.1, traceId=fe8c2b3858354e48, duration=2 ms] 2022-12-08 16:13:26.422 INFO 42 --- [http-nio-8080-exec-1,12085c572fff45b8,a8d262549603] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/maz/state client=192.168.28.1, traceId=12085c572fff45b8, duration=2 ms] 2022-12-08 16:13:26.454 INFO 42 --- [http-nio-8080-exec-6,45c59d82fb594a89,dcc8e45c0242] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=192.168.28.1, traceId=45c59d82fb594a89, duration=51 ms] 2022-12-08 16:13:26.529 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 613, operation:EXECUTE, state: RUNNING 2022-12-08 16:13:26.586 INFO 42 --- [http-nio-8080-exec-2,53fa40b44aee47b8,29b2ce1a49fe] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=192.168.28.1, traceId=53fa40b44aee47b8, method=OffsetDateTime com.alipay.ocp.server.controller.InfoController.time(), args=] 2022-12-08 16:13:26.586 INFO 42 --- [http-nio-8080-exec-2,53fa40b44aee47b8,29b2ce1a49fe] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=192.168.28.1, traceId=53fa40b44aee47b8, duration=1 ms] 2022-12-08 16:13:26.599 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=613, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:13:26.515+08:00, endTime=null} 2022-12-08 16:13:26.645 INFO 42 --- [http-nio-8080-exec-4,953abf1aa459413b,8220f576e0d1] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms?page=1&size=10&isSubscribedByMe=false&collapsed=false, client=192.168.28.1, traceId=953abf1aa459413b, method=ResponseEntity com.alipay.ocp.server.controller.AlarmController.fetchAlarms(Integer,Integer,String,String,String,Integer,String,String,String,String,String,String,String,String,OffsetDateTime,OffsetDateTime,Boolean,String,String), args=1,10,false,] 2022-12-08 16:13:26.676 INFO 42 --- [http-nio-8080-exec-4,953abf1aa459413b,8220f576e0d1] c.a.o.s.a.service.OcpAlarmSearchService : sortedAlarm size=0, alarmHistory size=0 2022-12-08 16:13:26.677 INFO 42 --- [http-nio-8080-exec-4,953abf1aa459413b,8220f576e0d1] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms client=192.168.28.1, traceId=953abf1aa459413b, duration=36 ms] 2022-12-08 16:13:26.733 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:26.916 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:26.927 INFO 42 --- [http-nio-8080-exec-10,4cabe0555bba4ce4,64d39bdbe02b] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/hosts?null, client=192.168.28.1, traceId=4cabe0555bba4ce4, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listHosts(List,String,List,List,Pageable), args=Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:26.944 WARN 42 --- [http-nio-8080-exec-10,4cabe0555bba4ce4,64d39bdbe02b] o.h.h.internal.ast.QueryTranslatorImpl : HHH000104: firstResult/maxResults specified with collection fetch; applying in memory! 2022-12-08 16:13:26.971 INFO 42 --- [http-nio-8080-exec-10,4cabe0555bba4ce4,64d39bdbe02b] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hosts client=192.168.28.1, traceId=4cabe0555bba4ce4, duration=46 ms] 2022-12-08 16:13:27.013 INFO 42 --- [http-nio-8080-exec-5,822a1738112a4cef,ee794e23499a] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances?page=1&size=10, client=192.168.28.1, traceId=822a1738112a4cef, method=PaginatedResponse com.alipay.ocp.server.controller.TaskController.listTaskInstances(Pageable,String,String,TaskType,String,Long,String,Long,Long), args=Page request [number: 0, size 10, sort: id: DESC],MANUAL,] 2022-12-08 16:13:27.193 INFO 42 --- [http-nio-8080-exec-5,822a1738112a4cef,ee794e23499a] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances client=192.168.28.1, traceId=822a1738112a4cef, duration=203 ms] 2022-12-08 16:13:27.798 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:610, status:SUCCESS 2022-12-08 16:13:27.804 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:610, status:SUCCESS 2022-12-08 16:13:28.477 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:13:28.485 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:13:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:13:28.780 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:28.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:13:28.801127+08:00, lastProcessTime=2022-12-08T16:13:18.792391+08:00 2022-12-08 16:13:28.952 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:13:28.801127+08:00, resultsCount=0 2022-12-08 16:13:28.952 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:13:28.801127+08:00, resultsCount=0 2022-12-08 16:13:28.952 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:13:28.801127+08:00 2022-12-08 16:13:28.985 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:29.478 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:13:29.574 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:13:29.917 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:29.921 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:31.150 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:31.0, nextRun=2022-12-08 16:13:30.0, currentDate=Thu Dec 08 16:13:31 CST 2022 2022-12-08 16:13:31.150 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:12:31.0, nextRunTime=2022-12-08 16:13:30.0} 2022-12-08 16:13:31.176 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:13:31.280 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:13:02.0, nextRun=2022-12-08 16:13:30.0, currentDate=Thu Dec 08 16:13:31 CST 2022 2022-12-08 16:13:31.280 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:13:02.0, nextRunTime=2022-12-08 16:13:30.0} 2022-12-08 16:13:31.299 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:13:31.299 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:13:31.299 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:13:31.731 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 614, operation:EXECUTE, state: RUNNING 2022-12-08 16:13:31.863 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:31.864 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:31.884 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=614, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:13:31.719+08:00, endTime=null} 2022-12-08 16:13:32.091 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:32.091 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:32.153 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:13:32.586 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:611, status:SUCCESS 2022-12-08 16:13:32.592 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:611, status:SUCCESS 2022-12-08 16:13:32.921 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:32.926 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:33.383 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:33.425 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:13:34.477 INFO 42 --- [http-nio-8080-exec-4,96c536d789184bd8,90d1fadc6d17] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/583?taskInstanceId=583, client=192.168.28.1, traceId=96c536d789184bd8, method=SuccessResponse com.alipay.ocp.server.controller.TaskController.getTaskInstance(Long), args=583,] 2022-12-08 16:13:34.526 INFO 42 --- [http-nio-8080-exec-4,96c536d789184bd8,90d1fadc6d17] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/583 client=192.168.28.1, traceId=96c536d789184bd8, duration=70 ms] 2022-12-08 16:13:34.723 INFO 42 --- [http-nio-8080-exec-7,daa1268d087c4dc3,10edff4cd0ed] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/583/subtasks/584/log?taskInstanceId=583&subtaskInstanceId=584, client=192.168.28.1, traceId=daa1268d087c4dc3, method=SuccessResponse com.alipay.ocp.server.controller.TaskController.getSubtaskLog(Long,Long), args=583,584,] 2022-12-08 16:13:34.766 INFO 42 --- [http-nio-8080-exec-7,daa1268d087c4dc3,10edff4cd0ed] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/583/subtasks/584/log client=192.168.28.1, traceId=daa1268d087c4dc3, duration=65 ms] 2022-12-08 16:13:34.813 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:13:34.821 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:13:34.944 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:35.209 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:13:35.375 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:35.385 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:35.891 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:13:35.927 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:35.931 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:36.174 INFO 42 --- [pool-ocp-schedules-13,,d9bb6f7eabe7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:13:38.000 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:38.001 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:38.470 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:38.470 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:13:38.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:13:38.794281+08:00, lastProcessTime=2022-12-08T16:13:28.801127+08:00 2022-12-08 16:13:38.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:13:38.794281+08:00, resultsCount=0 2022-12-08 16:13:38.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:13:38.794281+08:00, resultsCount=0 2022-12-08 16:13:38.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:13:38.794281+08:00 2022-12-08 16:13:38.933 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:38.940 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:40.299 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:13:40.312 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=13ms, period=120000ms 2022-12-08 16:13:41.298 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:13:41.304 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:13:41.539 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:41.941 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:41.944 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:42.405 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:13:43.471 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:43.473 INFO 42 --- [http-nio-8080-exec-2,3a6297ae7aaa405d,3dfb39ec91b5] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/compute/hosts?null, client=192.168.28.1, traceId=3a6297ae7aaa405d, method=PaginatedResponse com.alipay.ocp.server.controller.ComputeController.listHosts(List,String,List,List,Pageable), args=Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:43.473 INFO 42 --- [http-nio-8080-exec-10,82bac09cc53c452e,37fad2d5a8ff] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=82bac09cc53c452e, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:43.484 INFO 42 --- [http-nio-8080-exec-5,7adbd5a4c80449f8,1e3668e911ac] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/clusters?null, client=192.168.28.1, traceId=7adbd5a4c80449f8, method=PaginatedResponse com.alipay.ocp.server.controller.ObproxyController.listObproxyClusters(Pageable,String), args=Page request [number: 0, size 2000, sort: id: ASC],] 2022-12-08 16:13:43.498 INFO 42 --- [http-nio-8080-exec-5,7adbd5a4c80449f8,1e3668e911ac] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/clusters client=192.168.28.1, traceId=7adbd5a4c80449f8, duration=16 ms] 2022-12-08 16:13:43.499 WARN 42 --- [http-nio-8080-exec-2,3a6297ae7aaa405d,3dfb39ec91b5] o.h.h.internal.ast.QueryTranslatorImpl : HHH000104: firstResult/maxResults specified with collection fetch; applying in memory! 2022-12-08 16:13:43.526 INFO 42 --- [http-nio-8080-exec-2,3a6297ae7aaa405d,3dfb39ec91b5] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hosts client=192.168.28.1, traceId=3a6297ae7aaa405d, duration=56 ms] 2022-12-08 16:13:43.560 INFO 42 --- [http-nio-8080-exec-10,82bac09cc53c452e,37fad2d5a8ff] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=82bac09cc53c452e, duration=90 ms] 2022-12-08 16:13:43.829 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:13:44.271 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:44.508 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:13:44.593 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:44.593 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:44.641 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:13:44.680 INFO 42 --- [http-nio-8080-exec-9,8af72af256a64c22,5b435d531aee] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/users?page=1&size=10, client=192.168.28.1, traceId=8af72af256a64c22, method=PaginatedResponse com.alipay.ocp.server.controller.IamController.listUsers(Pageable,String), args=Page request [number: 0, size 10, sort: id: DESC],] 2022-12-08 16:13:44.699 INFO 42 --- [http-nio-8080-exec-9,8af72af256a64c22,5b435d531aee] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/users client=192.168.28.1, traceId=8af72af256a64c22, duration=22 ms] 2022-12-08 16:13:44.922 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:13:44.945 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:44.950 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:45.249 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:13:45.420 INFO 42 --- [pool-ocp-schedules-2,,ffa8c4f4bb3d] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:13:45.420 INFO 42 --- [pool-ocp-schedules-2,,ffa8c4f4bb3d] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:13:45.436 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:45.474 INFO 42 --- [pool-ocp-schedules-8,,90426434a6c0] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:13:45.486 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:13:45.505 INFO 42 --- [pool-ocp-schedules-8,,90426434a6c0] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:13:45.721 INFO 42 --- [pool-ocp-schedules-17,,f05d39c8d633] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:13:45.762 INFO 42 --- [pool-ocp-schedules-15,,95c2aa7b56d3] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:13:45.762 INFO 42 --- [pool-ocp-schedules-15,,95c2aa7b56d3] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:13:45.838 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:13:46.175 INFO 42 --- [pool-ocp-schedules-12,,edcdd6bc5c7e] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:13:46.274 INFO 42 --- [pool-ocp-schedules-19,,1b459efc4030] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:13:47.332 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:47.333 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:47.951 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:47.958 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:13:48.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:13:48.799951+08:00, lastProcessTime=2022-12-08T16:13:38.794281+08:00 2022-12-08 16:13:48.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:13:48.799951+08:00, resultsCount=0 2022-12-08 16:13:48.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:13:48.799951+08:00, resultsCount=0 2022-12-08 16:13:48.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:13:48.799951+08:00 2022-12-08 16:13:49.677 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:13:49.683 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:13:50.412 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:50.959 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:50.963 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:51.146 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:51.314 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:13:52.085 INFO 42 --- [http-nio-8080-exec-10,2644ac66bae04696,d34d97269f27] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=2644ac66bae04696, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:52.086 INFO 42 --- [http-nio-8080-exec-5,0226094fd3844303,1b9a4911f936] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/roles?null, client=192.168.28.1, traceId=0226094fd3844303, method=PaginatedResponse com.alipay.ocp.server.controller.IamController.listRoles(String,Pageable), args=Page request [number: 0, size 2000, sort: UNSORTED],] 2022-12-08 16:13:52.095 INFO 42 --- [http-nio-8080-exec-9,513a926c2a5c4910,c96b393f9fe9] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/rateLimiter/policies/USER/100?objectType=USER&objectId=100, client=192.168.28.1, traceId=513a926c2a5c4910, method=SuccessResponse com.alipay.ocp.server.controller.RateLimiterController.listLimiterResources(String,String), args=USER,100,] 2022-12-08 16:13:52.100 INFO 42 --- [http-nio-8080-exec-4,dc7d1cdb006b459b,86cbe35d098b] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/rateLimiter/resources?null, client=192.168.28.1, traceId=dc7d1cdb006b459b, method=IterableResponse com.alipay.ocp.server.controller.RateLimiterController.listLimiterResources(), args=] 2022-12-08 16:13:52.101 INFO 42 --- [http-nio-8080-exec-2,3f9430bc96984dda,cb3dc56bffd7] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/users/100?id=100, client=192.168.28.1, traceId=3f9430bc96984dda, method=SuccessResponse com.alipay.ocp.server.controller.IamController.getUserById(long), args=100,] 2022-12-08 16:13:52.122 INFO 42 --- [http-nio-8080-exec-4,dc7d1cdb006b459b,86cbe35d098b] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/rateLimiter/resources client=192.168.28.1, traceId=dc7d1cdb006b459b, duration=23 ms] 2022-12-08 16:13:52.124 INFO 42 --- [http-nio-8080-exec-2,3f9430bc96984dda,cb3dc56bffd7] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/users/100 client=192.168.28.1, traceId=3f9430bc96984dda, duration=32 ms] 2022-12-08 16:13:52.137 INFO 42 --- [http-nio-8080-exec-9,513a926c2a5c4910,c96b393f9fe9] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/rateLimiter/policies/USER/100 client=192.168.28.1, traceId=513a926c2a5c4910, duration=48 ms] 2022-12-08 16:13:52.170 INFO 42 --- [http-nio-8080-exec-10,2644ac66bae04696,d34d97269f27] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=2644ac66bae04696, duration=86 ms] 2022-12-08 16:13:52.343 INFO 42 --- [http-nio-8080-exec-1,33f4f1cdf1e541b3,62bce7207801] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=33f4f1cdf1e541b3, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:13:52.412 INFO 42 --- [http-nio-8080-exec-1,33f4f1cdf1e541b3,62bce7207801] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=33f4f1cdf1e541b3, duration=73 ms] 2022-12-08 16:13:52.461 INFO 42 --- [http-nio-8080-exec-5,0226094fd3844303,1b9a4911f936] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/roles client=192.168.28.1, traceId=0226094fd3844303, duration=379 ms] 2022-12-08 16:13:52.508 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:13:52.563 INFO 42 --- [http-nio-8080-exec-3,4e1f16fa97bf4158,5825652ecf85] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/roles?null, client=192.168.28.1, traceId=4e1f16fa97bf4158, method=PaginatedResponse com.alipay.ocp.server.controller.IamController.listRoles(String,Pageable), args=Page request [number: 0, size 2000, sort: UNSORTED],] 2022-12-08 16:13:52.671 INFO 42 --- [http-nio-8080-exec-3,4e1f16fa97bf4158,5825652ecf85] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/roles client=192.168.28.1, traceId=4e1f16fa97bf4158, duration=110 ms] 2022-12-08 16:13:53.536 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:53.537 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:53.541 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:53.964 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:53.968 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:54.009 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:13:54.307 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:13:54.307 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:13:55.341 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:13:55.486 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:13:56.176 INFO 42 --- [pool-ocp-schedules-16,,34090dd4e393] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:13:56.512 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:13:56.517 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:13:56.969 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:56.973 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:13:57.156 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:57.543 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:13:58.350 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:13:58.396 INFO 42 --- [pool-ocp-schedules-9,,60ae65cb039a] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:13:58.396 INFO 42 --- [pool-ocp-schedules-5,,8dc0448e7df0] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:13:58.427 INFO 42 --- [pool-ocp-schedules-2,,ee6844d7a5ac] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:13:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,3287018e4b1c] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:13:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,3287018e4b1c] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:13:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:13:58.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:13:58.792432+08:00, lastProcessTime=2022-12-08T16:13:48.799951+08:00 2022-12-08 16:13:58.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:13:58.792432+08:00, resultsCount=0 2022-12-08 16:13:58.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:13:58.792432+08:00, resultsCount=0 2022-12-08 16:13:58.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:13:58.792432+08:00 2022-12-08 16:13:59.071 INFO 42 --- [pool-ocp-schedules-17,,1ed3038845b3] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:13:59.072 INFO 42 --- [pool-ocp-schedules-17,,1ed3038845b3] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:13:59.072 INFO 42 --- [pool-ocp-schedules-17,,1ed3038845b3] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:13:59.689 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:13:59.974 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:13:59.978 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:00.090 INFO 42 --- [http-nio-8080-exec-6,041744fc95b44b5b,da42dd9e990f] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/properties?null, client=192.168.28.1, traceId=041744fc95b44b5b, method=PaginatedResponse com.alipay.ocp.server.controller.PropertyController.findNonFatalProperties(String,Pageable), args=Page request [number: 0, size 2000, sort: key: ASC],] 2022-12-08 16:14:00.153 INFO 42 --- [http-nio-8080-exec-6,041744fc95b44b5b,da42dd9e990f] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/properties client=192.168.28.1, traceId=041744fc95b44b5b, duration=66 ms] 2022-12-08 16:14:00.249 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:00.249 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:00.621 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:00.621 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:00.918 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:12:01.0, nextRun=2022-12-08 16:14:00.0, currentDate=Thu Dec 08 16:14:00 CST 2022 2022-12-08 16:14:00.918 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:12:01.0, nextRunTime=2022-12-08 16:14:00.0} 2022-12-08 16:14:00.939 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:14:01.012 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:13:01.0, nextRun=2022-12-08 16:14:00.0, currentDate=Thu Dec 08 16:14:01 CST 2022 2022-12-08 16:14:01.012 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:13:01.0, nextRunTime=2022-12-08 16:14:00.0} 2022-12-08 16:14:01.034 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:14:01.035 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:14:01.035 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:14:01.169 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:13:01.0, nextRun=2022-12-08 16:14:00.0, currentDate=Thu Dec 08 16:14:01 CST 2022 2022-12-08 16:14:01.170 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:13:01.0, nextRunTime=2022-12-08 16:14:00.0} 2022-12-08 16:14:01.200 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:14:01.200 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:14:01.201 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:14:01.350 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:13:01.0, nextRun=2022-12-08 16:14:00.0, currentDate=Thu Dec 08 16:14:01 CST 2022 2022-12-08 16:14:01.351 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:13:01.0, nextRunTime=2022-12-08 16:14:00.0} 2022-12-08 16:14:01.374 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:14:01.375 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:14:01.375 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:14:01.447 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 615, operation:EXECUTE, state: RUNNING 2022-12-08 16:14:01.519 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:13:31.0, nextRun=2022-12-08 16:14:00.0, currentDate=Thu Dec 08 16:14:01 CST 2022 2022-12-08 16:14:01.519 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:13:31.0, nextRunTime=2022-12-08 16:14:00.0} 2022-12-08 16:14:01.537 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:14:01.538 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:14:01.538 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:14:01.603 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=615, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:14:01.435+08:00, endTime=null} 2022-12-08 16:14:01.676 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 616, operation:EXECUTE, state: RUNNING 2022-12-08 16:14:01.798 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:13:02.0, nextRun=2022-12-08 16:14:00.0, currentDate=Thu Dec 08 16:14:01 CST 2022 2022-12-08 16:14:01.798 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:13:02.0, nextRunTime=2022-12-08 16:14:00.0} 2022-12-08 16:14:01.817 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:14:01.817 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:14:01.817 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:14:01.932 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=616, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:14:01.664+08:00, endTime=null} 2022-12-08 16:14:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,48b04760ef6e] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487300, interval=60 2022-12-08 16:14:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,48b04760ef6e] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487242, count=0, elapsed=1668816755393 2022-12-08 16:14:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,a939a1d320e9] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487300, interval=60 2022-12-08 16:14:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,a939a1d320e9] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487242, count=0, elapsed=1668816755398 2022-12-08 16:14:02.819 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:14:02.981 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:02.989 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:03.034 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 617, operation:EXECUTE, state: RUNNING 2022-12-08 16:14:03.260 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=617, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:14:03.017+08:00, endTime=null} 2022-12-08 16:14:03.332 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 618, operation:EXECUTE, state: RUNNING 2022-12-08 16:14:03.683 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=618, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:14:03.320+08:00, endTime=null} 2022-12-08 16:14:03.761 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 619, operation:EXECUTE, state: RUNNING 2022-12-08 16:14:03.787 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:14:03.795 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:14:03.880 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=619, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:14:03.740+08:00, endTime=null} 2022-12-08 16:14:03.897 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:612, status:SUCCESS 2022-12-08 16:14:03.907 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:612, status:SUCCESS 2022-12-08 16:14:04.144 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:04.412 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:14:04.486 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:613, status:SUCCESS 2022-12-08 16:14:04.513 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:613, status:SUCCESS 2022-12-08 16:14:04.685 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:614, status:SUCCESS 2022-12-08 16:14:04.691 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:614, status:SUCCESS 2022-12-08 16:14:04.829 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:615, status:SUCCESS 2022-12-08 16:14:04.835 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:615, status:SUCCESS 2022-12-08 16:14:04.914 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:616, status:SUCCESS 2022-12-08 16:14:04.920 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:616, status:SUCCESS 2022-12-08 16:14:05.463 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:14:05.480 INFO 42 --- [pool-ocp-schedules-18,,eeaedaa4b01c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:14:05.481 INFO 42 --- [pool-ocp-schedules-18,,eeaedaa4b01c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:14:05.602 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:05.841 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:13:06.0, nextRun=2022-12-08 16:14:05.0, currentDate=Thu Dec 08 16:14:05 CST 2022 2022-12-08 16:14:05.842 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:13:06.0, nextRunTime=2022-12-08 16:14:05.0} 2022-12-08 16:14:05.860 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:14:05.861 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:14:05.861 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:14:05.966 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 620, operation:EXECUTE, state: RUNNING 2022-12-08 16:14:05.991 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:05.998 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:06.006 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=620, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:14:05.953+08:00, endTime=null} 2022-12-08 16:14:06.177 INFO 42 --- [pool-ocp-schedules-19,,1e99cb49657a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:14:06.747 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:06.885 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:07.308 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:14:07.540 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:617, status:SUCCESS 2022-12-08 16:14:07.556 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:617, status:SUCCESS 2022-12-08 16:14:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:14:08.803 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:14:08.797828+08:00, lastProcessTime=2022-12-08T16:13:58.792432+08:00 2022-12-08 16:14:08.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:14:08.797828+08:00, resultsCount=0 2022-12-08 16:14:08.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:14:08.797828+08:00, resultsCount=0 2022-12-08 16:14:08.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:14:08.797828+08:00 2022-12-08 16:14:08.999 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:09.003 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:09.975 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:09.976 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:10.078 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:10.079 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:12.003 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:12.007 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:12.529 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:14:12.536 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:14:13.031 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:13.127 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:13.146 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:14:13.634 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:14:14.503 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:14.669 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:14:14.727 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:14:14.952 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:14:15.008 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:15.012 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:15.507 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:14:15.617 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:14:15.708 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:15.893 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:14:16.124 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:16.124 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:16.178 INFO 42 --- [pool-ocp-schedules-4,,0f03526e82b0] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:14:16.201 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:16.201 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:18.013 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:18.020 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:14:18.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:14:18.792687+08:00, lastProcessTime=2022-12-08T16:14:08.797828+08:00 2022-12-08 16:14:18.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:14:18.792687+08:00, resultsCount=0 2022-12-08 16:14:18.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:14:18.792687+08:00, resultsCount=0 2022-12-08 16:14:18.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:14:18.792687+08:00 2022-12-08 16:14:19.286 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:14:19.294 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:14:20.128 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:13:21.0, nextRun=2022-12-08 16:14:20.0, currentDate=Thu Dec 08 16:14:20 CST 2022 2022-12-08 16:14:20.129 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:13:21.0, nextRunTime=2022-12-08 16:14:20.0} 2022-12-08 16:14:20.147 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:14:20.147 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:14:20.148 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:14:21.021 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:21.026 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:21.274 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 621, operation:EXECUTE, state: RUNNING 2022-12-08 16:14:21.839 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=621, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:14:21.263+08:00, endTime=null} 2022-12-08 16:14:22.392 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:23.213 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:14:23.250 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:618, status:SUCCESS 2022-12-08 16:14:23.257 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:618, status:SUCCESS 2022-12-08 16:14:24.027 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:24.031 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:24.688 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:24.820 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:14:25.617 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:14:25.843 INFO 42 --- [pool-ocp-schedules-5,,db49a697e09b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:14:25.843 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:25.844 INFO 42 --- [pool-ocp-schedules-5,,db49a697e09b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:14:26.179 INFO 42 --- [pool-ocp-schedules-4,,acb34a4cb3c8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:14:26.590 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:13:26.0, nextRun=2022-12-08 16:14:25.0, currentDate=Thu Dec 08 16:14:26 CST 2022 2022-12-08 16:14:26.591 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:13:26.0, nextRunTime=2022-12-08 16:14:25.0} 2022-12-08 16:14:26.626 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:14:26.626 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:14:26.627 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:14:27.001 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 622, operation:EXECUTE, state: RUNNING 2022-12-08 16:14:27.031 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:27.035 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:27.053 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=622, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:14:26.988+08:00, endTime=null} 2022-12-08 16:14:28.581 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:619, status:SUCCESS 2022-12-08 16:14:28.588 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:619, status:SUCCESS 2022-12-08 16:14:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:14:28.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:14:28.800128+08:00, lastProcessTime=2022-12-08T16:14:18.792687+08:00 2022-12-08 16:14:28.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:14:28.800128+08:00, resultsCount=0 2022-12-08 16:14:28.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:14:28.800128+08:00, resultsCount=0 2022-12-08 16:14:28.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:14:28.800128+08:00 2022-12-08 16:14:29.873 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:14:30.036 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:30.040 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:30.068 WARN 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Sharding failed, wait for next cycle. 2022-12-08 16:14:31.123 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:13:31.0, nextRun=2022-12-08 16:14:30.0, currentDate=Thu Dec 08 16:14:31 CST 2022 2022-12-08 16:14:31.123 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:13:31.0, nextRunTime=2022-12-08 16:14:30.0} 2022-12-08 16:14:31.153 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:14:31.373 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:02.0, nextRun=2022-12-08 16:14:30.0, currentDate=Thu Dec 08 16:14:31 CST 2022 2022-12-08 16:14:31.374 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:14:02.0, nextRunTime=2022-12-08 16:14:30.0} 2022-12-08 16:14:31.391 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:14:31.391 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:14:31.391 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:14:32.285 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 623, operation:EXECUTE, state: RUNNING 2022-12-08 16:14:32.372 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=623, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:14:32.265+08:00, endTime=null} 2022-12-08 16:14:33.041 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:33.047 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:33.288 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:14:34.152 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T16:10:33.558, end=2022-12-08T16:12:34.033} 2022-12-08 16:14:34.167 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:14:34.184 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:620, status:SUCCESS 2022-12-08 16:14:34.192 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:620, status:SUCCESS 2022-12-08 16:14:34.923 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:34.977 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:14:35.161 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:14:35.167 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:14:35.380 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:35.843 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:14:36.048 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:36.052 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:36.104 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:36.180 INFO 42 --- [pool-ocp-schedules-5,,4e1b46922df8] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:14:36.391 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:36.652 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:14:38.474 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:38.475 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:14:38.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:14:38.798828+08:00, lastProcessTime=2022-12-08T16:14:28.800128+08:00 2022-12-08 16:14:38.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:14:38.798828+08:00, resultsCount=0 2022-12-08 16:14:38.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:14:38.798828+08:00, resultsCount=0 2022-12-08 16:14:38.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:14:38.798828+08:00 2022-12-08 16:14:39.053 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:39.057 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:39.648 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:39.649 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:41.899 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:14:41.906 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:14:42.058 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:42.063 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:42.861 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:43.399 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:14:44.865 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:44.973 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:45.004 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:14:45.048 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:14:45.064 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:45.068 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:45.162 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:14:45.211 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:09:14+08:00, updateTime=2022-12-08T16:14:14+08:00, expireTime=null, isLeader=false} 2022-12-08 16:14:45.251 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:14:45.262 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:14:45.470 INFO 42 --- [pool-ocp-schedules-16,,b735c723e0bd] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:14:45.498 INFO 42 --- [pool-ocp-schedules-16,,b735c723e0bd] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:14:45.708 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:14:45.722 INFO 42 --- [pool-ocp-schedules-14,,8b9db0430f0d] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:14:45.933 INFO 42 --- [pool-ocp-schedules-11,,8f77a286913a] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:14:45.933 INFO 42 --- [pool-ocp-schedules-11,,8f77a286913a] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:14:46.100 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:14:46.129 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:46.129 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:46.169 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:09:15+08:00, updateTime=2022-12-08T16:14:15+08:00, expireTime=null, isLeader=false} 2022-12-08 16:14:46.178 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:14:46.181 INFO 42 --- [pool-ocp-schedules-2,,7f4b940dc727] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:14:46.279 INFO 42 --- [pool-ocp-schedules-8,,6cced00e29d0] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:14:46.391 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:14:46.745 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:47.974 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:47.975 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:48.069 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:48.082 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:14:48.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:14:48.792394+08:00, lastProcessTime=2022-12-08T16:14:38.798828+08:00 2022-12-08 16:14:48.890 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:14:48.792394+08:00, resultsCount=0 2022-12-08 16:14:48.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:14:48.792394+08:00, resultsCount=0 2022-12-08 16:14:48.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:14:48.792394+08:00 2022-12-08 16:14:51.082 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:51.088 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:51.164 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:14:51.179 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:14:52.289 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:53.550 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:14:54.089 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:54.093 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:54.307 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:14:54.419 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:14:55.048 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:55.104 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:14:55.340 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:55.340 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:56.182 INFO 42 --- [pool-ocp-schedules-14,,daf59af1644c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:14:56.745 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:14:57.094 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:14:57.098 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:14:57.146 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:14:57.373 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:14:57.374 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:14:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,4f149d0e8266] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:14:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,4f149d0e8266] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:14:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:14:58.979 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:14:58.974771+08:00, lastProcessTime=2022-12-08T16:14:48.792394+08:00 2022-12-08 16:14:59.068 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:14:58.974771+08:00, resultsCount=0 2022-12-08 16:14:59.068 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:14:58.974771+08:00, resultsCount=0 2022-12-08 16:14:59.069 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:14:58.974771+08:00 2022-12-08 16:14:59.347 INFO 42 --- [pool-ocp-schedules-11,,5818509e2388] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:14:59.347 INFO 42 --- [pool-ocp-schedules-3,,e87b9eb5a1b5] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:14:59.348 INFO 42 --- [pool-ocp-schedules-19,,9e4417cb793b] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:14:59.789 INFO 42 --- [pool-ocp-schedules-12,,8b4c81533c04] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:14:59.789 INFO 42 --- [pool-ocp-schedules-12,,8b4c81533c04] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:14:59.790 INFO 42 --- [pool-ocp-schedules-12,,8b4c81533c04] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:15:00.000 INFO 42 --- [pool-ocp-schedules-1,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 16:15:00.098 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:00.103 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:00.251 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:15:00.512 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:15:00.519 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:15:02.159 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:01.0, nextRun=2022-12-08 16:15:00.0, currentDate=Thu Dec 08 16:15:02 CST 2022 2022-12-08 16:15:02.160 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 16:10:01.0, nextRunTime=2022-12-08 16:15:00.0} 2022-12-08 16:15:02.177 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 16:15:02.178 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:02.178 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:02.239 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:01.0, nextRun=2022-12-08 16:15:00.0, currentDate=Thu Dec 08 16:15:02 CST 2022 2022-12-08 16:15:02.240 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 16:10:01.0, nextRunTime=2022-12-08 16:15:00.0} 2022-12-08 16:15:02.272 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 16:15:02.272 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 16:15:02.311 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:01.0, nextRun=2022-12-08 16:15:00.0, currentDate=Thu Dec 08 16:15:02 CST 2022 2022-12-08 16:15:02.311 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:14:01.0, nextRunTime=2022-12-08 16:15:00.0} 2022-12-08 16:15:02.327 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:15:02.328 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:02.328 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:02.360 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:02.394 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:01.0, nextRun=2022-12-08 16:15:00.0, currentDate=Thu Dec 08 16:15:02 CST 2022 2022-12-08 16:15:02.395 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:14:01.0, nextRunTime=2022-12-08 16:15:00.0} 2022-12-08 16:15:02.423 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:15:02.423 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:02.423 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:02.491 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:01.0, nextRun=2022-12-08 16:15:00.0, currentDate=Thu Dec 08 16:15:02 CST 2022 2022-12-08 16:15:02.491 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:14:01.0, nextRunTime=2022-12-08 16:15:00.0} 2022-12-08 16:15:02.518 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:15:02.519 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:02.519 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:02.634 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:31.0, nextRun=2022-12-08 16:15:00.0, currentDate=Thu Dec 08 16:15:02 CST 2022 2022-12-08 16:15:02.634 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:14:31.0, nextRunTime=2022-12-08 16:15:00.0} 2022-12-08 16:15:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,3009722d54cd] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487360, interval=60 2022-12-08 16:15:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,3009722d54cd] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487302, count=0, elapsed=1668816815333 2022-12-08 16:15:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,b56619b2ff7d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487360, interval=60 2022-12-08 16:15:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,b56619b2ff7d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487302, count=0, elapsed=1668816815338 2022-12-08 16:15:02.649 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:15:02.650 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:02.650 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:02.776 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:02.0, nextRun=2022-12-08 16:15:00.0, currentDate=Thu Dec 08 16:15:02 CST 2022 2022-12-08 16:15:02.777 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 16:10:02.0, nextRunTime=2022-12-08 16:15:00.0} 2022-12-08 16:15:02.795 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 16:15:02.795 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:02.796 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:02.862 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:02.0, nextRun=2022-12-08 16:15:00.0, currentDate=Thu Dec 08 16:15:02 CST 2022 2022-12-08 16:15:02.862 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:14:02.0, nextRunTime=2022-12-08 16:15:00.0} 2022-12-08 16:15:02.883 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:15:02.884 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:02.884 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:03.080 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 624, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:03.104 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:03.110 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:03.182 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=624, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T16:15:03.046+08:00, endTime=null} 2022-12-08 16:15:03.252 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 625, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:03.540 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=625, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:15:03.239+08:00, endTime=null} 2022-12-08 16:15:03.576 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:15:03.613 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 626, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:03.699 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=626, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:15:03.600+08:00, endTime=null} 2022-12-08 16:15:03.761 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 627, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:03.811 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=627, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:15:03.748+08:00, endTime=null} 2022-12-08 16:15:03.868 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 628, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:03.915 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=628, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:15:03.857+08:00, endTime=null} 2022-12-08 16:15:03.977 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 629, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:04.056 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=629, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T16:15:03.966+08:00, endTime=null} 2022-12-08 16:15:04.147 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 630, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:04.218 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=630, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:15:04.134+08:00, endTime=null} 2022-12-08 16:15:04.884 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:621, status:SUCCESS 2022-12-08 16:15:04.896 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:621, status:SUCCESS 2022-12-08 16:15:04.947 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:04.962 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:622, status:SUCCESS 2022-12-08 16:15:04.967 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:622, status:SUCCESS 2022-12-08 16:15:05.068 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:623, status:SUCCESS 2022-12-08 16:15:05.082 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:623, status:SUCCESS 2022-12-08 16:15:05.120 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:15:05.175 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:624, status:SUCCESS 2022-12-08 16:15:05.186 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:624, status:SUCCESS 2022-12-08 16:15:05.288 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:625, status:SUCCESS 2022-12-08 16:15:05.294 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:625, status:SUCCESS 2022-12-08 16:15:05.387 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:626, status:SUCCESS 2022-12-08 16:15:05.390 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:05.395 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:626, status:SUCCESS 2022-12-08 16:15:05.426 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:05.426 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:05.477 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:06.0, nextRun=2022-12-08 16:15:05.0, currentDate=Thu Dec 08 16:15:05 CST 2022 2022-12-08 16:15:05.478 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:14:06.0, nextRunTime=2022-12-08 16:15:05.0} 2022-12-08 16:15:05.492 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:15:05.493 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:05.493 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:05.501 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:627, status:SUCCESS 2022-12-08 16:15:05.506 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:627, status:SUCCESS 2022-12-08 16:15:05.544 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:15:06.110 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:06.118 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:06.172 INFO 42 --- [pool-ocp-schedules-11,,9b503fa6da88] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:15:06.172 INFO 42 --- [pool-ocp-schedules-11,,9b503fa6da88] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:15:06.183 INFO 42 --- [pool-ocp-schedules-10,,ac3aa0095a38] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:15:06.245 INFO 42 --- [pool-ocp-schedules-1,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 16:15:06.314 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 631, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:06.350 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=631, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:15:06.294+08:00, endTime=null} 2022-12-08 16:15:06.614 INFO 42 --- [pool-ocp-schedules-1,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 16:15:06.721 INFO 42 --- [pool-ocp-schedules-1,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 16:15:06.723 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:628, status:SUCCESS 2022-12-08 16:15:06.754 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:628, status:SUCCESS 2022-12-08 16:15:06.944 INFO 42 --- [pool-ocp-schedules-1,,] o.s.boot.SpringApplication : Started application in 6.893 seconds (JVM running for 3303.79) 2022-12-08 16:15:07.146 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:15:07.272 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:08.032 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:08.033 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:08.647 INFO 42 --- [pool-ocp-schedules-1,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T16:15:08.647+08:00 2022-12-08 16:15:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:15:08.789 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:15:08.788976+08:00, lastProcessTime=2022-12-08T16:14:58.974771+08:00 2022-12-08 16:15:08.864 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:15:08.788976+08:00, resultsCount=0 2022-12-08 16:15:08.865 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:15:08.788976+08:00, resultsCount=0 2022-12-08 16:15:08.865 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:15:08.788976+08:00 2022-12-08 16:15:09.119 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:09.124 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:10.494 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:15:10.501 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:15:11.207 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:11.593 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:12.125 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:12.129 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:12.154 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:15:13.647 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:15:14.454 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:14.455 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:14.549 INFO 42 --- [http-nio-8080-exec-3,fd41a746817f4770,7976e490fefc] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=192.168.28.1, traceId=fd41a746817f4770, method=SuccessResponse com.alipay.ocp.server.controller.ProfileController.userInfo(), args=] 2022-12-08 16:15:14.570 INFO 42 --- [http-nio-8080-exec-3,fd41a746817f4770,7976e490fefc] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=192.168.28.1, traceId=fd41a746817f4770, duration=25 ms] 2022-12-08 16:15:14.712 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:14.712 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:15.129 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:15.134 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:15.314 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:15:15.456 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:15.596 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:15:15.888 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:15:16.184 INFO 42 --- [pool-ocp-schedules-16,,ca0c821a5d80] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:15:16.426 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:15:16.870 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:15:17.223 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:15:17.328 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:17.837 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:15:17.843 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:15:18.134 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:18.139 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:15:18.805 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:15:18.804285+08:00, lastProcessTime=2022-12-08T16:15:08.788976+08:00 2022-12-08 16:15:18.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:15:18.804285+08:00, resultsCount=0 2022-12-08 16:15:18.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:15:18.804285+08:00, resultsCount=0 2022-12-08 16:15:18.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:15:18.804285+08:00 2022-12-08 16:15:20.794 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:20.938 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:20.0, nextRun=2022-12-08 16:15:20.0, currentDate=Thu Dec 08 16:15:20 CST 2022 2022-12-08 16:15:20.939 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:14:20.0, nextRunTime=2022-12-08 16:15:20.0} 2022-12-08 16:15:20.952 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:20.954 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:15:20.954 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:20.955 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:21.006 INFO 42 --- [http-nio-8080-exec-10,a56cccbe8726436f,77837521af5a] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/alarm/groups?null, client=192.168.28.1, traceId=a56cccbe8726436f, method=ResponseEntity com.alipay.ocp.server.controller.AlarmController.fetchAlarmGroups(Integer,Integer), args=] 2022-12-08 16:15:21.019 INFO 42 --- [http-nio-8080-exec-8,0b8e464bd1d64c41,782fb9f41496] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/users/admin/subscriptions?null, client=192.168.28.1, traceId=0b8e464bd1d64c41, method=ResponseEntity com.alipay.ocp.server.controller.UserController.fetchSubscriptions(String,Integer,Integer,String,String), args=admin,] 2022-12-08 16:15:21.068 INFO 42 --- [http-nio-8080-exec-10,a56cccbe8726436f,77837521af5a] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/groups client=192.168.28.1, traceId=a56cccbe8726436f, duration=66 ms] 2022-12-08 16:15:21.077 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:15:21.104 INFO 42 --- [http-nio-8080-exec-8,0b8e464bd1d64c41,782fb9f41496] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/users/admin/subscriptions client=192.168.28.1, traceId=0b8e464bd1d64c41, duration=99 ms] 2022-12-08 16:15:21.139 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:21.143 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:21.660 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 632, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:21.757 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=632, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:15:21.636+08:00, endTime=null} 2022-12-08 16:15:22.150 INFO 42 --- [http-nio-8080-exec-9,eb0705f0cbd4480d,cddedcbcbafa] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/alarm/channels?null, client=192.168.28.1, traceId=eb0705f0cbd4480d, method=ResponseEntity com.alipay.ocp.server.controller.AlarmController.fetchAlarmChannels(Integer,Integer), args=] 2022-12-08 16:15:22.157 INFO 42 --- [http-nio-8080-exec-4,85c4a46d167a43cf,13267daf89a7] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/users/admin/config/receiveConfig?uid=admin, client=192.168.28.1, traceId=85c4a46d167a43cf, method=ResponseEntity com.alipay.ocp.server.controller.UserController.getUserReceiveConfig(String), args=admin,] 2022-12-08 16:15:22.207 INFO 42 --- [http-nio-8080-exec-9,eb0705f0cbd4480d,cddedcbcbafa] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/channels client=192.168.28.1, traceId=eb0705f0cbd4480d, duration=61 ms] 2022-12-08 16:15:22.260 INFO 42 --- [http-nio-8080-exec-4,85c4a46d167a43cf,13267daf89a7] c.a.o.s.a.service.OcpUserConfigService : create Done, affectRow=1, uid=admin 2022-12-08 16:15:22.277 INFO 42 --- [http-nio-8080-exec-4,85c4a46d167a43cf,13267daf89a7] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/users/admin/config/receiveConfig client=192.168.28.1, traceId=85c4a46d167a43cf, duration=128 ms] 2022-12-08 16:15:23.022 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:629, status:SUCCESS 2022-12-08 16:15:23.030 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:629, status:SUCCESS 2022-12-08 16:15:23.868 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:15:23.914 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:23.915 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:24.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:24.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:24.144 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:24.148 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:25.422 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:27.0, nextRun=2022-12-08 16:15:25.0, currentDate=Thu Dec 08 16:15:25 CST 2022 2022-12-08 16:15:25.423 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:14:27.0, nextRunTime=2022-12-08 16:15:25.0} 2022-12-08 16:15:25.469 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:15:25.469 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:25.470 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:25.503 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:25.865 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 633, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:26.005 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:15:26.014 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=633, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:15:25.853+08:00, endTime=null} 2022-12-08 16:15:26.185 INFO 42 --- [pool-ocp-schedules-15,,9546b3614771] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:15:26.232 INFO 42 --- [pool-ocp-schedules-18,,a1d6556be1db] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:15:26.233 INFO 42 --- [pool-ocp-schedules-18,,a1d6556be1db] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:15:26.562 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:15:26.570 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:15:26.993 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:27.075 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:27.091 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:630, status:SUCCESS 2022-12-08 16:15:27.098 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:630, status:SUCCESS 2022-12-08 16:15:27.148 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:27.153 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:27.328 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:15:27.473 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:27.493 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:15:28.345 INFO 42 --- [http-nio-8080-exec-5,5d13b6b05b6840f5,26d4ebcf2ff5] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/users?page=1&size=10, client=192.168.28.1, traceId=5d13b6b05b6840f5, method=PaginatedResponse com.alipay.ocp.server.controller.IamController.listUsers(Pageable,String), args=Page request [number: 0, size 10, sort: id: DESC],] 2022-12-08 16:15:28.378 INFO 42 --- [http-nio-8080-exec-5,5d13b6b05b6840f5,26d4ebcf2ff5] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/users client=192.168.28.1, traceId=5d13b6b05b6840f5, duration=36 ms] 2022-12-08 16:15:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:15:28.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:15:28.795999+08:00, lastProcessTime=2022-12-08T16:15:18.804285+08:00 2022-12-08 16:15:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:15:28.795999+08:00, resultsCount=0 2022-12-08 16:15:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:15:28.795999+08:00, resultsCount=0 2022-12-08 16:15:28.894 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:15:28.795999+08:00 2022-12-08 16:15:30.065 INFO 42 --- [http-nio-8080-exec-6,036a1cd1ef4045fe,9765280ee2eb] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/roles?null, client=192.168.28.1, traceId=036a1cd1ef4045fe, method=PaginatedResponse com.alipay.ocp.server.controller.IamController.listRoles(String,Pageable), args=Page request [number: 0, size 2000, sort: UNSORTED],] 2022-12-08 16:15:30.087 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:30.087 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:30.154 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:30.160 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:30.210 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:30.210 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:30.224 INFO 42 --- [http-nio-8080-exec-6,036a1cd1ef4045fe,9765280ee2eb] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/roles client=192.168.28.1, traceId=036a1cd1ef4045fe, duration=161 ms] 2022-12-08 16:15:30.496 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:31.0, nextRun=2022-12-08 16:15:30.0, currentDate=Thu Dec 08 16:15:30 CST 2022 2022-12-08 16:15:30.497 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:14:31.0, nextRunTime=2022-12-08 16:15:30.0} 2022-12-08 16:15:30.515 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:15:30.654 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:03.0, nextRun=2022-12-08 16:15:30.0, currentDate=Thu Dec 08 16:15:30 CST 2022 2022-12-08 16:15:30.654 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:15:03.0, nextRunTime=2022-12-08 16:15:30.0} 2022-12-08 16:15:30.672 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:15:30.673 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:15:30.673 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:15:31.150 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 634, operation:EXECUTE, state: RUNNING 2022-12-08 16:15:31.554 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=634, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:15:31.138+08:00, endTime=null} 2022-12-08 16:15:32.120 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:15:32.764 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:15:32.771 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:15:32.909 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:631, status:SUCCESS 2022-12-08 16:15:32.918 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:631, status:SUCCESS 2022-12-08 16:15:32.993 INFO 42 --- [http-nio-8080-exec-2,95e205c55e3649ad,a2d6b6960fd6] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/users?page=1&size=10, client=192.168.28.1, traceId=95e205c55e3649ad, method=PaginatedResponse com.alipay.ocp.server.controller.IamController.listUsers(Pageable,String), args=Page request [number: 0, size 10, sort: id: DESC],] 2022-12-08 16:15:33.029 INFO 42 --- [http-nio-8080-exec-2,95e205c55e3649ad,a2d6b6960fd6] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/users client=192.168.28.1, traceId=95e205c55e3649ad, duration=38 ms] 2022-12-08 16:15:33.161 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:33.165 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:33.299 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:33.419 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:33.880 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:15:33.913 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:15:34.569 INFO 42 --- [http-nio-8080-exec-8,6a040a179afc4ef3,33b1cb97cc11] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/rateLimiter/resources?null, client=192.168.28.1, traceId=6a040a179afc4ef3, method=IterableResponse com.alipay.ocp.server.controller.RateLimiterController.listLimiterResources(), args=] 2022-12-08 16:15:34.570 INFO 42 --- [http-nio-8080-exec-10,703b12e20ea94259,d671fa3ee82e] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/roles?null, client=192.168.28.1, traceId=703b12e20ea94259, method=PaginatedResponse com.alipay.ocp.server.controller.IamController.listRoles(String,Pageable), args=Page request [number: 0, size 2000, sort: UNSORTED],] 2022-12-08 16:15:34.570 INFO 42 --- [http-nio-8080-exec-7,622d0c2ee3fb4ac5,762368bb60c0] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=622d0c2ee3fb4ac5, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:15:34.571 INFO 42 --- [http-nio-8080-exec-8,6a040a179afc4ef3,33b1cb97cc11] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/rateLimiter/resources client=192.168.28.1, traceId=6a040a179afc4ef3, duration=3 ms] 2022-12-08 16:15:34.573 INFO 42 --- [http-nio-8080-exec-9,4dc213f34e634aef,18575af92f5a] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/users/100?id=100, client=192.168.28.1, traceId=4dc213f34e634aef, method=SuccessResponse com.alipay.ocp.server.controller.IamController.getUserById(long), args=100,] 2022-12-08 16:15:34.577 INFO 42 --- [http-nio-8080-exec-4,c2add9db84af4551,25e3ce852021] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/rateLimiter/policies/USER/100?objectType=USER&objectId=100, client=192.168.28.1, traceId=c2add9db84af4551, method=SuccessResponse com.alipay.ocp.server.controller.RateLimiterController.listLimiterResources(String,String), args=USER,100,] 2022-12-08 16:15:34.580 INFO 42 --- [http-nio-8080-exec-4,c2add9db84af4551,25e3ce852021] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/rateLimiter/policies/USER/100 client=192.168.28.1, traceId=c2add9db84af4551, duration=3 ms] 2022-12-08 16:15:34.584 INFO 42 --- [http-nio-8080-exec-9,4dc213f34e634aef,18575af92f5a] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/users/100 client=192.168.28.1, traceId=4dc213f34e634aef, duration=12 ms] 2022-12-08 16:15:34.618 INFO 42 --- [http-nio-8080-exec-7,622d0c2ee3fb4ac5,762368bb60c0] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=622d0c2ee3fb4ac5, duration=49 ms] 2022-12-08 16:15:34.655 INFO 42 --- [http-nio-8080-exec-10,703b12e20ea94259,d671fa3ee82e] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/roles client=192.168.28.1, traceId=703b12e20ea94259, duration=86 ms] 2022-12-08 16:15:35.574 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:35.725 INFO 42 --- [http-nio-8080-exec-5,f8f8b277eba8417c,7539184aa145] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/iam/roles?null, client=192.168.28.1, traceId=f8f8b277eba8417c, method=PaginatedResponse com.alipay.ocp.server.controller.IamController.listRoles(String,Pageable), args=Page request [number: 0, size 2000, sort: UNSORTED],] 2022-12-08 16:15:35.755 INFO 42 --- [http-nio-8080-exec-1,e806eb8f2f704664,c2f4430ea6f3] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=192.168.28.1, traceId=e806eb8f2f704664, method=PaginatedResponse com.alipay.ocp.server.controller.ObClusterController.listObClusters(String,List,Boolean,WithRemote,Pageable), args=NONE,Page request [number: 0, size 2000, sort: id: DESC],] 2022-12-08 16:15:35.804 INFO 42 --- [http-nio-8080-exec-1,e806eb8f2f704664,c2f4430ea6f3] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.28.1, traceId=e806eb8f2f704664, duration=51 ms] 2022-12-08 16:15:35.847 INFO 42 --- [http-nio-8080-exec-5,f8f8b277eba8417c,7539184aa145] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/roles client=192.168.28.1, traceId=f8f8b277eba8417c, duration=124 ms] 2022-12-08 16:15:36.166 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:36.170 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:36.181 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:15:36.186 INFO 42 --- [pool-ocp-schedules-13,,b3477fb4853d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:15:36.376 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:36.377 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:36.479 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:36.479 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:37.474 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:15:37.686 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:15:38.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:15:38.796516+08:00, lastProcessTime=2022-12-08T16:15:28.795999+08:00 2022-12-08 16:15:38.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:15:38.796516+08:00, resultsCount=0 2022-12-08 16:15:38.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:15:38.796516+08:00, resultsCount=0 2022-12-08 16:15:38.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:15:38.796516+08:00 2022-12-08 16:15:39.159 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:15:39.165 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:15:39.171 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:39.176 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:39.431 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:39.534 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:39.844 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:15:40.315 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:15:40.330 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=14ms, period=120000ms 2022-12-08 16:15:40.574 INFO 42 --- [http-nio-8080-exec-3,be78c68c58e94544,e264971d981d] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/properties?null, client=192.168.28.1, traceId=be78c68c58e94544, method=PaginatedResponse com.alipay.ocp.server.controller.PropertyController.findNonFatalProperties(String,Pageable), args=Page request [number: 0, size 2000, sort: key: ASC],] 2022-12-08 16:15:40.649 INFO 42 --- [http-nio-8080-exec-3,be78c68c58e94544,e264971d981d] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/properties client=192.168.28.1, traceId=be78c68c58e94544, duration=78 ms] 2022-12-08 16:15:42.176 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:42.181 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:42.840 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:42.840 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:42.842 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:42.843 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:44.079 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:15:45.182 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:45.186 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:45.381 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:15:45.388 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:15:45.456 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:15:45.471 INFO 42 --- [pool-ocp-schedules-10,,93db1a078a30] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:15:45.480 INFO 42 --- [pool-ocp-schedules-7,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 16:15:45.502 INFO 42 --- [pool-ocp-schedules-10,,93db1a078a30] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:15:45.687 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:45.724 INFO 42 --- [pool-ocp-schedules-2,,3a2d604a5caa] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:15:45.763 INFO 42 --- [pool-ocp-schedules-9,,bf0b5aa4bf43] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:15:45.764 INFO 42 --- [pool-ocp-schedules-9,,bf0b5aa4bf43] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:15:45.981 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:45.983 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:46.078 INFO 42 --- [pool-ocp-schedules-12,,6b7e198b7fef] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 16:15:46.187 INFO 42 --- [pool-ocp-schedules-11,,8227eb6e2219] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:15:46.211 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:15:46.245 INFO 42 --- [pool-ocp-schedules-1,,4f282edb5ec8] c.a.o.s.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2022-12-08 16:15:46.273 INFO 42 --- [pool-ocp-schedules-5,,0a4b691df27c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:15:46.274 INFO 42 --- [pool-ocp-schedules-5,,0a4b691df27c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:15:46.284 INFO 42 --- [pool-ocp-schedules-10,,f305da900bbf] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:15:46.427 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:15:46.514 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:15:46.778 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:11:45+08:00, updateTime=2022-12-08T16:15:15+08:00, expireTime=null, isLeader=false} 2022-12-08 16:15:46.786 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 16:15:47.021 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:15:47.261 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:14:46+08:00, updateTime=2022-12-08T16:15:16+08:00, expireTime=null, isLeader=false} 2022-12-08 16:15:47.270 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:15:47.350 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:15:47.687 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:15:48.128 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:48.187 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:48.191 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:15:48.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:15:48.798068+08:00, lastProcessTime=2022-12-08T16:15:38.796516+08:00 2022-12-08 16:15:48.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:15:48.798068+08:00, resultsCount=0 2022-12-08 16:15:48.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:15:48.798068+08:00, resultsCount=0 2022-12-08 16:15:48.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:15:48.798068+08:00 2022-12-08 16:15:49.046 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:49.047 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:49.049 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:49.049 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:51.192 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:51.195 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:52.403 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:15:52.409 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:15:52.770 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:52.770 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:53.081 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:15:54.196 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:54.200 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:54.404 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:15:55.778 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:55.827 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:55.828 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:55.867 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:15:55.868 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:15:56.188 INFO 42 --- [pool-ocp-schedules-8,,52a5a24a247c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:15:56.242 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:15:57.201 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:15:57.204 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:15:58.128 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:15:58.344 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:15:58.438 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:15:58.446 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:15:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,e7a7f5f911c6] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:15:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,e7a7f5f911c6] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:15:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:15:58.806 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:15:58.806444+08:00, lastProcessTime=2022-12-08T16:15:48.798068+08:00 2022-12-08 16:15:58.939 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:15:58.806444+08:00, resultsCount=0 2022-12-08 16:15:58.940 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:15:58.806444+08:00, resultsCount=0 2022-12-08 16:15:58.940 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:15:58.806444+08:00 2022-12-08 16:15:58.965 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:58.966 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:15:59.593 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:15:59.730 INFO 42 --- [pool-ocp-schedules-4,,def78e474fcd] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:15:59.730 INFO 42 --- [pool-ocp-schedules-13,,9d09f3aec086] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:15:59.731 INFO 42 --- [pool-ocp-schedules-2,,c5f09826290f] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:15:59.874 INFO 42 --- [pool-ocp-schedules-10,,8d2a39aea004] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:15:59.875 INFO 42 --- [pool-ocp-schedules-10,,8d2a39aea004] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:15:59.876 INFO 42 --- [pool-ocp-schedules-10,,8d2a39aea004] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:16:00.008 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:02.0, nextRun=2022-12-08 16:16:00.0, currentDate=Thu Dec 08 16:16:00 CST 2022 2022-12-08 16:16:00.009 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:15:02.0, nextRunTime=2022-12-08 16:16:00.0} 2022-12-08 16:16:00.032 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:16:00.034 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:16:00.034 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:16:00.205 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:00.210 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:02.0, nextRun=2022-12-08 16:16:00.0, currentDate=Thu Dec 08 16:16:00 CST 2022 2022-12-08 16:16:00.210 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:15:02.0, nextRunTime=2022-12-08 16:16:00.0} 2022-12-08 16:16:00.211 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:00.234 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:16:00.234 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:16:00.235 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:16:00.619 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:02.0, nextRun=2022-12-08 16:16:00.0, currentDate=Thu Dec 08 16:16:00 CST 2022 2022-12-08 16:16:00.620 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:15:02.0, nextRunTime=2022-12-08 16:16:00.0} 2022-12-08 16:16:00.647 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:16:00.648 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:16:00.648 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:16:00.789 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:31.0, nextRun=2022-12-08 16:16:00.0, currentDate=Thu Dec 08 16:16:00 CST 2022 2022-12-08 16:16:00.790 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:15:31.0, nextRunTime=2022-12-08 16:16:00.0} 2022-12-08 16:16:00.805 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:16:00.806 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:16:00.806 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:16:01.086 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:03.0, nextRun=2022-12-08 16:16:00.0, currentDate=Thu Dec 08 16:16:01 CST 2022 2022-12-08 16:16:01.086 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:15:03.0, nextRunTime=2022-12-08 16:16:00.0} 2022-12-08 16:16:01.105 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:16:01.106 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:16:01.106 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:16:01.126 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 635, operation:EXECUTE, state: RUNNING 2022-12-08 16:16:01.805 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=635, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:16:01.115+08:00, endTime=null} 2022-12-08 16:16:01.897 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 636, operation:EXECUTE, state: RUNNING 2022-12-08 16:16:02.080 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=636, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:16:01.878+08:00, endTime=null} 2022-12-08 16:16:02.142 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 637, operation:EXECUTE, state: RUNNING 2022-12-08 16:16:02.390 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:16:02.584 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:02.585 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:02.590 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:02.591 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,484ca6029f1a] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487420, interval=60 2022-12-08 16:16:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,484ca6029f1a] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487362, count=0, elapsed=1668816875274 2022-12-08 16:16:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,e8b381ee442d] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487420, interval=60 2022-12-08 16:16:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,e8b381ee442d] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487362, count=0, elapsed=1668816875278 2022-12-08 16:16:02.717 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=637, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:16:02.128+08:00, endTime=null} 2022-12-08 16:16:02.790 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 638, operation:EXECUTE, state: RUNNING 2022-12-08 16:16:02.925 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=638, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:16:02.774+08:00, endTime=null} 2022-12-08 16:16:03.101 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:632, status:SUCCESS 2022-12-08 16:16:03.109 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:632, status:SUCCESS 2022-12-08 16:16:03.211 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:03.217 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:03.362 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:14:01.0, nextRun=2022-12-08 16:16:00.0, currentDate=Thu Dec 08 16:16:03 CST 2022 2022-12-08 16:16:03.363 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:14:01.0, nextRunTime=2022-12-08 16:16:00.0} 2022-12-08 16:16:03.383 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:16:03.461 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:633, status:SUCCESS 2022-12-08 16:16:03.467 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:633, status:SUCCESS 2022-12-08 16:16:03.727 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:634, status:SUCCESS 2022-12-08 16:16:03.733 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:634, status:SUCCESS 2022-12-08 16:16:03.969 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:635, status:SUCCESS 2022-12-08 16:16:03.976 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:635, status:SUCCESS 2022-12-08 16:16:04.028 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 639, operation:EXECUTE, state: RUNNING 2022-12-08 16:16:04.259 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=639, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:16:04.004+08:00, endTime=null} 2022-12-08 16:16:04.571 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:16:04.872 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:16:04.879 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:16:05.061 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:05.0, nextRun=2022-12-08 16:16:05.0, currentDate=Thu Dec 08 16:16:05 CST 2022 2022-12-08 16:16:05.062 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:15:05.0, nextRunTime=2022-12-08 16:16:05.0} 2022-12-08 16:16:05.077 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:16:05.078 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:16:05.078 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:16:05.856 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:05.857 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:05.918 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:06.096 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 640, operation:EXECUTE, state: RUNNING 2022-12-08 16:16:06.190 INFO 42 --- [pool-ocp-schedules-19,,cd2337787801] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:16:06.218 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:06.221 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:06.285 INFO 42 --- [pool-subtask-coordinator4,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=640, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:16:06.080+08:00, endTime=null} 2022-12-08 16:16:06.299 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:636, status:SUCCESS 2022-12-08 16:16:06.306 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:636, status:SUCCESS 2022-12-08 16:16:06.385 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:16:06.451 INFO 42 --- [pool-ocp-schedules-2,,aacc57140278] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:16:06.452 INFO 42 --- [pool-ocp-schedules-2,,aacc57140278] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:16:06.489 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:16:07.866 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:637, status:SUCCESS 2022-12-08 16:16:07.872 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:637, status:SUCCESS 2022-12-08 16:16:08.345 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:16:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:16:08.791 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:08.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:16:08.797594+08:00, lastProcessTime=2022-12-08T16:15:58.806444+08:00 2022-12-08 16:16:08.919 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:16:08.797594+08:00, resultsCount=0 2022-12-08 16:16:08.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:16:08.797594+08:00, resultsCount=0 2022-12-08 16:16:08.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:16:08.797594+08:00 2022-12-08 16:16:09.222 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:09.225 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:09.290 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:09.290 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:09.291 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:09.291 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:11.766 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:16:11.773 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:16:12.226 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:12.230 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:12.415 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:12.415 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:12.986 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:16:14.634 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:16:15.231 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:15.235 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:15.569 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:16:15.985 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:15.986 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:15.986 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:15.986 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:16.191 INFO 42 --- [pool-ocp-schedules-11,,211bfca6ab7f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:16:16.277 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:16.672 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:16:17.021 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:16:17.150 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:15:46+08:00, updateTime=2022-12-08T16:15:46+08:00, expireTime=null, isLeader=false} 2022-12-08 16:16:17.157 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 16:16:17.350 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:16:17.707 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:16:18.236 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:18.241 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:18.324 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:16:18.331 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:16:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:16:18.791 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:16:18.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:16:18.799228+08:00, lastProcessTime=2022-12-08T16:16:08.797594+08:00 2022-12-08 16:16:18.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:16:18.799228+08:00, resultsCount=0 2022-12-08 16:16:18.920 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:16:18.799228+08:00, resultsCount=0 2022-12-08 16:16:18.921 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:16:18.799228+08:00 2022-12-08 16:16:18.956 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:19.343 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:19.345 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:19.466 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:16:21.065 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:21.0, nextRun=2022-12-08 16:16:20.0, currentDate=Thu Dec 08 16:16:21 CST 2022 2022-12-08 16:16:21.066 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:15:21.0, nextRunTime=2022-12-08 16:16:20.0} 2022-12-08 16:16:21.082 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:16:21.083 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:16:21.083 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:16:21.242 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:21.249 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:21.562 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 641, operation:EXECUTE, state: RUNNING 2022-12-08 16:16:21.871 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=641, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:16:21.550+08:00, endTime=null} 2022-12-08 16:16:22.439 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:638, status:SUCCESS 2022-12-08 16:16:22.446 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:638, status:SUCCESS 2022-12-08 16:16:22.466 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:22.466 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:22.466 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:22.467 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:23.593 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T16:10:22.727, end=2022-12-08T16:15:23.463} 2022-12-08 16:16:23.593 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T16:10:22.727, end=2022-12-08T16:15:23.46} 2022-12-08 16:16:23.626 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 16:16:23.626 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 16:16:24.250 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:24.256 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:25.028 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:16:25.034 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:16:25.469 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:16:25.922 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:25.923 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:26.192 INFO 42 --- [pool-ocp-schedules-3,,448cd5d6580c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:16:26.391 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:26.757 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:16:26.760 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:16:26.872 INFO 42 --- [pool-ocp-schedules-2,,ea6d413e9853] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:16:26.873 INFO 42 --- [pool-ocp-schedules-2,,ea6d413e9853] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:16:26.940 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:25.0, nextRun=2022-12-08 16:16:25.0, currentDate=Thu Dec 08 16:16:26 CST 2022 2022-12-08 16:16:26.941 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:15:25.0, nextRunTime=2022-12-08 16:16:25.0} 2022-12-08 16:16:26.984 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:16:26.985 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:16:26.985 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:16:27.257 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:27.262 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:28.015 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 642, operation:EXECUTE, state: RUNNING 2022-12-08 16:16:28.065 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=642, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:16:28.003+08:00, endTime=null} 2022-12-08 16:16:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:16:28.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:16:28.798296+08:00, lastProcessTime=2022-12-08T16:16:18.799228+08:00 2022-12-08 16:16:28.853 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:16:28.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:16:28.798296+08:00, resultsCount=0 2022-12-08 16:16:28.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:16:28.798296+08:00, resultsCount=0 2022-12-08 16:16:28.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:16:28.798296+08:00 2022-12-08 16:16:29.131 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:29.518 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:639, status:SUCCESS 2022-12-08 16:16:29.525 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:639, status:SUCCESS 2022-12-08 16:16:29.757 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:29.757 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:29.759 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:29.759 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:30.263 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:30.268 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:30.671 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:30.0, nextRun=2022-12-08 16:16:30.0, currentDate=Thu Dec 08 16:16:30 CST 2022 2022-12-08 16:16:30.671 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:15:30.0, nextRunTime=2022-12-08 16:16:30.0} 2022-12-08 16:16:30.691 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:16:31.242 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:01.0, nextRun=2022-12-08 16:16:30.0, currentDate=Thu Dec 08 16:16:31 CST 2022 2022-12-08 16:16:31.242 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:16:01.0, nextRunTime=2022-12-08 16:16:30.0} 2022-12-08 16:16:31.261 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:16:31.261 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:16:31.262 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:16:32.139 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:16:32.145 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:16:32.181 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 643, operation:EXECUTE, state: RUNNING 2022-12-08 16:16:32.392 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=643, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:16:32.168+08:00, endTime=null} 2022-12-08 16:16:32.838 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:33.157 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:16:33.168 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:33.269 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:33.273 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:33.765 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:16:33.949 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:640, status:SUCCESS 2022-12-08 16:16:33.956 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:640, status:SUCCESS 2022-12-08 16:16:34.616 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T16:12:34.033, end=2022-12-08T16:14:34.334} 2022-12-08 16:16:34.630 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:16:36.088 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:36.089 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:36.193 INFO 42 --- [pool-ocp-schedules-4,,2febeed58f91] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:16:36.274 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:36.278 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:36.317 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:36.318 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:36.342 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:16:36.872 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:37.044 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:16:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:16:38.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:16:38.797026+08:00, lastProcessTime=2022-12-08T16:16:28.798296+08:00 2022-12-08 16:16:38.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:16:38.797026+08:00, resultsCount=0 2022-12-08 16:16:38.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:16:38.797026+08:00, resultsCount=0 2022-12-08 16:16:38.898 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:16:38.797026+08:00 2022-12-08 16:16:39.059 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:16:39.279 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:39.287 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:39.295 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:16:39.302 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:16:39.454 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:39.647 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:39.647 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:40.181 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:16:42.288 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:42.294 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:42.792 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:42.793 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:42.795 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:42.796 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:45.295 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:45.301 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:45.472 INFO 42 --- [pool-ocp-schedules-12,,998eb1c4558b] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:16:45.514 INFO 42 --- [pool-ocp-schedules-12,,998eb1c4558b] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:16:45.644 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:16:45.725 INFO 42 --- [pool-ocp-schedules-1,,efb84d0387c6] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:16:46.194 INFO 42 --- [pool-ocp-schedules-20,,b45675d50020] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:16:46.214 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:16:46.221 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:16:46.288 INFO 42 --- [pool-ocp-schedules-2,,6c35565fdc7f] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:16:46.485 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:16:46.960 INFO 42 --- [pool-ocp-schedules-18,,b52a4e0fccf4] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:16:46.960 INFO 42 --- [pool-ocp-schedules-18,,b52a4e0fccf4] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:16:47.006 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:47.205 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:16:47.287 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:16:47.583 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:16:48.256 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:16:48.301 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:48.306 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:16:48.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:16:48.799092+08:00, lastProcessTime=2022-12-08T16:16:38.797026+08:00 2022-12-08 16:16:48.923 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:16:48.799092+08:00, resultsCount=0 2022-12-08 16:16:48.924 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:16:48.799092+08:00, resultsCount=0 2022-12-08 16:16:48.924 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:16:48.799092+08:00 2022-12-08 16:16:49.187 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:49.190 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:49.241 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:16:49.381 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:16:49.676 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:51.306 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:51.311 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:52.273 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:52.273 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:52.275 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:52.275 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:54.312 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:54.317 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:54.707 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:16:54.714 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:16:55.474 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:55.475 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:16:55.822 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:16:56.195 INFO 42 --- [pool-ocp-schedules-1,,ebf651f58209] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:16:56.564 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:16:57.053 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:16:57.317 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:16:57.322 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:16:57.740 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:16:58.635 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:58.636 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:58.636 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:16:58.637 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:16:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,cf9067c46e03] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:16:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,cf9067c46e03] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:16:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:16:58.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:16:58.796912+08:00, lastProcessTime=2022-12-08T16:16:48.799092+08:00 2022-12-08 16:16:58.930 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:16:58.796912+08:00, resultsCount=0 2022-12-08 16:16:58.931 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:16:58.796912+08:00, resultsCount=0 2022-12-08 16:16:58.931 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:16:58.796912+08:00 2022-12-08 16:16:59.273 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:16:59.735 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:00.205 INFO 42 --- [pool-ocp-schedules-11,,0f6616965b09] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:17:00.205 INFO 42 --- [pool-ocp-schedules-14,,f06bb35eb6ef] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:17:00.205 INFO 42 --- [pool-ocp-schedules-5,,e8432779e6e8] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:17:00.323 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:00.332 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:00.369 INFO 42 --- [pool-ocp-schedules-7,,e5772e44ace5] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:17:00.370 INFO 42 --- [pool-ocp-schedules-7,,e5772e44ace5] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:17:00.370 INFO 42 --- [pool-ocp-schedules-7,,e5772e44ace5] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:17:00.733 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:00.0, nextRun=2022-12-08 16:17:00.0, currentDate=Thu Dec 08 16:17:00 CST 2022 2022-12-08 16:17:00.734 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:16:00.0, nextRunTime=2022-12-08 16:17:00.0} 2022-12-08 16:17:00.751 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:17:00.751 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:17:00.751 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:17:00.842 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:00.0, nextRun=2022-12-08 16:17:00.0, currentDate=Thu Dec 08 16:17:00 CST 2022 2022-12-08 16:17:00.843 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:16:00.0, nextRunTime=2022-12-08 16:17:00.0} 2022-12-08 16:17:00.866 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:17:00.867 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:17:00.867 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:17:00.971 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:01.0, nextRun=2022-12-08 16:17:00.0, currentDate=Thu Dec 08 16:17:00 CST 2022 2022-12-08 16:17:00.972 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:16:01.0, nextRunTime=2022-12-08 16:17:00.0} 2022-12-08 16:17:00.996 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:17:00.997 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:17:00.997 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:17:01.018 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 644, operation:EXECUTE, state: RUNNING 2022-12-08 16:17:01.038 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:17:01.044 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:17:01.051 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:31.0, nextRun=2022-12-08 16:17:00.0, currentDate=Thu Dec 08 16:17:01 CST 2022 2022-12-08 16:17:01.052 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:16:31.0, nextRunTime=2022-12-08 16:17:00.0} 2022-12-08 16:17:01.070 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=644, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:17:01.008+08:00, endTime=null} 2022-12-08 16:17:01.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:17:01.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:17:01.073 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:17:01.129 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:01.0, nextRun=2022-12-08 16:17:00.0, currentDate=Thu Dec 08 16:17:01 CST 2022 2022-12-08 16:17:01.129 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 645, operation:EXECUTE, state: RUNNING 2022-12-08 16:17:01.130 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:16:01.0, nextRunTime=2022-12-08 16:17:00.0} 2022-12-08 16:17:01.154 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:17:01.155 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:17:01.156 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:17:01.157 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=645, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:17:01.117+08:00, endTime=null} 2022-12-08 16:17:01.915 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:01.915 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:02.031 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:641, status:SUCCESS 2022-12-08 16:17:02.038 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:641, status:SUCCESS 2022-12-08 16:17:02.140 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:17:02.236 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 646, operation:EXECUTE, state: RUNNING 2022-12-08 16:17:02.408 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:642, status:SUCCESS 2022-12-08 16:17:02.427 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:642, status:SUCCESS 2022-12-08 16:17:02.530 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=646, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:17:02.224+08:00, endTime=null} 2022-12-08 16:17:02.609 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 647, operation:EXECUTE, state: RUNNING 2022-12-08 16:17:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,5929af981b04] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487480, interval=60 2022-12-08 16:17:02.636 INFO 42 --- [pool-prometheus-minute-schedule-2,,5929af981b04] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487422, count=0, elapsed=1668816935214 2022-12-08 16:17:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,a07f7be8936a] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487480, interval=60 2022-12-08 16:17:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,a07f7be8936a] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487422, count=0, elapsed=1668816935218 2022-12-08 16:17:02.701 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=647, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:17:02.594+08:00, endTime=null} 2022-12-08 16:17:02.793 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 648, operation:EXECUTE, state: RUNNING 2022-12-08 16:17:02.860 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=648, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:17:02.779+08:00, endTime=null} 2022-12-08 16:17:03.333 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:03.345 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:03.570 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:17:03.840 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:643, status:SUCCESS 2022-12-08 16:17:03.847 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:643, status:SUCCESS 2022-12-08 16:17:03.933 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:644, status:SUCCESS 2022-12-08 16:17:03.938 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:644, status:SUCCESS 2022-12-08 16:17:04.041 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:645, status:SUCCESS 2022-12-08 16:17:04.047 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:645, status:SUCCESS 2022-12-08 16:17:05.025 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:05.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:05.033 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:05.034 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:05.162 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:05.0, nextRun=2022-12-08 16:17:05.0, currentDate=Thu Dec 08 16:17:05 CST 2022 2022-12-08 16:17:05.162 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:16:05.0, nextRunTime=2022-12-08 16:17:05.0} 2022-12-08 16:17:05.179 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:17:05.180 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:17:05.180 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:17:05.980 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 649, operation:EXECUTE, state: RUNNING 2022-12-08 16:17:06.156 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=649, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:17:05.969+08:00, endTime=null} 2022-12-08 16:17:06.197 INFO 42 --- [pool-ocp-schedules-8,,6a737819275d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:17:06.346 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:06.353 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:06.992 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:17:07.272 INFO 42 --- [pool-ocp-schedules-11,,00f63224009c] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:17:07.272 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:07.273 INFO 42 --- [pool-ocp-schedules-11,,00f63224009c] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:17:07.778 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:17:07.783 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:17:07.837 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:646, status:SUCCESS 2022-12-08 16:17:07.842 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:646, status:SUCCESS 2022-12-08 16:17:08.103 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:08.104 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:08.162 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:17:08.398 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:17:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:17:08.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:17:08.797419+08:00, lastProcessTime=2022-12-08T16:16:58.796912+08:00 2022-12-08 16:17:08.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:17:08.797419+08:00, resultsCount=0 2022-12-08 16:17:08.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:17:08.797419+08:00, resultsCount=0 2022-12-08 16:17:08.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:17:08.797419+08:00 2022-12-08 16:17:09.310 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:17:09.354 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:09.359 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:10.202 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:11.185 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:11.185 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:11.186 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:11.186 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:12.360 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:12.365 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:13.833 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:17:13.839 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:17:14.356 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:14.356 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:15.045 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:17:15.365 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:15.370 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:15.687 INFO 42 --- [http-nio-8080-exec-9,,] c.a.o.s.i.a.CsrfRequestMatcher : CSRF token required for API [PUT /api/v2/config/properties/62, client 192.168.28.1, traceId ] 2022-12-08 16:17:15.709 INFO 42 --- [http-nio-8080-exec-9,67656c56124a487c,2333b6d732e8] c.a.o.server.trace.RequestTracingAspect : API: [PUT /api/v2/config/properties/62?newValue=1, client=192.168.28.1, traceId=67656c56124a487c, method=SuccessResponse com.alipay.ocp.server.controller.PropertyController.updateProperty(long,String), args=62,1,] 2022-12-08 16:17:15.885 INFO 42 --- [http-nio-8080-exec-9,67656c56124a487c,2333b6d732e8] c.a.o.service.property.PropertyService : Updated property, key=ocp.iam.login.client.lockout-minutes, previousValue=1, updatedValue=1 2022-12-08 16:17:15.886 INFO 42 --- [http-nio-8080-exec-9,67656c56124a487c,2333b6d732e8] c.a.o.server.trace.RequestTracingAspect : API OK: [PUT /api/v2/config/properties/62 client=192.168.28.1, traceId=67656c56124a487c, duration=188 ms] 2022-12-08 16:17:16.097 INFO 42 --- [http-nio-8080-exec-7,4131248e859a4ace,70313183320d] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/properties?null, client=192.168.28.1, traceId=4131248e859a4ace, method=PaginatedResponse com.alipay.ocp.server.controller.PropertyController.findNonFatalProperties(String,Pageable), args=Page request [number: 0, size 2000, sort: key: ASC],] 2022-12-08 16:17:16.140 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:17:16.171 INFO 42 --- [http-nio-8080-exec-7,4131248e859a4ace,70313183320d] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/properties client=192.168.28.1, traceId=4131248e859a4ace, duration=77 ms] 2022-12-08 16:17:16.198 INFO 42 --- [pool-ocp-schedules-1,,88df464b01ba] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:17:16.213 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:14:45+08:00, updateTime=2022-12-08T16:16:45+08:00, expireTime=null, isLeader=false} 2022-12-08 16:17:16.222 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:17:17.272 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:17:17.537 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:17.537 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:17.597 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:17:17.925 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:18.045 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:18.047 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:18.179 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:17:18.360 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:15:47+08:00, updateTime=2022-12-08T16:16:47+08:00, expireTime=null, isLeader=false} 2022-12-08 16:17:18.366 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:17:18.370 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:18.377 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:18.547 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:17:18.703 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:17:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:17:18.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:17:18.794042+08:00, lastProcessTime=2022-12-08T16:17:08.797419+08:00 2022-12-08 16:17:18.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:17:18.794042+08:00, resultsCount=0 2022-12-08 16:17:18.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:17:18.794042+08:00, resultsCount=0 2022-12-08 16:17:18.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:17:18.794042+08:00 2022-12-08 16:17:19.720 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:17:20.620 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:20.783 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:17:20.790 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:17:21.130 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:21.0, nextRun=2022-12-08 16:17:20.0, currentDate=Thu Dec 08 16:17:21 CST 2022 2022-12-08 16:17:21.131 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:16:21.0, nextRunTime=2022-12-08 16:17:20.0} 2022-12-08 16:17:21.150 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:17:21.150 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:17:21.151 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:17:21.205 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:21.377 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:21.382 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:21.429 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 650, operation:EXECUTE, state: RUNNING 2022-12-08 16:17:21.781 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=650, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:17:21.416+08:00, endTime=null} 2022-12-08 16:17:22.139 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:647, status:SUCCESS 2022-12-08 16:17:22.147 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:647, status:SUCCESS 2022-12-08 16:17:23.752 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:23.984 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:17:24.290 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:24.290 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:24.383 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:24.388 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:26.083 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:27.0, nextRun=2022-12-08 16:17:25.0, currentDate=Thu Dec 08 16:17:26 CST 2022 2022-12-08 16:17:26.084 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:16:27.0, nextRunTime=2022-12-08 16:17:25.0} 2022-12-08 16:17:26.138 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:17:26.139 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:17:26.139 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:17:26.199 INFO 42 --- [pool-ocp-schedules-15,,b2e174666cdd] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:17:26.921 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 651, operation:EXECUTE, state: RUNNING 2022-12-08 16:17:26.936 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:26.937 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:27.049 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=651, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:17:26.910+08:00, endTime=null} 2022-12-08 16:17:27.338 INFO 42 --- [pool-ocp-schedules-16,,868c69e137ed] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:17:27.339 INFO 42 --- [pool-ocp-schedules-16,,868c69e137ed] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:17:27.389 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:27.393 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:27.597 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:17:28.156 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:648, status:SUCCESS 2022-12-08 16:17:28.163 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:648, status:SUCCESS 2022-12-08 16:17:28.179 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:28.652 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:17:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:17:28.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:17:28.792851+08:00, lastProcessTime=2022-12-08T16:17:18.794042+08:00 2022-12-08 16:17:28.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:17:28.792851+08:00, resultsCount=0 2022-12-08 16:17:28.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:17:28.792851+08:00, resultsCount=0 2022-12-08 16:17:28.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:17:28.792851+08:00 2022-12-08 16:17:29.495 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:17:29.501 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:17:29.902 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:17:30.055 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:30.394 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:30.398 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:30.711 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:30.983 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:31.170 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:17:31.234 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:31.0, nextRun=2022-12-08 16:17:30.0, currentDate=Thu Dec 08 16:17:31 CST 2022 2022-12-08 16:17:31.235 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:16:31.0, nextRunTime=2022-12-08 16:17:30.0} 2022-12-08 16:17:31.264 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:17:31.533 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:17:01.0, nextRun=2022-12-08 16:17:30.0, currentDate=Thu Dec 08 16:17:31 CST 2022 2022-12-08 16:17:31.534 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:17:01.0, nextRunTime=2022-12-08 16:17:30.0} 2022-12-08 16:17:31.552 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:17:31.553 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:17:31.553 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:17:32.179 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 652, operation:EXECUTE, state: RUNNING 2022-12-08 16:17:32.328 INFO 42 --- [pool-subtask-coordinator3,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=652, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:17:32.166+08:00, endTime=null} 2022-12-08 16:17:33.160 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:33.160 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:33.399 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:33.403 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:33.954 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:649, status:SUCCESS 2022-12-08 16:17:33.960 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:649, status:SUCCESS 2022-12-08 16:17:34.125 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:17:34.162 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:34.162 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:36.200 INFO 42 --- [pool-ocp-schedules-5,,3d943675a27c] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:17:36.403 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:36.408 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:36.722 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:17:36.728 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:17:37.252 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:37.918 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:17:38.478 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:17:38.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:17:38.795247+08:00, lastProcessTime=2022-12-08T16:17:28.792851+08:00 2022-12-08 16:17:38.818 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:17:38.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:17:38.795247+08:00, resultsCount=0 2022-12-08 16:17:38.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:17:38.795247+08:00, resultsCount=0 2022-12-08 16:17:38.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:17:38.795247+08:00 2022-12-08 16:17:39.409 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:39.414 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:39.692 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:39.956 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:17:40.029 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:17:40.190 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:17:40.203 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=13ms, period=120000ms 2022-12-08 16:17:40.355 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:40.355 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:40.974 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:42.414 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:42.419 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:42.906 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:42.906 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:44.430 INFO 42 --- [http-nio-8080-exec-1,,] c.a.o.s.i.a.CsrfRequestMatcher : CSRF token required for API [PUT /api/v2/config/properties/61, client 192.168.28.1, traceId ] 2022-12-08 16:17:44.438 INFO 42 --- [http-nio-8080-exec-1,329eca102ef64a3c,06a8fac86363] c.a.o.server.trace.RequestTracingAspect : API: [PUT /api/v2/config/properties/61?newValue=100, client=192.168.28.1, traceId=329eca102ef64a3c, method=SuccessResponse com.alipay.ocp.server.controller.PropertyController.updateProperty(long,String), args=61,100,] 2022-12-08 16:17:44.477 INFO 42 --- [http-nio-8080-exec-1,329eca102ef64a3c,06a8fac86363] c.a.o.service.property.PropertyService : Updated property, key=ocp.iam.login.client.max-attempts, previousValue=100, updatedValue=100 2022-12-08 16:17:44.478 INFO 42 --- [http-nio-8080-exec-1,329eca102ef64a3c,06a8fac86363] c.a.o.server.trace.RequestTracingAspect : API OK: [PUT /api/v2/config/properties/61 client=192.168.28.1, traceId=329eca102ef64a3c, duration=43 ms] 2022-12-08 16:17:44.660 INFO 42 --- [http-nio-8080-exec-5,3d2799433f294372,547e0825de07] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/properties?null, client=192.168.28.1, traceId=3d2799433f294372, method=PaginatedResponse com.alipay.ocp.server.controller.PropertyController.findNonFatalProperties(String,Pageable), args=Page request [number: 0, size 2000, sort: key: ASC],] 2022-12-08 16:17:44.748 INFO 42 --- [http-nio-8080-exec-5,3d2799433f294372,547e0825de07] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/properties client=192.168.28.1, traceId=3d2799433f294372, duration=90 ms] 2022-12-08 16:17:45.202 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:17:45.209 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:17:45.420 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:45.424 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:45.470 INFO 42 --- [pool-ocp-schedules-11,,5f484ec54ef1] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:17:45.509 INFO 42 --- [pool-ocp-schedules-11,,5f484ec54ef1] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:17:45.726 INFO 42 --- [pool-ocp-schedules-17,,ea69daff6890] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:17:45.765 INFO 42 --- [pool-ocp-schedules-15,,5630544b697b] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:17:45.765 INFO 42 --- [pool-ocp-schedules-15,,5630544b697b] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:17:45.990 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:46.201 INFO 42 --- [pool-ocp-schedules-7,,93065c534425] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:17:46.293 INFO 42 --- [pool-ocp-schedules-9,,01d9648d276e] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:17:46.451 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:17:46.658 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:46.968 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:17:47.438 INFO 42 --- [pool-ocp-schedules-3,,cf3dd57bc6d2] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:17:47.438 INFO 42 --- [pool-ocp-schedules-3,,cf3dd57bc6d2] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:17:47.925 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:17:48.426 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:48.431 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:48.479 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:17:48.557 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:17:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:17:48.802 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:17:48.801900+08:00, lastProcessTime=2022-12-08T16:17:38.795247+08:00 2022-12-08 16:17:48.809 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:48.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:17:48.801900+08:00, resultsCount=0 2022-12-08 16:17:48.908 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:17:48.801900+08:00, resultsCount=0 2022-12-08 16:17:48.909 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:17:48.801900+08:00 2022-12-08 16:17:49.178 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:49.179 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:49.188 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:17:49.361 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:17:49.959 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:49.960 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:49.998 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:17:51.079 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:51.432 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:51.441 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:52.486 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:17:52.493 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:17:53.018 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:54.442 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:54.446 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:55.362 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:17:55.614 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:17:55.656 INFO 42 --- [http-nio-8080-exec-3,,] c.a.o.s.i.a.CsrfRequestMatcher : CSRF token required for API [PUT /api/v2/config/properties/59, client 192.168.28.1, traceId ] 2022-12-08 16:17:55.663 INFO 42 --- [http-nio-8080-exec-3,0c835d172a4442d8,781958430dca] c.a.o.server.trace.RequestTracingAspect : API: [PUT /api/v2/config/properties/59?newValue=99, client=192.168.28.1, traceId=0c835d172a4442d8, method=SuccessResponse com.alipay.ocp.server.controller.PropertyController.updateProperty(long,String), args=59,99,] 2022-12-08 16:17:55.709 INFO 42 --- [http-nio-8080-exec-3,0c835d172a4442d8,781958430dca] c.a.o.service.property.PropertyService : Updated property, key=ocp.iam.login.max-attempts, previousValue=99, updatedValue=99 2022-12-08 16:17:55.709 INFO 42 --- [http-nio-8080-exec-3,0c835d172a4442d8,781958430dca] c.a.o.server.trace.RequestTracingAspect : API OK: [PUT /api/v2/config/properties/59 client=192.168.28.1, traceId=0c835d172a4442d8, duration=48 ms] 2022-12-08 16:17:55.901 INFO 42 --- [http-nio-8080-exec-6,85d14dda0dcd4ebb,9bf54b3bfd1a] c.a.o.server.trace.RequestTracingAspect : API: [GET /api/v2/config/properties?null, client=192.168.28.1, traceId=85d14dda0dcd4ebb, method=PaginatedResponse com.alipay.ocp.server.controller.PropertyController.findNonFatalProperties(String,Pageable), args=Page request [number: 0, size 2000, sort: key: ASC],] 2022-12-08 16:17:55.987 INFO 42 --- [http-nio-8080-exec-6,85d14dda0dcd4ebb,9bf54b3bfd1a] c.a.o.server.trace.RequestTracingAspect : API OK: [GET /api/v2/config/properties client=192.168.28.1, traceId=85d14dda0dcd4ebb, duration=88 ms] 2022-12-08 16:17:56.173 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:56.173 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:56.202 INFO 42 --- [pool-ocp-schedules-6,,0619b6ab6932] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:17:57.447 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:17:57.451 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:17:58.419 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:17:58.420 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:17:58.557 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:17:58.647 INFO 42 --- [pool-prometheus-cache-monitor1,,769eacefe7cf] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:17:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,769eacefe7cf] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:17:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:17:58.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:17:58.794440+08:00, lastProcessTime=2022-12-08T16:17:48.801900+08:00 2022-12-08 16:17:58.884 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:17:58.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:17:58.794440+08:00, resultsCount=0 2022-12-08 16:17:58.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:17:58.794440+08:00, resultsCount=0 2022-12-08 16:17:58.898 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:17:58.794440+08:00 2022-12-08 16:17:59.425 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:18:00.000 INFO 42 --- [pool-ocp-schedules-4,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 16:18:00.077 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:18:00.118 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:16:03.0, nextRun=2022-12-08 16:18:00.0, currentDate=Thu Dec 08 16:18:00 CST 2022 2022-12-08 16:18:00.119 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:16:03.0, nextRunTime=2022-12-08 16:18:00.0} 2022-12-08 16:18:00.142 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:18:00.227 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:17:01.0, nextRun=2022-12-08 16:18:00.0, currentDate=Thu Dec 08 16:18:00 CST 2022 2022-12-08 16:18:00.228 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:17:01.0, nextRunTime=2022-12-08 16:18:00.0} 2022-12-08 16:18:00.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:18:00.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:18:00.244 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:18:00.276 INFO 42 --- [pool-ocp-schedules-8,,f50dac1bd86f] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:18:00.279 INFO 42 --- [pool-ocp-schedules-20,,b69447ff177e] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:18:00.279 INFO 42 --- [pool-ocp-schedules-17,,f0015da4acd1] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:18:00.298 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:17:01.0, nextRun=2022-12-08 16:18:00.0, currentDate=Thu Dec 08 16:18:00 CST 2022 2022-12-08 16:18:00.298 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:17:01.0, nextRunTime=2022-12-08 16:18:00.0} 2022-12-08 16:18:00.321 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:18:00.322 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:18:00.322 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:18:00.403 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:17:01.0, nextRun=2022-12-08 16:18:00.0, currentDate=Thu Dec 08 16:18:00 CST 2022 2022-12-08 16:18:00.404 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:17:01.0, nextRunTime=2022-12-08 16:18:00.0} 2022-12-08 16:18:00.432 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:18:00.432 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:18:00.433 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:18:00.452 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:00.456 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:00.457 INFO 42 --- [pool-ocp-schedules-7,,b774d9b70c32] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:18:00.458 INFO 42 --- [pool-ocp-schedules-7,,b774d9b70c32] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:18:00.458 INFO 42 --- [pool-ocp-schedules-7,,b774d9b70c32] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:18:00.486 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:17:32.0, nextRun=2022-12-08 16:18:00.0, currentDate=Thu Dec 08 16:18:00 CST 2022 2022-12-08 16:18:00.487 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:17:32.0, nextRunTime=2022-12-08 16:18:00.0} 2022-12-08 16:18:00.503 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:18:00.503 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:18:00.503 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:18:00.576 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:17:01.0, nextRun=2022-12-08 16:18:00.0, currentDate=Thu Dec 08 16:18:00 CST 2022 2022-12-08 16:18:00.576 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:17:01.0, nextRunTime=2022-12-08 16:18:00.0} 2022-12-08 16:18:00.597 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:18:00.598 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:18:00.598 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:18:00.770 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:18:00.777 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:18:00.802 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 656, operation:EXECUTE, state: RUNNING 2022-12-08 16:18:00.832 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=656, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:18:00.788+08:00, endTime=null} 2022-12-08 16:18:00.894 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 657, operation:EXECUTE, state: RUNNING 2022-12-08 16:18:00.951 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=657, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:18:00.882+08:00, endTime=null} 2022-12-08 16:18:01.033 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 653, operation:EXECUTE, state: RUNNING 2022-12-08 16:18:01.105 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=653, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:18:01.022+08:00, endTime=null} 2022-12-08 16:18:01.108 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:01.182 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 654, operation:EXECUTE, state: RUNNING 2022-12-08 16:18:01.305 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=654, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:18:01.169+08:00, endTime=null} 2022-12-08 16:18:01.370 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 655, operation:EXECUTE, state: RUNNING 2022-12-08 16:18:01.444 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:653, status:SUCCESS 2022-12-08 16:18:01.452 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:653, status:SUCCESS 2022-12-08 16:18:01.477 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=655, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:18:01.359+08:00, endTime=null} 2022-12-08 16:18:01.498 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:01.643 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:654, status:SUCCESS 2022-12-08 16:18:01.650 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:654, status:SUCCESS 2022-12-08 16:18:02.399 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,d426b037d124] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487540, interval=60 2022-12-08 16:18:02.636 INFO 42 --- [pool-prometheus-minute-schedule-1,,d426b037d124] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487482, count=0, elapsed=1668816995154 2022-12-08 16:18:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,f592cb77cdd9] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487540, interval=60 2022-12-08 16:18:02.641 INFO 42 --- [pool-prometheus-minute-schedule-2,,f592cb77cdd9] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487482, count=0, elapsed=1668816995159 2022-12-08 16:18:02.879 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:18:03.040 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:650, status:SUCCESS 2022-12-08 16:18:03.046 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:650, status:SUCCESS 2022-12-08 16:18:03.175 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:651, status:SUCCESS 2022-12-08 16:18:03.180 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:651, status:SUCCESS 2022-12-08 16:18:03.267 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:652, status:SUCCESS 2022-12-08 16:18:03.274 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:652, status:SUCCESS 2022-12-08 16:18:03.456 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:03.460 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:04.254 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:18:04.684 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:04.684 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:05.452 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:05.453 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:06.203 INFO 42 --- [pool-ocp-schedules-15,,22bbdf7e3260] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:18:06.357 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:17:05.0, nextRun=2022-12-08 16:18:05.0, currentDate=Thu Dec 08 16:18:06 CST 2022 2022-12-08 16:18:06.358 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:17:05.0, nextRunTime=2022-12-08 16:18:05.0} 2022-12-08 16:18:06.374 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:18:06.374 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:18:06.375 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:18:06.461 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:06.471 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:06.624 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 658, operation:EXECUTE, state: RUNNING 2022-12-08 16:18:06.693 INFO 42 --- [pool-subtask-coordinator2,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=658, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:18:06.589+08:00, endTime=null} 2022-12-08 16:18:07.497 INFO 42 --- [pool-ocp-schedules-18,,1aaf83f3634d] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:18:07.498 INFO 42 --- [pool-ocp-schedules-18,,1aaf83f3634d] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:18:08.065 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:18:08.071 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:18:08.208 INFO 42 --- [pool-ocp-schedules-4,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 16:18:08.607 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:18:08.624 INFO 42 --- [pool-ocp-schedules-4,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 16:18:08.790 INFO 42 --- [pool-ocp-schedules-4,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 16:18:08.821 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:18:08.820563+08:00, lastProcessTime=2022-12-08T16:17:58.794440+08:00 2022-12-08 16:18:08.941 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:18:08.820563+08:00, resultsCount=0 2022-12-08 16:18:08.941 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:18:08.820563+08:00, resultsCount=0 2022-12-08 16:18:08.942 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:18:08.820563+08:00 2022-12-08 16:18:08.967 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:09.159 INFO 42 --- [pool-ocp-schedules-4,,] o.s.boot.SpringApplication : Started application in 9.102 seconds (JVM running for 3486.006) 2022-12-08 16:18:09.472 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:09.476 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:09.518 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:18:10.115 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:18:10.904 INFO 42 --- [pool-ocp-schedules-4,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T16:18:10.904+08:00 2022-12-08 16:18:11.185 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:11.474 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:11.749 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:18:12.425 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:12.426 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:12.477 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:12.492 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:14.731 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:14.732 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:15.493 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:15.497 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:16.204 INFO 42 --- [pool-ocp-schedules-3,,34ff210a20fd] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:18:16.623 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:18:17.548 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:18:17.554 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:18:17.896 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:18.145 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:18:18.173 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:16:17+08:00, updateTime=2022-12-08T16:17:47+08:00, expireTime=null, isLeader=false} 2022-12-08 16:18:18.180 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 16:18:18.498 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:18.503 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:18.659 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:18:18.663 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:18.705 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:18:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:18:18.807 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:18:18.807139+08:00, lastProcessTime=2022-12-08T16:18:08.820563+08:00 2022-12-08 16:18:18.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:18:18.807139+08:00, resultsCount=0 2022-12-08 16:18:18.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:18:18.807139+08:00, resultsCount=0 2022-12-08 16:18:18.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:18:18.807139+08:00 2022-12-08 16:18:19.018 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:19.153 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:18:19.296 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:18:19.559 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:18:20.148 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:18:21.065 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:17:21.0, nextRun=2022-12-08 16:18:20.0, currentDate=Thu Dec 08 16:18:21 CST 2022 2022-12-08 16:18:21.066 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:17:21.0, nextRunTime=2022-12-08 16:18:20.0} 2022-12-08 16:18:21.084 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:18:21.085 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:18:21.085 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:18:21.095 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:21.096 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:21.217 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:21.504 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:21.510 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:21.730 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:21.730 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:22.013 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 659, operation:EXECUTE, state: RUNNING 2022-12-08 16:18:22.062 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=659, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:18:21.989+08:00, endTime=null} 2022-12-08 16:18:23.585 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:656, status:SUCCESS 2022-12-08 16:18:23.592 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:656, status:SUCCESS 2022-12-08 16:18:24.511 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:24.516 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:25.278 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:18:25.322 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:18:25.398 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:17:26.0, nextRun=2022-12-08 16:18:25.0, currentDate=Thu Dec 08 16:18:25 CST 2022 2022-12-08 16:18:25.398 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:17:26.0, nextRunTime=2022-12-08 16:18:25.0} 2022-12-08 16:18:25.462 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:18:25.463 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:18:25.463 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:18:26.177 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 660, operation:EXECUTE, state: RUNNING 2022-12-08 16:18:26.205 INFO 42 --- [pool-ocp-schedules-8,,4b9094ba33bb] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:18:26.706 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=660, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:18:26.166+08:00, endTime=null} 2022-12-08 16:18:27.517 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:27.525 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:27.858 INFO 42 --- [pool-ocp-schedules-14,,d650369f9e9f] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:18:27.859 INFO 42 --- [pool-ocp-schedules-14,,d650369f9e9f] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:18:28.253 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:28.300 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:657, status:SUCCESS 2022-12-08 16:18:28.306 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:657, status:SUCCESS 2022-12-08 16:18:28.333 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:28.569 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:18:28.744 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:18:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:18:28.801 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:18:28.801189+08:00, lastProcessTime=2022-12-08T16:18:18.807139+08:00 2022-12-08 16:18:28.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:18:28.801189+08:00, resultsCount=0 2022-12-08 16:18:28.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:18:28.801189+08:00, resultsCount=0 2022-12-08 16:18:28.914 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:18:28.801189+08:00 2022-12-08 16:18:29.047 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:29.732 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:18:30.360 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:18:30.526 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:30.531 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:30.641 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:17:31.0, nextRun=2022-12-08 16:18:30.0, currentDate=Thu Dec 08 16:18:30 CST 2022 2022-12-08 16:18:30.641 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:17:31.0, nextRunTime=2022-12-08 16:18:30.0} 2022-12-08 16:18:30.661 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:18:30.867 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:00.0, nextRun=2022-12-08 16:18:30.0, currentDate=Thu Dec 08 16:18:30 CST 2022 2022-12-08 16:18:30.867 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:18:00.0, nextRunTime=2022-12-08 16:18:30.0} 2022-12-08 16:18:30.885 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:18:30.885 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:18:30.886 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:18:31.342 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:31.342 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:31.450 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:31.451 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:31.536 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:31.825 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 661, operation:EXECUTE, state: RUNNING 2022-12-08 16:18:32.435 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=661, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:18:31.814+08:00, endTime=null} 2022-12-08 16:18:33.531 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:33.535 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:34.206 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:18:34.212 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:18:34.333 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:18:34.810 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:34.811 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:34.828 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:658, status:SUCCESS 2022-12-08 16:18:34.833 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:658, status:SUCCESS 2022-12-08 16:18:35.074 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T16:14:34.334, end=2022-12-08T16:16:34.973} 2022-12-08 16:18:35.103 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:18:35.357 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:18:36.206 INFO 42 --- [pool-ocp-schedules-17,,4d703e3b8519] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:18:36.536 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:36.540 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:37.972 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:37.973 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:37.973 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:37.973 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:38.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:18:38.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:18:38.799759+08:00, lastProcessTime=2022-12-08T16:18:28.801189+08:00 2022-12-08 16:18:38.837 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:18:38.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:18:38.799759+08:00, resultsCount=0 2022-12-08 16:18:38.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:18:38.799759+08:00, resultsCount=0 2022-12-08 16:18:38.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:18:38.799759+08:00 2022-12-08 16:18:39.103 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:39.541 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:39.545 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:39.785 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:18:40.587 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:18:40.594 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:18:40.629 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:18:41.224 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:41.233 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:41.675 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:41.709 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:18:42.546 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:42.549 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:44.426 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:44.426 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:44.427 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:44.427 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:45.471 INFO 42 --- [pool-ocp-schedules-11,,f5f53c3f6e89] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:18:45.506 INFO 42 --- [pool-ocp-schedules-11,,f5f53c3f6e89] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:18:45.550 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:45.555 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:45.728 INFO 42 --- [pool-ocp-schedules-15,,5e34299a7089] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:18:46.207 INFO 42 --- [pool-ocp-schedules-4,,1894cf0985c2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:18:46.299 INFO 42 --- [pool-ocp-schedules-13,,428c51a77d7c] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:18:46.671 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:18:47.103 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:18:47.110 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:18:47.483 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:47.485 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:47.710 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:18:47.965 INFO 42 --- [pool-ocp-schedules-16,,35b612a818a4] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:18:47.966 INFO 42 --- [pool-ocp-schedules-16,,35b612a818a4] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:18:48.232 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:18:48.555 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:48.560 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:48.691 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:18:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:18:48.792 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:18:48.791994+08:00, lastProcessTime=2022-12-08T16:18:38.799759+08:00 2022-12-08 16:18:48.879 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:18:48.791994+08:00, resultsCount=0 2022-12-08 16:18:48.880 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:18:48.791994+08:00, resultsCount=0 2022-12-08 16:18:48.880 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:18:48.791994+08:00 2022-12-08 16:18:49.242 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:18:49.376 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:49.811 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:18:49.898 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:18:50.570 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:50.571 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:50.571 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:50.571 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:50.733 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:18:51.560 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:51.567 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:51.775 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:18:52.942 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:18:52.951 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:18:54.147 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:54.160 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:18:54.568 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:54.572 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:54.577 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:18:56.208 INFO 42 --- [pool-ocp-schedules-7,,65b98a274de7] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:18:57.312 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:57.312 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:57.325 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:18:57.325 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:18:57.572 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:18:57.577 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:18:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,27648c359996] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:18:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,27648c359996] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:18:58.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:18:58.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:18:58.797342+08:00, lastProcessTime=2022-12-08T16:18:48.791994+08:00 2022-12-08 16:18:58.885 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:18:58.797342+08:00, resultsCount=0 2022-12-08 16:18:58.885 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:18:58.797342+08:00, resultsCount=0 2022-12-08 16:18:58.886 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:18:58.797342+08:00 2022-12-08 16:18:59.376 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:18:59.777 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:00.007 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:19:00.014 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:19:00.020 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:19:00.527 INFO 42 --- [pool-ocp-schedules-20,,1e08706eda3e] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:19:00.528 INFO 42 --- [pool-ocp-schedules-18,,4364785af3c0] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:19:00.528 INFO 42 --- [pool-ocp-schedules-19,,f12f58ab0424] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:19:00.578 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:00.582 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:00.705 INFO 42 --- [pool-ocp-schedules-2,,2f2f2089cc9c] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:19:00.706 INFO 42 --- [pool-ocp-schedules-2,,2f2f2089cc9c] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:19:00.706 INFO 42 --- [pool-ocp-schedules-2,,2f2f2089cc9c] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:19:00.793 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:00.806 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:01.134 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:19:01.210 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:19:01.299 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:00.0, nextRun=2022-12-08 16:19:00.0, currentDate=Thu Dec 08 16:19:01 CST 2022 2022-12-08 16:19:01.300 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:18:00.0, nextRunTime=2022-12-08 16:19:00.0} 2022-12-08 16:19:01.314 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:19:01.315 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:19:01.315 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:19:01.656 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:00.0, nextRun=2022-12-08 16:19:00.0, currentDate=Thu Dec 08 16:19:01 CST 2022 2022-12-08 16:19:01.657 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:18:00.0, nextRunTime=2022-12-08 16:19:00.0} 2022-12-08 16:19:01.680 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:19:01.680 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:19:01.680 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:19:01.832 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:00.0, nextRun=2022-12-08 16:19:00.0, currentDate=Thu Dec 08 16:19:01 CST 2022 2022-12-08 16:19:01.832 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:18:00.0, nextRunTime=2022-12-08 16:19:00.0} 2022-12-08 16:19:01.858 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:19:01.858 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:19:01.858 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:19:01.941 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:01.953 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 662, operation:EXECUTE, state: RUNNING 2022-12-08 16:19:01.972 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:31.0, nextRun=2022-12-08 16:19:00.0, currentDate=Thu Dec 08 16:19:01 CST 2022 2022-12-08 16:19:01.972 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:18:31.0, nextRunTime=2022-12-08 16:19:00.0} 2022-12-08 16:19:01.986 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:19:01.986 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:19:01.987 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:19:02.094 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=662, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:19:01.942+08:00, endTime=null} 2022-12-08 16:19:02.153 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 663, operation:EXECUTE, state: RUNNING 2022-12-08 16:19:02.188 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:01.0, nextRun=2022-12-08 16:19:00.0, currentDate=Thu Dec 08 16:19:02 CST 2022 2022-12-08 16:19:02.189 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:18:01.0, nextRunTime=2022-12-08 16:19:00.0} 2022-12-08 16:19:02.206 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:19:02.206 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:19:02.206 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:19:02.595 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=663, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:19:02.141+08:00, endTime=null} 2022-12-08 16:19:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,bc398167a361] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487600, interval=60 2022-12-08 16:19:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,bc398167a361] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487542, count=0, elapsed=1668817055093 2022-12-08 16:19:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,928f668813e6] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487600, interval=60 2022-12-08 16:19:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,928f668813e6] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487542, count=0, elapsed=1668817055098 2022-12-08 16:19:03.582 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:03.587 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:03.677 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 664, operation:EXECUTE, state: RUNNING 2022-12-08 16:19:03.715 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:659, status:SUCCESS 2022-12-08 16:19:03.722 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:659, status:SUCCESS 2022-12-08 16:19:03.900 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:03.901 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:04.122 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:04.123 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:04.256 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=664, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:19:03.665+08:00, endTime=null} 2022-12-08 16:19:04.274 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:660, status:SUCCESS 2022-12-08 16:19:04.281 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:660, status:SUCCESS 2022-12-08 16:19:04.324 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 665, operation:EXECUTE, state: RUNNING 2022-12-08 16:19:04.428 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=665, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:19:04.312+08:00, endTime=null} 2022-12-08 16:19:04.518 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 666, operation:EXECUTE, state: RUNNING 2022-12-08 16:19:04.579 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=666, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:19:04.506+08:00, endTime=null} 2022-12-08 16:19:04.957 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:19:05.672 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:661, status:SUCCESS 2022-12-08 16:19:05.678 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:661, status:SUCCESS 2022-12-08 16:19:05.724 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:06.0, nextRun=2022-12-08 16:19:05.0, currentDate=Thu Dec 08 16:19:05 CST 2022 2022-12-08 16:19:05.724 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:18:06.0, nextRunTime=2022-12-08 16:19:05.0} 2022-12-08 16:19:05.742 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:19:05.743 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:19:05.743 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:19:06.031 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:662, status:SUCCESS 2022-12-08 16:19:06.037 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:662, status:SUCCESS 2022-12-08 16:19:06.211 INFO 42 --- [pool-ocp-schedules-14,,196cc30f2c28] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:19:06.490 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:663, status:SUCCESS 2022-12-08 16:19:06.497 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:663, status:SUCCESS 2022-12-08 16:19:06.587 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:06.591 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:06.662 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 667, operation:EXECUTE, state: RUNNING 2022-12-08 16:19:06.697 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=667, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:19:06.651+08:00, endTime=null} 2022-12-08 16:19:06.761 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:19:06.768 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:19:07.263 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:07.288 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:07.609 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:19:07.945 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:664, status:SUCCESS 2022-12-08 16:19:07.962 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:664, status:SUCCESS 2022-12-08 16:19:08.085 INFO 42 --- [pool-ocp-schedules-14,,79a559d0bfc6] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:19:08.086 INFO 42 --- [pool-ocp-schedules-14,,79a559d0bfc6] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:19:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:19:08.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:19:08.793984+08:00, lastProcessTime=2022-12-08T16:18:58.797342+08:00 2022-12-08 16:19:08.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:19:08.793984+08:00, resultsCount=0 2022-12-08 16:19:08.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:19:08.793984+08:00, resultsCount=0 2022-12-08 16:19:08.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:19:08.793984+08:00 2022-12-08 16:19:09.432 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:19:09.592 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:09.596 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:09.952 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:10.177 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:19:10.575 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:10.575 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:10.605 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:10.606 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:11.558 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:19:12.088 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:12.597 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:12.602 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:13.027 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:19:13.034 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:19:13.619 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:13.664 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:14.134 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:19:15.603 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:15.607 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:16.212 INFO 42 --- [pool-ocp-schedules-18,,9b0c2a71dc8d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:19:16.685 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:16.686 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:16.726 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:19:16.745 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:16.745 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:18.607 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:18.619 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:18.662 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:19:18.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:19:18.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:19:18.792734+08:00, lastProcessTime=2022-12-08T16:19:08.793984+08:00 2022-12-08 16:19:18.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:19:18.792734+08:00, resultsCount=0 2022-12-08 16:19:18.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:19:18.792734+08:00, resultsCount=0 2022-12-08 16:19:18.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:19:18.792734+08:00 2022-12-08 16:19:19.242 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:19:19.279 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:17:18+08:00, updateTime=2022-12-08T16:18:48+08:00, expireTime=null, isLeader=false} 2022-12-08 16:19:19.285 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:19:19.308 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:19:19.321 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:19:19.504 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:19:19.983 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:19:20.069 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:20.074 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:20.161 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:21.0, nextRun=2022-12-08 16:19:20.0, currentDate=Thu Dec 08 16:19:20 CST 2022 2022-12-08 16:19:20.162 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:18:21.0, nextRunTime=2022-12-08 16:19:20.0} 2022-12-08 16:19:20.170 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:20.186 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:19:20.186 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:19:20.186 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:19:20.226 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:19:20.465 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:19:20.941 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 668, operation:EXECUTE, state: RUNNING 2022-12-08 16:19:21.012 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=668, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:19:20.915+08:00, endTime=null} 2022-12-08 16:19:21.619 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:21.624 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:21.785 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:19:22.128 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:22.788 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:665, status:SUCCESS 2022-12-08 16:19:22.795 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:665, status:SUCCESS 2022-12-08 16:19:23.208 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:23.209 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:23.260 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:23.260 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:24.625 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:24.629 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:25.691 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:19:25.697 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:19:26.213 INFO 42 --- [pool-ocp-schedules-7,,32c331eb3cf2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:19:26.465 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:26.467 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:26.526 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:25.0, nextRun=2022-12-08 16:19:25.0, currentDate=Thu Dec 08 16:19:26 CST 2022 2022-12-08 16:19:26.526 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:18:25.0, nextRunTime=2022-12-08 16:19:25.0} 2022-12-08 16:19:26.572 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:19:26.572 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:19:26.573 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:19:26.810 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:19:27.162 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 669, operation:EXECUTE, state: RUNNING 2022-12-08 16:19:27.192 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=669, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:19:27.150+08:00, endTime=null} 2022-12-08 16:19:27.629 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:27.634 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:28.237 INFO 42 --- [pool-ocp-schedules-1,,1081d577e771] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:19:28.237 INFO 42 --- [pool-ocp-schedules-1,,1081d577e771] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:19:28.443 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:666, status:SUCCESS 2022-12-08 16:19:28.449 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:666, status:SUCCESS 2022-12-08 16:19:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:19:28.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:19:28.793001+08:00, lastProcessTime=2022-12-08T16:19:18.792734+08:00 2022-12-08 16:19:28.886 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:19:28.793001+08:00, resultsCount=0 2022-12-08 16:19:28.886 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:19:28.793001+08:00, resultsCount=0 2022-12-08 16:19:28.886 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:19:28.793001+08:00 2022-12-08 16:19:29.553 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:29.554 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:29.560 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:29.561 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:29.751 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:19:30.192 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:30.321 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:19:30.634 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:30.638 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:31.141 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:31.0, nextRun=2022-12-08 16:19:30.0, currentDate=Thu Dec 08 16:19:31 CST 2022 2022-12-08 16:19:31.142 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:18:31.0, nextRunTime=2022-12-08 16:19:30.0} 2022-12-08 16:19:31.165 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:19:31.606 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:19:02.0, nextRun=2022-12-08 16:19:30.0, currentDate=Thu Dec 08 16:19:31 CST 2022 2022-12-08 16:19:31.607 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:19:02.0, nextRunTime=2022-12-08 16:19:30.0} 2022-12-08 16:19:31.624 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:19:31.625 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:19:31.625 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:19:31.929 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:19:32.086 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:19:32.092 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:19:32.324 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 670, operation:EXECUTE, state: RUNNING 2022-12-08 16:19:32.345 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:32.423 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=670, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:19:32.310+08:00, endTime=null} 2022-12-08 16:19:32.652 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:32.652 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:33.206 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:19:33.639 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:33.644 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:35.074 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:19:35.415 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:667, status:SUCCESS 2022-12-08 16:19:35.436 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:667, status:SUCCESS 2022-12-08 16:19:35.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:35.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:35.995 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:35.995 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:36.214 INFO 42 --- [pool-ocp-schedules-17,,27c8ffa667ab] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:19:36.645 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:36.649 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:38.740 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:19:38.747 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:19:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:19:38.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:19:38.798054+08:00, lastProcessTime=2022-12-08T16:19:28.793001+08:00 2022-12-08 16:19:38.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:19:38.798054+08:00, resultsCount=0 2022-12-08 16:19:38.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:19:38.798054+08:00, resultsCount=0 2022-12-08 16:19:38.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:19:38.798054+08:00 2022-12-08 16:19:39.566 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:39.566 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:39.650 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:39.669 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:39.731 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:19:39.853 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:19:40.316 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:19:40.333 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=17ms, period=120000ms 2022-12-08 16:19:40.627 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:40.830 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:19:42.051 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:19:42.414 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:42.670 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:42.675 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:42.681 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:42.681 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:42.684 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:42.685 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:45.037 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:19:45.045 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:19:45.471 INFO 42 --- [pool-ocp-schedules-8,,d6d1f35dd2a3] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:19:45.505 INFO 42 --- [pool-ocp-schedules-8,,d6d1f35dd2a3] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:19:45.676 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:45.681 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:45.730 INFO 42 --- [pool-ocp-schedules-14,,b2c33232c175] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:19:45.767 INFO 42 --- [pool-ocp-schedules-19,,8cee29953fb0] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:19:45.767 INFO 42 --- [pool-ocp-schedules-19,,8cee29953fb0] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:19:45.797 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:45.797 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:46.215 INFO 42 --- [pool-ocp-schedules-18,,8f61bfa15ed6] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:19:46.313 INFO 42 --- [pool-ocp-schedules-10,,b1f7a8c55251] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:19:46.339 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:19:47.140 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:19:47.174 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:17:16+08:00, updateTime=2022-12-08T16:19:16+08:00, expireTime=null, isLeader=false} 2022-12-08 16:19:47.181 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:19:48.337 INFO 42 --- [pool-ocp-schedules-10,,146419ae87e1] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:19:48.338 INFO 42 --- [pool-ocp-schedules-10,,146419ae87e1] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:19:48.682 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:48.687 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:48.731 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:19:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:19:48.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:19:48.791898+08:00, lastProcessTime=2022-12-08T16:19:38.798054+08:00 2022-12-08 16:19:48.883 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:19:48.791898+08:00, resultsCount=0 2022-12-08 16:19:48.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:19:48.791898+08:00, resultsCount=0 2022-12-08 16:19:48.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:19:48.791898+08:00 2022-12-08 16:19:48.943 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:48.943 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:48.943 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:48.944 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:49.498 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:19:49.948 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:19:50.404 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:19:50.920 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:51.026 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:19:51.688 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:51.695 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:51.824 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:19:51.835 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:19:52.327 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:19:52.512 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:52.512 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:52.681 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:19:52.746 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:19:54.696 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:54.701 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:55.560 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:55.560 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:55.562 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:19:55.562 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:19:56.216 INFO 42 --- [pool-ocp-schedules-3,,3b9a349affb9] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:19:57.702 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:19:57.707 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:19:57.847 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:19:57.857 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:19:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,2ffe5a5905ef] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:19:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,2ffe5a5905ef] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:19:58.729 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:58.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:19:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:19:58.792 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:19:58.791847+08:00, lastProcessTime=2022-12-08T16:19:48.791898+08:00 2022-12-08 16:19:58.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:19:58.791847+08:00, resultsCount=0 2022-12-08 16:19:58.895 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:19:58.791847+08:00, resultsCount=0 2022-12-08 16:19:58.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:19:58.791847+08:00 2022-12-08 16:19:59.508 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:20:00.006 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:03.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:00 CST 2022 2022-12-08 16:20:00.007 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=35, name=Collect all tenants mini compactions, templateName=CollectTenantMiniCompactionSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 16:15:03.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:00.019 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:20:00.024 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants mini compactions, nodeCount=1, taskCount=1 2022-12-08 16:20:00.024 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:00.024 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants mini compactions, taskDefinitionId=35, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:00.355 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:19:02.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:00 CST 2022 2022-12-08 16:20:00.356 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:19:02.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:00.375 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:20:00.376 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:00.376 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:00.656 INFO 42 --- [pool-ocp-schedules-13,,c1b2eea99118] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:20:00.657 INFO 42 --- [pool-ocp-schedules-4,,81003ff1e385] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:20:00.657 INFO 42 --- [pool-ocp-schedules-12,,74ca1c485833] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:20:00.708 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:00.714 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:00.844 INFO 42 --- [pool-ocp-schedules-15,,83d2985e35ff] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:20:00.844 INFO 42 --- [pool-ocp-schedules-15,,83d2985e35ff] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:20:00.844 INFO 42 --- [pool-ocp-schedules-15,,83d2985e35ff] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:20:00.869 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 672, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:00.947 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:01.023 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=672, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:20:00.847+08:00, endTime=null} 2022-12-08 16:20:01.076 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:20:01.087 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 671, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:01.246 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=671, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask, seriesId=0, startTime=2022-12-08T16:20:01.075+08:00, endTime=null} 2022-12-08 16:20:02.254 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:01.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:02 CST 2022 2022-12-08 16:20:02.255 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=12, name=Refresh agent config, templateName=RefreshAgentConfigSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 16:10:01.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:02.277 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Refresh agent config, nodeCount=1, taskCount=1 2022-12-08 16:20:02.278 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:02.278 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Refresh agent config, taskDefinitionId=12, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:02.357 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:18:00.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:02 CST 2022 2022-12-08 16:20:02.358 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:18:00.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:02.378 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:20:02.408 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:20:02.429 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:10:01.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:02 CST 2022 2022-12-08 16:20:02.430 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=15, name=Sync system event, templateName=SyncSystemEventSchedule, scheduleRule=0 */10 * * * *, lastRunTime=2022-12-08 16:10:01.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:02.451 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync system event 2022-12-08 16:20:02.475 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:668, status:SUCCESS 2022-12-08 16:20:02.482 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:668, status:SUCCESS 2022-12-08 16:20:02.505 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:02.506 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:02.508 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:02.508 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:02.526 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:02.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:02 CST 2022 2022-12-08 16:20:02.526 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=20, name=Check all cluster configUrl, templateName=ConfigUrlCheckSchedule, scheduleRule=0 */5 * * * ?, lastRunTime=2022-12-08 16:15:02.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:02.556 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check all OB clusters config-url, nodeCount=1, taskCount=1 2022-12-08 16:20:02.557 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:02.557 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check all OB clusters config-url, taskDefinitionId=20, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:02.583 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:669, status:SUCCESS 2022-12-08 16:20:02.588 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:669, status:SUCCESS 2022-12-08 16:20:02.622 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:15:02.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:02 CST 2022 2022-12-08 16:20:02.623 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=21, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2022-12-08 16:15:02.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,c3414ff7fbd4] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487660, interval=60 2022-12-08 16:20:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,c3414ff7fbd4] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487602, count=0, elapsed=1668817115033 2022-12-08 16:20:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,f385c58fa08a] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487660, interval=60 2022-12-08 16:20:02.640 INFO 42 --- [pool-prometheus-minute-schedule-2,,f385c58fa08a] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487602, count=0, elapsed=1668817115038 2022-12-08 16:20:02.657 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2022-12-08 16:20:02.658 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2022-12-08 16:20:02.740 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:19:01.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:02 CST 2022 2022-12-08 16:20:02.741 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:19:01.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:02.760 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:20:02.760 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:02.760 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:02.785 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:02.808 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:19:02.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:02 CST 2022 2022-12-08 16:20:02.809 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:19:02.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:02.844 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:20:02.844 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:02.844 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:02.917 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:19:02.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:02 CST 2022 2022-12-08 16:20:02.917 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:19:02.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:02.951 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:20:02.952 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:02.952 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:03.037 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:19:32.0, nextRun=2022-12-08 16:20:00.0, currentDate=Thu Dec 08 16:20:03 CST 2022 2022-12-08 16:20:03.038 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:19:32.0, nextRunTime=2022-12-08 16:20:00.0} 2022-12-08 16:20:03.062 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:20:03.063 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:03.063 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:03.338 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 673, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:03.387 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=673, name=Refresh all agent config, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.RefreshAllAgentConfigTask, seriesId=0, startTime=2022-12-08T16:20:03.328+08:00, endTime=null} 2022-12-08 16:20:03.469 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 674, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:03.530 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=674, name=Check root service , state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CheckClusterRootServersTask, seriesId=0, startTime=2022-12-08T16:20:03.455+08:00, endTime=null} 2022-12-08 16:20:03.592 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 675, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:03.714 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:03.718 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:03.876 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=675, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:20:03.580+08:00, endTime=null} 2022-12-08 16:20:03.960 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 676, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:04.310 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=676, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:20:03.948+08:00, endTime=null} 2022-12-08 16:20:04.370 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 677, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:04.676 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=677, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:20:04.359+08:00, endTime=null} 2022-12-08 16:20:04.688 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:670, status:SUCCESS 2022-12-08 16:20:04.693 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:670, status:SUCCESS 2022-12-08 16:20:04.742 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 678, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:04.827 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=678, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:20:04.730+08:00, endTime=null} 2022-12-08 16:20:04.838 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:671, status:SUCCESS 2022-12-08 16:20:04.843 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:671, status:SUCCESS 2022-12-08 16:20:04.922 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:20:04.927 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:20:04.974 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:672, status:SUCCESS 2022-12-08 16:20:04.981 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:672, status:SUCCESS 2022-12-08 16:20:05.144 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:673, status:SUCCESS 2022-12-08 16:20:05.149 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:673, status:SUCCESS 2022-12-08 16:20:05.238 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:674, status:SUCCESS 2022-12-08 16:20:05.244 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:674, status:SUCCESS 2022-12-08 16:20:05.335 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:675, status:SUCCESS 2022-12-08 16:20:05.341 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:675, status:SUCCESS 2022-12-08 16:20:05.578 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:05.578 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:05.763 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:20:06.032 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:20:06.049 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:19:06.0, nextRun=2022-12-08 16:20:05.0, currentDate=Thu Dec 08 16:20:06 CST 2022 2022-12-08 16:20:06.049 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:19:06.0, nextRunTime=2022-12-08 16:20:05.0} 2022-12-08 16:20:06.066 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:20:06.067 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:06.067 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:06.217 INFO 42 --- [pool-ocp-schedules-4,,af2ddaf6259d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:20:06.719 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:06.723 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:06.911 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 679, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:07.331 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=679, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:20:06.900+08:00, endTime=null} 2022-12-08 16:20:08.411 INFO 42 --- [pool-ocp-schedules-11,,8fcfb829fe01] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:20:08.411 INFO 42 --- [pool-ocp-schedules-11,,8fcfb829fe01] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:20:08.644 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:08.645 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:08.676 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:08.676 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:20:08.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:20:08.792503+08:00, lastProcessTime=2022-12-08T16:19:58.791847+08:00 2022-12-08 16:20:08.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:20:08.792503+08:00, resultsCount=0 2022-12-08 16:20:08.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:20:08.792503+08:00, resultsCount=0 2022-12-08 16:20:08.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:20:08.792503+08:00 2022-12-08 16:20:09.552 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:676, status:SUCCESS 2022-12-08 16:20:09.559 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:676, status:SUCCESS 2022-12-08 16:20:09.723 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:09.728 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:10.341 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:20:11.055 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:11.242 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:20:11.417 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:20:11.423 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:20:12.032 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:12.038 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:12.454 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:20:12.639 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:20:12.728 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:12.733 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:12.832 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:15.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:15.102 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:15.126 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:15.127 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:15.733 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:15.737 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:16.218 INFO 42 --- [pool-ocp-schedules-18,,d69a57a64556] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:20:17.260 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:20:17.818 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:20:17.824 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:20:18.321 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:18.435 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:18.738 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:18.743 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:20:18.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:20:18.796842+08:00, lastProcessTime=2022-12-08T16:20:08.792503+08:00 2022-12-08 16:20:18.927 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:20:18.796842+08:00, resultsCount=0 2022-12-08 16:20:18.928 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:20:18.796842+08:00, resultsCount=0 2022-12-08 16:20:18.928 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:20:18.796842+08:00 2022-12-08 16:20:18.991 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:20:19.498 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:20:19.556 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:18:18+08:00, updateTime=2022-12-08T16:19:48+08:00, expireTime=null, isLeader=false} 2022-12-08 16:20:19.562 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 16:20:19.737 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:20:20.505 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:20:20.658 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:19:20.0, nextRun=2022-12-08 16:20:20.0, currentDate=Thu Dec 08 16:20:20 CST 2022 2022-12-08 16:20:20.659 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:19:20.0, nextRunTime=2022-12-08 16:20:20.0} 2022-12-08 16:20:20.686 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:20:20.686 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:20.686 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:20.800 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:20:21.358 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:21.435 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:21.435 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:21.449 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:20:21.539 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:21.539 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:21.569 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 680, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:21.687 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=680, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:20:21.557+08:00, endTime=null} 2022-12-08 16:20:21.744 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:21.748 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:22.499 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:20:22.860 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:22.979 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:677, status:SUCCESS 2022-12-08 16:20:22.986 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:677, status:SUCCESS 2022-12-08 16:20:24.199 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:20:24.206 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:20:24.537 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:24.653 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:24.748 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:24.753 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:24.792 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:20:26.002 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:19:27.0, nextRun=2022-12-08 16:20:25.0, currentDate=Thu Dec 08 16:20:26 CST 2022 2022-12-08 16:20:26.003 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:19:27.0, nextRunTime=2022-12-08 16:20:25.0} 2022-12-08 16:20:26.040 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:20:26.041 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:26.041 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:26.220 INFO 42 --- [pool-ocp-schedules-14,,fea0681d66cc] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:20:26.825 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 681, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:26.876 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=681, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:20:26.812+08:00, endTime=null} 2022-12-08 16:20:27.599 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:678, status:SUCCESS 2022-12-08 16:20:27.605 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:678, status:SUCCESS 2022-12-08 16:20:27.696 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:27.696 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:27.720 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:27.720 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:27.754 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:27.758 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:28.506 INFO 42 --- [pool-ocp-schedules-9,,0dd25f78ae86] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:20:28.506 INFO 42 --- [pool-ocp-schedules-9,,0dd25f78ae86] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:20:28.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:20:28.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:20:28.796215+08:00, lastProcessTime=2022-12-08T16:20:18.796842+08:00 2022-12-08 16:20:28.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:20:28.796215+08:00, resultsCount=0 2022-12-08 16:20:28.912 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:20:28.796215+08:00, resultsCount=0 2022-12-08 16:20:28.913 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:20:28.796215+08:00 2022-12-08 16:20:29.947 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:20:29.954 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:20:30.291 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:19:31.0, nextRun=2022-12-08 16:20:30.0, currentDate=Thu Dec 08 16:20:30 CST 2022 2022-12-08 16:20:30.291 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:19:31.0, nextRunTime=2022-12-08 16:20:30.0} 2022-12-08 16:20:30.311 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:20:30.579 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:03.0, nextRun=2022-12-08 16:20:30.0, currentDate=Thu Dec 08 16:20:30 CST 2022 2022-12-08 16:20:30.579 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:20:03.0, nextRunTime=2022-12-08 16:20:30.0} 2022-12-08 16:20:30.604 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:20:30.604 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:20:30.605 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:20:30.621 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:20:30.759 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:30.761 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:30.763 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:30.829 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:31.003 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 682, operation:EXECUTE, state: RUNNING 2022-12-08 16:20:31.065 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=682, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:20:30.993+08:00, endTime=null} 2022-12-08 16:20:31.076 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:20:31.438 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:31.564 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:20:31.629 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:679, status:SUCCESS 2022-12-08 16:20:31.636 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:679, status:SUCCESS 2022-12-08 16:20:32.544 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:20:32.926 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:33.763 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:33.770 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:33.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:33.826 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:33.902 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:33.902 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:35.294 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T16:16:34.973, end=2022-12-08T16:18:35.215} 2022-12-08 16:20:35.326 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:20:35.865 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:20:36.221 INFO 42 --- [pool-ocp-schedules-13,,8b58e0888b1d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:20:36.274 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:20:36.280 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:20:36.770 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:36.774 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:36.985 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:36.986 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:37.367 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:20:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:20:38.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:20:38.793638+08:00, lastProcessTime=2022-12-08T16:20:28.796215+08:00 2022-12-08 16:20:38.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:20:38.793638+08:00, resultsCount=0 2022-12-08 16:20:38.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:20:38.793638+08:00, resultsCount=0 2022-12-08 16:20:38.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:20:38.793638+08:00 2022-12-08 16:20:39.775 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:39.779 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:40.037 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:40.038 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:40.068 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:40.069 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:40.682 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:20:41.479 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:41.648 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:20:42.547 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:20:42.554 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:20:42.650 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:20:42.780 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:42.784 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:43.115 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:43.132 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:43.239 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:43.649 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:20:45.472 INFO 42 --- [pool-ocp-schedules-15,,4944dc4a0a96] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:20:45.482 INFO 42 --- [pool-ocp-schedules-10,,] c.a.o.c.o.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2022-12-08 16:20:45.516 INFO 42 --- [pool-ocp-schedules-15,,4944dc4a0a96] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:20:45.731 INFO 42 --- [pool-ocp-schedules-17,,f6b7f515892d] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:20:45.785 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:45.791 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:46.107 INFO 42 --- [pool-ocp-schedules-9,,91c1c4b84783] c.a.o.s.m.helper.ExporterRequestHelper : Refresh exporter helper 2022-12-08 16:20:46.171 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:46.171 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:46.222 INFO 42 --- [pool-ocp-schedules-3,,5bdb2a9d3e6a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:20:46.229 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:46.230 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:46.317 INFO 42 --- [pool-ocp-schedules-8,,7805110b1202] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:20:47.321 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:20:48.562 INFO 42 --- [pool-ocp-schedules-11,,0637ec8c099f] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:20:48.562 INFO 42 --- [pool-ocp-schedules-11,,0637ec8c099f] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:20:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:20:48.792 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:48.795 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:48.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:20:48.798909+08:00, lastProcessTime=2022-12-08T16:20:38.793638+08:00 2022-12-08 16:20:48.823 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:20:48.828 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:20:48.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:20:48.798909+08:00, resultsCount=0 2022-12-08 16:20:48.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:20:48.798909+08:00, resultsCount=0 2022-12-08 16:20:48.902 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:20:48.798909+08:00 2022-12-08 16:20:49.259 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:49.291 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:49.434 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:20:49.606 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:20:49.789 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:20:50.712 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:20:50.929 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:20:51.520 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:51.714 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:20:51.796 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:51.800 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:52.385 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:52.385 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:52.413 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:52.414 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:52.723 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:20:53.538 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:20:54.606 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:20:54.612 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:20:54.800 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:54.807 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:55.452 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:55.476 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:20:55.706 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:20:56.223 INFO 42 --- [pool-ocp-schedules-3,,26b9a895c588] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:20:57.807 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:20:57.812 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:20:58.579 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:58.579 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:20:58.580 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:58.580 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:20:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,4448f6beb948] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:20:58.649 INFO 42 --- [pool-prometheus-cache-monitor1,,4448f6beb948] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:20:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:20:58.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:20:58.794723+08:00, lastProcessTime=2022-12-08T16:20:48.798909+08:00 2022-12-08 16:20:58.898 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:20:58.794723+08:00, resultsCount=0 2022-12-08 16:20:58.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:20:58.794723+08:00, resultsCount=0 2022-12-08 16:20:58.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:20:58.794723+08:00 2022-12-08 16:21:00.001 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 16:21:00.586 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:03.0, nextRun=2022-12-08 16:21:00.0, currentDate=Thu Dec 08 16:21:00 CST 2022 2022-12-08 16:21:00.587 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:20:03.0, nextRunTime=2022-12-08 16:21:00.0} 2022-12-08 16:21:00.605 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:21:00.605 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:21:00.605 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:21:00.663 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:03.0, nextRun=2022-12-08 16:21:00.0, currentDate=Thu Dec 08 16:21:00 CST 2022 2022-12-08 16:21:00.663 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:20:03.0, nextRunTime=2022-12-08 16:21:00.0} 2022-12-08 16:21:00.691 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:21:00.691 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:21:00.692 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:21:00.722 INFO 42 --- [pool-ocp-schedules-18,,54483855450b] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:21:00.752 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:03.0, nextRun=2022-12-08 16:21:00.0, currentDate=Thu Dec 08 16:21:00 CST 2022 2022-12-08 16:21:00.752 INFO 42 --- [pool-ocp-schedules-5,,65d906a2dcd4] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:21:00.753 INFO 42 --- [pool-ocp-schedules-9,,774523706a87] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:21:00.753 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:20:03.0, nextRunTime=2022-12-08 16:21:00.0} 2022-12-08 16:21:00.786 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:21:00.787 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:21:00.787 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:21:00.787 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:21:00.813 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:00.817 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:00.885 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:31.0, nextRun=2022-12-08 16:21:00.0, currentDate=Thu Dec 08 16:21:00 CST 2022 2022-12-08 16:21:00.885 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:20:31.0, nextRunTime=2022-12-08 16:21:00.0} 2022-12-08 16:21:00.902 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:21:00.903 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:21:00.903 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:21:00.954 INFO 42 --- [pool-ocp-schedules-2,,247fa9fd70b4] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:21:00.955 INFO 42 --- [pool-ocp-schedules-2,,247fa9fd70b4] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:21:00.955 INFO 42 --- [pool-ocp-schedules-2,,247fa9fd70b4] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:21:00.988 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:00.0, nextRun=2022-12-08 16:21:00.0, currentDate=Thu Dec 08 16:21:00 CST 2022 2022-12-08 16:21:00.988 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:20:00.0, nextRunTime=2022-12-08 16:21:00.0} 2022-12-08 16:21:01.003 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:21:01.004 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:21:01.004 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:21:01.042 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:21:01.049 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:21:01.545 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 683, operation:EXECUTE, state: RUNNING 2022-12-08 16:21:01.638 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:01.638 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:01.849 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:01.929 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:21:01.964 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=683, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:21:01.534+08:00, endTime=null} 2022-12-08 16:21:02.034 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 684, operation:EXECUTE, state: RUNNING 2022-12-08 16:21:02.167 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=684, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:21:02.019+08:00, endTime=null} 2022-12-08 16:21:02.178 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:21:02.245 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 685, operation:EXECUTE, state: RUNNING 2022-12-08 16:21:02.367 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=685, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:21:02.231+08:00, endTime=null} 2022-12-08 16:21:02.472 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 686, operation:EXECUTE, state: RUNNING 2022-12-08 16:21:02.576 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=686, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:21:02.453+08:00, endTime=null} 2022-12-08 16:21:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,5f8b5b4dbaea] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487720, interval=60 2022-12-08 16:21:02.635 INFO 42 --- [pool-prometheus-minute-schedule-1,,5f8b5b4dbaea] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487662, count=0, elapsed=1668817174973 2022-12-08 16:21:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,0375500dfddc] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487720, interval=60 2022-12-08 16:21:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,0375500dfddc] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487662, count=0, elapsed=1668817174978 2022-12-08 16:21:02.642 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 687, operation:EXECUTE, state: RUNNING 2022-12-08 16:21:02.762 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=687, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:21:02.629+08:00, endTime=null} 2022-12-08 16:21:02.772 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:21:03.527 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:680, status:SUCCESS 2022-12-08 16:21:03.534 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:680, status:SUCCESS 2022-12-08 16:21:03.573 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:03.817 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:03.821 INFO 42 --- [pool-3-thread-2,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:03.908 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:681, status:SUCCESS 2022-12-08 16:21:03.914 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:681, status:SUCCESS 2022-12-08 16:21:04.096 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:682, status:SUCCESS 2022-12-08 16:21:04.103 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:682, status:SUCCESS 2022-12-08 16:21:04.643 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:683, status:SUCCESS 2022-12-08 16:21:04.648 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:683, status:SUCCESS 2022-12-08 16:21:04.984 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:684, status:SUCCESS 2022-12-08 16:21:04.991 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:684, status:SUCCESS 2022-12-08 16:21:05.025 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:05.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:05.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:05.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:05.782 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:06.0, nextRun=2022-12-08 16:21:05.0, currentDate=Thu Dec 08 16:21:05 CST 2022 2022-12-08 16:21:05.783 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:20:06.0, nextRunTime=2022-12-08 16:21:05.0} 2022-12-08 16:21:05.800 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:21:05.801 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:21:05.801 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:21:05.981 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:21:06.224 INFO 42 --- [pool-ocp-schedules-17,,9db2e4a8b930] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:21:06.822 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:06.826 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:06.907 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 688, operation:EXECUTE, state: RUNNING 2022-12-08 16:21:06.954 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=688, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:21:06.870+08:00, endTime=null} 2022-12-08 16:21:07.434 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:21:07.441 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:21:07.477 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:685, status:SUCCESS 2022-12-08 16:21:07.484 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:685, status:SUCCESS 2022-12-08 16:21:07.912 INFO 42 --- [pool-ocp-schedules-15,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 16:21:08.160 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:08.197 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:08.271 INFO 42 --- [pool-ocp-schedules-15,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 16:21:08.398 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 16:21:08.557 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:21:08.662 INFO 42 --- [pool-ocp-schedules-1,,d271acd66b9e] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:21:08.671 INFO 42 --- [pool-ocp-schedules-1,,d271acd66b9e] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:21:08.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:21:08.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:21:08.799589+08:00, lastProcessTime=2022-12-08T16:20:58.794723+08:00 2022-12-08 16:21:08.841 INFO 42 --- [pool-ocp-schedules-15,,] o.s.boot.SpringApplication : Started application in 8.788 seconds (JVM running for 3665.688) 2022-12-08 16:21:08.958 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:21:08.799589+08:00, resultsCount=0 2022-12-08 16:21:08.959 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:21:08.799589+08:00, resultsCount=0 2022-12-08 16:21:08.959 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:21:08.799589+08:00 2022-12-08 16:21:09.827 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:09.832 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:10.822 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:21:10.955 INFO 42 --- [pool-ocp-schedules-15,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T16:21:10.955+08:00 2022-12-08 16:21:11.242 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:11.243 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:11.277 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:11.277 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:12.012 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:12.016 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:21:12.815 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:21:12.832 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:12.837 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:13.816 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:21:13.822 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:21:13.960 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:14.336 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:14.336 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:14.923 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:21:15.838 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:15.842 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:16.225 INFO 42 --- [pool-ocp-schedules-4,,da548ff7c516] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:21:17.363 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:21:17.411 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:17.412 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:17.414 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:17.414 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:21:18.799 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:21:18.798869+08:00, lastProcessTime=2022-12-08T16:21:08.799589+08:00 2022-12-08 16:21:18.842 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:18.846 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:18.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:21:18.798869+08:00, resultsCount=0 2022-12-08 16:21:18.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:21:18.798869+08:00, resultsCount=0 2022-12-08 16:21:18.897 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:21:18.798869+08:00 2022-12-08 16:21:19.631 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:21:19.819 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:21:20.091 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:21:20.097 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:21:20.508 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:20.511 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:20.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:21.0, nextRun=2022-12-08 16:21:20.0, currentDate=Thu Dec 08 16:21:20 CST 2022 2022-12-08 16:21:20.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:20:21.0, nextRunTime=2022-12-08 16:21:20.0} 2022-12-08 16:21:20.661 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:21:20.662 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:21:20.662 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:21:20.702 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:21:20.983 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:21:21.018 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:21:21.232 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 689, operation:EXECUTE, state: RUNNING 2022-12-08 16:21:21.281 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=689, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:21:21.208+08:00, endTime=null} 2022-12-08 16:21:21.847 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:21.851 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:22.013 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:686, status:SUCCESS 2022-12-08 16:21:22.026 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:686, status:SUCCESS 2022-12-08 16:21:22.073 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:22.086 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:21:22.856 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:21:23.579 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:23.579 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:23.580 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:23.580 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:23.821 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2022-12-08T16:15:23.46, end=2022-12-08T16:20:23.713} 2022-12-08 16:21:23.821 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2022-12-08T16:15:23.463, end=2022-12-08T16:20:23.738} 2022-12-08 16:21:23.847 INFO 42 --- [pool-6-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 16:21:23.847 INFO 42 --- [pool-7-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2022-12-08 16:21:24.000 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:24.852 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:24.855 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:25.902 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:21:25.909 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:21:26.226 INFO 42 --- [pool-ocp-schedules-18,,3d022acda84d] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:21:26.606 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:26.0, nextRun=2022-12-08 16:21:25.0, currentDate=Thu Dec 08 16:21:26 CST 2022 2022-12-08 16:21:26.607 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:20:26.0, nextRunTime=2022-12-08 16:21:25.0} 2022-12-08 16:21:26.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:21:26.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:21:26.643 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:21:26.662 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:26.664 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:27.084 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:21:27.422 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 690, operation:EXECUTE, state: RUNNING 2022-12-08 16:21:27.485 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=690, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:21:27.405+08:00, endTime=null} 2022-12-08 16:21:27.856 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:27.862 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:27.936 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:687, status:SUCCESS 2022-12-08 16:21:27.944 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:687, status:SUCCESS 2022-12-08 16:21:28.724 INFO 42 --- [pool-ocp-schedules-9,,19dc7956be06] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:21:28.725 INFO 42 --- [pool-ocp-schedules-9,,19dc7956be06] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:21:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:21:28.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:21:28.795710+08:00, lastProcessTime=2022-12-08T16:21:18.798869+08:00 2022-12-08 16:21:28.891 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:21:28.795710+08:00, resultsCount=0 2022-12-08 16:21:28.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:21:28.795710+08:00, resultsCount=0 2022-12-08 16:21:28.892 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:21:28.795710+08:00 2022-12-08 16:21:29.751 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:29.751 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:29.789 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:29.789 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:30.651 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:30.0, nextRun=2022-12-08 16:21:30.0, currentDate=Thu Dec 08 16:21:30 CST 2022 2022-12-08 16:21:30.652 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:20:30.0, nextRunTime=2022-12-08 16:21:30.0} 2022-12-08 16:21:30.674 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:21:30.765 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:21:01.0, nextRun=2022-12-08 16:21:30.0, currentDate=Thu Dec 08 16:21:30 CST 2022 2022-12-08 16:21:30.766 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:21:01.0, nextRunTime=2022-12-08 16:21:30.0} 2022-12-08 16:21:30.781 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:21:30.782 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:21:30.782 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:21:30.862 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:30.867 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:31.018 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:21:31.600 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 691, operation:EXECUTE, state: RUNNING 2022-12-08 16:21:31.680 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=691, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:21:31.589+08:00, endTime=null} 2022-12-08 16:21:32.448 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:32.495 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:21:32.614 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:21:32.621 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:21:32.821 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:32.879 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:32.891 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:21:33.286 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:21:33.290 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:688, status:SUCCESS 2022-12-08 16:21:33.297 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:688, status:SUCCESS 2022-12-08 16:21:33.868 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:33.871 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:34.044 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:36.055 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:21:36.121 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:36.121 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:36.122 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:36.122 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:36.227 INFO 42 --- [pool-ocp-schedules-11,,bfbc7ab30513] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:21:36.872 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:36.876 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:38.499 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:21:38.505 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:21:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:21:38.792 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:21:38.792538+08:00, lastProcessTime=2022-12-08T16:21:28.795710+08:00 2022-12-08 16:21:38.872 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:21:38.792538+08:00, resultsCount=0 2022-12-08 16:21:38.872 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:21:38.792538+08:00, resultsCount=0 2022-12-08 16:21:38.872 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:21:38.792538+08:00 2022-12-08 16:21:39.476 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:39.477 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:39.614 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:21:39.877 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:39.881 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:40.302 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:21:40.316 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=14ms, period=120000ms 2022-12-08 16:21:41.255 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:21:42.544 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:42.544 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:42.545 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:42.546 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:42.557 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:42.616 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:21:42.882 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:42.889 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:43.106 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:21:44.229 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:44.776 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:21:44.781 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:21:45.473 INFO 42 --- [pool-ocp-schedules-4,,2b32141e0d50] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:21:45.508 INFO 42 --- [pool-ocp-schedules-4,,2b32141e0d50] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:21:45.632 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:45.635 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:45.732 INFO 42 --- [pool-ocp-schedules-18,,73359e88d7b9] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:21:45.769 INFO 42 --- [pool-ocp-schedules-12,,cde6de5c2bee] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:21:45.769 INFO 42 --- [pool-ocp-schedules-12,,cde6de5c2bee] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:21:45.867 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:21:45.890 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:45.894 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:46.228 INFO 42 --- [pool-ocp-schedules-17,,06d9661c1312] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:21:46.322 INFO 42 --- [pool-ocp-schedules-2,,27b3ee598605] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:21:47.495 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:21:48.755 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:48.756 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:48.756 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:48.756 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:48.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:21:48.792 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:21:48.791662+08:00, lastProcessTime=2022-12-08T16:21:38.792538+08:00 2022-12-08 16:21:48.872 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:21:48.791662+08:00, resultsCount=0 2022-12-08 16:21:48.873 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:21:48.791662+08:00, resultsCount=0 2022-12-08 16:21:48.873 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:21:48.791662+08:00 2022-12-08 16:21:48.896 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:48.901 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:48.977 INFO 42 --- [pool-ocp-schedules-7,,eacb9fe0e4ec] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:21:48.978 INFO 42 --- [pool-ocp-schedules-7,,eacb9fe0e4ec] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:21:49.663 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:21:49.852 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:21:51.464 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:21:51.567 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:21:51.576 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:21:51.902 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:51.906 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:51.989 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:51.992 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:52.181 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:21:52.214 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:21:52.619 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:52.716 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:21:53.320 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:21:54.567 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:21:54.907 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:54.910 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:55.057 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:55.058 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:55.085 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:21:55.085 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:21:56.229 INFO 42 --- [pool-ocp-schedules-6,,beb9586c82c0] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:21:57.656 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:21:57.661 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:21:57.911 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:21:57.915 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:21:58.121 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:58.139 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:21:58.436 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:21:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,99f362277d79] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:21:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,99f362277d79] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:21:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:21:58.793 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:21:58.792435+08:00, lastProcessTime=2022-12-08T16:21:48.791662+08:00 2022-12-08 16:21:58.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:21:58.792435+08:00, resultsCount=0 2022-12-08 16:21:58.899 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:21:58.792435+08:00, resultsCount=0 2022-12-08 16:21:58.900 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:21:58.792435+08:00 2022-12-08 16:22:00.578 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:20:02.0, nextRun=2022-12-08 16:22:00.0, currentDate=Thu Dec 08 16:22:00 CST 2022 2022-12-08 16:22:00.579 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:20:02.0, nextRunTime=2022-12-08 16:22:00.0} 2022-12-08 16:22:00.601 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:22:00.675 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:21:01.0, nextRun=2022-12-08 16:22:00.0, currentDate=Thu Dec 08 16:22:00 CST 2022 2022-12-08 16:22:00.675 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:21:01.0, nextRunTime=2022-12-08 16:22:00.0} 2022-12-08 16:22:00.694 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:22:00.695 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:22:00.695 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:22:00.740 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:21:01.0, nextRun=2022-12-08 16:22:00.0, currentDate=Thu Dec 08 16:22:00 CST 2022 2022-12-08 16:22:00.741 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:21:01.0, nextRunTime=2022-12-08 16:22:00.0} 2022-12-08 16:22:00.762 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:22:00.763 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:22:00.763 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:22:00.775 INFO 42 --- [pool-ocp-schedules-2,,17b8c8f3ef40] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:22:00.815 INFO 42 --- [pool-ocp-schedules-3,,eec616065e51] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:22:00.815 INFO 42 --- [pool-ocp-schedules-18,,e11a07f2a47a] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:22:00.818 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:21:01.0, nextRun=2022-12-08 16:22:00.0, currentDate=Thu Dec 08 16:22:00 CST 2022 2022-12-08 16:22:00.818 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:21:01.0, nextRunTime=2022-12-08 16:22:00.0} 2022-12-08 16:22:00.839 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:22:00.840 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:22:00.840 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:22:00.889 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:21:31.0, nextRun=2022-12-08 16:22:00.0, currentDate=Thu Dec 08 16:22:00 CST 2022 2022-12-08 16:22:00.889 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:21:31.0, nextRunTime=2022-12-08 16:22:00.0} 2022-12-08 16:22:00.905 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:22:00.906 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:22:00.906 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:22:00.916 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:00.921 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:00.982 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:21:01.0, nextRun=2022-12-08 16:22:00.0, currentDate=Thu Dec 08 16:22:00 CST 2022 2022-12-08 16:22:00.982 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:21:01.0, nextRunTime=2022-12-08 16:22:00.0} 2022-12-08 16:22:00.998 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:22:00.998 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:22:00.998 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:22:01.095 INFO 42 --- [pool-ocp-schedules-12,,1be9902fb833] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:22:01.096 INFO 42 --- [pool-ocp-schedules-12,,1be9902fb833] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:22:01.096 INFO 42 --- [pool-ocp-schedules-12,,1be9902fb833] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:22:01.114 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 692, operation:EXECUTE, state: RUNNING 2022-12-08 16:22:01.183 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:01.183 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:01.202 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=692, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:22:01.103+08:00, endTime=null} 2022-12-08 16:22:01.257 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:01.257 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 693, operation:EXECUTE, state: RUNNING 2022-12-08 16:22:01.257 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:01.346 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=693, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:22:01.246+08:00, endTime=null} 2022-12-08 16:22:01.405 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 694, operation:EXECUTE, state: RUNNING 2022-12-08 16:22:01.470 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=694, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:22:01.393+08:00, endTime=null} 2022-12-08 16:22:01.544 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 695, operation:EXECUTE, state: RUNNING 2022-12-08 16:22:01.603 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=695, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:22:01.531+08:00, endTime=null} 2022-12-08 16:22:02.089 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:689, status:SUCCESS 2022-12-08 16:22:02.096 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:689, status:SUCCESS 2022-12-08 16:22:02.214 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:690, status:SUCCESS 2022-12-08 16:22:02.223 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:22:02.226 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:690, status:SUCCESS 2022-12-08 16:22:02.365 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:691, status:SUCCESS 2022-12-08 16:22:02.371 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:691, status:SUCCESS 2022-12-08 16:22:02.510 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:692, status:SUCCESS 2022-12-08 16:22:02.517 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:692, status:SUCCESS 2022-12-08 16:22:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,ac7083dc2b33] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487780, interval=60 2022-12-08 16:22:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,ac7083dc2b33] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487722, count=0, elapsed=1668817234913 2022-12-08 16:22:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,632f73fa8e0c] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487780, interval=60 2022-12-08 16:22:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,632f73fa8e0c] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487722, count=0, elapsed=1668817234918 2022-12-08 16:22:02.667 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:02.691 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 696, operation:EXECUTE, state: RUNNING 2022-12-08 16:22:02.760 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:22:02.790 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=696, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:22:02.676+08:00, endTime=null} 2022-12-08 16:22:03.807 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:693, status:SUCCESS 2022-12-08 16:22:03.813 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:693, status:SUCCESS 2022-12-08 16:22:03.841 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:22:03.921 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:03.925 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:04.033 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:22:04.038 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:22:04.353 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:04.355 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:04.657 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:04.729 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:22:06.231 INFO 42 --- [pool-ocp-schedules-10,,82f0aab11e79] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:22:06.596 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:22:06.925 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:06.929 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:07.274 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:21:06.0, nextRun=2022-12-08 16:22:05.0, currentDate=Thu Dec 08 16:22:07 CST 2022 2022-12-08 16:22:07.275 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:21:06.0, nextRunTime=2022-12-08 16:22:05.0} 2022-12-08 16:22:07.291 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:22:07.291 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:22:07.291 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:22:07.579 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:07.580 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:07.580 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:07.581 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:07.911 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 697, operation:EXECUTE, state: RUNNING 2022-12-08 16:22:08.554 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=697, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:22:07.898+08:00, endTime=null} 2022-12-08 16:22:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:22:08.810 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:22:08.809420+08:00, lastProcessTime=2022-12-08T16:21:58.792435+08:00 2022-12-08 16:22:08.910 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:22:08.809420+08:00, resultsCount=0 2022-12-08 16:22:08.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:22:08.809420+08:00, resultsCount=0 2022-12-08 16:22:08.911 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:22:08.809420+08:00 2022-12-08 16:22:09.040 INFO 42 --- [pool-ocp-schedules-12,,3606055fde39] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:22:09.041 INFO 42 --- [pool-ocp-schedules-12,,3606055fde39] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:22:09.918 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:22:09.924 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:22:09.930 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:09.933 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:10.024 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:694, status:SUCCESS 2022-12-08 16:22:10.031 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:694, status:SUCCESS 2022-12-08 16:22:11.096 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:11.096 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:11.519 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:22:12.295 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:22:12.711 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:12.934 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:12.944 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:13.197 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:22:13.892 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:22:14.358 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:14.358 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:14.358 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:14.359 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:14.680 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:15.945 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:15.949 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:16.232 INFO 42 --- [pool-ocp-schedules-4,,9d0d1311a86f] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:22:16.713 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:22:16.719 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:22:17.571 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:22:17.582 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:17.582 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:17.831 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:22:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:22:18.795 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:22:18.794185+08:00, lastProcessTime=2022-12-08T16:22:08.809420+08:00 2022-12-08 16:22:18.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:22:18.794185+08:00, resultsCount=0 2022-12-08 16:22:18.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:22:18.794185+08:00, resultsCount=0 2022-12-08 16:22:18.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:22:18.794185+08:00 2022-12-08 16:22:18.950 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:18.956 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:19.726 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:22:19.894 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:22:20.820 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:20.821 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:20.822 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:20.823 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:20.921 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:21:21.0, nextRun=2022-12-08 16:22:20.0, currentDate=Thu Dec 08 16:22:20 CST 2022 2022-12-08 16:22:20.922 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:21:21.0, nextRunTime=2022-12-08 16:22:20.0} 2022-12-08 16:22:20.936 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:22:20.936 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:22:20.936 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:22:21.794 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 698, operation:EXECUTE, state: RUNNING 2022-12-08 16:22:21.833 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=698, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:22:21.782+08:00, endTime=null} 2022-12-08 16:22:21.957 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:21.962 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:22.071 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:22:22.404 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:22:22.892 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:695, status:SUCCESS 2022-12-08 16:22:22.903 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:695, status:SUCCESS 2022-12-08 16:22:22.954 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:23.150 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:22:23.157 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:22:23.361 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:22:23.897 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:23.903 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:24.228 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:22:24.266 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:22:24.769 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:24.962 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:24.966 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:26.233 INFO 42 --- [pool-ocp-schedules-18,,ff896c683eb4] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:22:26.528 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:21:27.0, nextRun=2022-12-08 16:22:25.0, currentDate=Thu Dec 08 16:22:26 CST 2022 2022-12-08 16:22:26.528 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:21:27.0, nextRunTime=2022-12-08 16:22:25.0} 2022-12-08 16:22:26.568 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:22:26.569 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:22:26.569 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:22:26.964 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:26.965 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:26.969 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 699, operation:EXECUTE, state: RUNNING 2022-12-08 16:22:27.014 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=699, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:22:26.952+08:00, endTime=null} 2022-12-08 16:22:27.040 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:27.040 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:27.967 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:27.979 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:28.246 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:696, status:SUCCESS 2022-12-08 16:22:28.255 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:696, status:SUCCESS 2022-12-08 16:22:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:22:28.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:22:28.796378+08:00, lastProcessTime=2022-12-08T16:22:18.794185+08:00 2022-12-08 16:22:28.886 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:22:28.796378+08:00, resultsCount=0 2022-12-08 16:22:28.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:22:28.796378+08:00, resultsCount=0 2022-12-08 16:22:28.887 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:22:28.796378+08:00 2022-12-08 16:22:29.349 INFO 42 --- [pool-ocp-schedules-4,,3f6de8ce59c9] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:22:29.349 INFO 42 --- [pool-ocp-schedules-4,,3f6de8ce59c9] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:22:29.974 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:22:29.980 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:22:30.238 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:30.287 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:30.582 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:22:30.979 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:30.984 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:31.173 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:21:31.0, nextRun=2022-12-08 16:22:30.0, currentDate=Thu Dec 08 16:22:31 CST 2022 2022-12-08 16:22:31.174 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:21:31.0, nextRunTime=2022-12-08 16:22:30.0} 2022-12-08 16:22:31.197 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:22:31.334 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:01.0, nextRun=2022-12-08 16:22:30.0, currentDate=Thu Dec 08 16:22:31 CST 2022 2022-12-08 16:22:31.334 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:22:01.0, nextRunTime=2022-12-08 16:22:30.0} 2022-12-08 16:22:31.349 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:22:31.349 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:22:31.350 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:22:32.172 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 700, operation:EXECUTE, state: RUNNING 2022-12-08 16:22:32.270 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=700, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:22:32.157+08:00, endTime=null} 2022-12-08 16:22:32.492 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:22:33.004 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:33.313 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:33.314 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:33.400 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:33.401 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:33.593 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:22:33.749 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:697, status:SUCCESS 2022-12-08 16:22:33.761 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:697, status:SUCCESS 2022-12-08 16:22:33.984 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:33.988 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:34.769 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:22:34.838 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:35.519 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2022-12-08T16:18:35.215, end=2022-12-08T16:20:35.447} 2022-12-08 16:22:35.538 INFO 42 --- [pool-9-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2022-12-08 16:22:35.791 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:22:35.797 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:22:36.234 INFO 42 --- [pool-ocp-schedules-17,,d8ab5608e742] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:22:36.647 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:36.648 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:36.893 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:22:36.989 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:36.992 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:37.127 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:22:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:22:38.792 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:22:38.791903+08:00, lastProcessTime=2022-12-08T16:22:28.796378+08:00 2022-12-08 16:22:38.875 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:22:38.791903+08:00, resultsCount=0 2022-12-08 16:22:38.875 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:22:38.791903+08:00, resultsCount=0 2022-12-08 16:22:38.876 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:22:38.791903+08:00 2022-12-08 16:22:39.705 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:39.705 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:39.732 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:39.733 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:39.993 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:39.999 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:42.097 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:22:42.103 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:22:42.541 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:22:42.871 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:42.871 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:43.000 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:43.004 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:43.225 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:22:43.600 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:43.694 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:22:44.835 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:22:45.397 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:45.471 INFO 42 --- [pool-ocp-schedules-10,,bcc5635809ad] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:22:45.516 INFO 42 --- [pool-ocp-schedules-10,,bcc5635809ad] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:22:45.734 INFO 42 --- [pool-ocp-schedules-3,,0905c93b529c] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:22:46.005 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:46.009 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:46.025 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:46.026 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:46.028 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:46.029 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:46.235 INFO 42 --- [pool-ocp-schedules-2,,3e682383081a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:22:46.337 INFO 42 --- [pool-ocp-schedules-11,,9a364a9a3ec0] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:22:47.808 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:22:48.446 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:22:48.453 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:22:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:22:48.806 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:22:48.804198+08:00, lastProcessTime=2022-12-08T16:22:38.791903+08:00 2022-12-08 16:22:48.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:22:48.804198+08:00, resultsCount=0 2022-12-08 16:22:48.906 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:22:48.804198+08:00, resultsCount=0 2022-12-08 16:22:48.907 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:22:48.804198+08:00 2022-12-08 16:22:49.010 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:49.014 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:49.340 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:49.341 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:49.419 INFO 42 --- [pool-ocp-schedules-12,,b0d5baa2e770] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:22:49.419 INFO 42 --- [pool-ocp-schedules-12,,b0d5baa2e770] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:22:49.580 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:22:49.761 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:22:50.035 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:22:50.183 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:19:19+08:00, updateTime=2022-12-08T16:22:19+08:00, expireTime=null, isLeader=false} 2022-12-08 16:22:50.190 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:22:52.015 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:52.019 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:52.179 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:22:52.432 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:52.432 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:52.434 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:52.434 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:52.573 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:22:53.929 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:53.931 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:22:54.725 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:22:54.733 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:22:55.020 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:55.025 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:55.397 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:22:55.467 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:22:55.625 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:55.625 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:22:55.833 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:22:56.236 INFO 42 --- [pool-ocp-schedules-2,,96d7c0b7f6fe] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:22:58.026 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:22:58.031 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:22:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,a2b0415b69cf] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:22:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,a2b0415b69cf] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:22:58.690 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:58.690 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:58.729 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:22:58.729 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:22:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:22:58.794 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:22:58.794988+08:00, lastProcessTime=2022-12-08T16:22:48.804198+08:00 2022-12-08 16:22:58.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:22:58.794988+08:00, resultsCount=0 2022-12-08 16:22:58.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:22:58.794988+08:00, resultsCount=0 2022-12-08 16:22:58.884 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:22:58.794988+08:00 2022-12-08 16:23:00.015 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:01.0, nextRun=2022-12-08 16:23:00.0, currentDate=Thu Dec 08 16:23:00 CST 2022 2022-12-08 16:23:00.016 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:22:01.0, nextRunTime=2022-12-08 16:23:00.0} 2022-12-08 16:23:00.033 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:23:00.034 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:23:00.034 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:23:00.521 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:01.0, nextRun=2022-12-08 16:23:00.0, currentDate=Thu Dec 08 16:23:00 CST 2022 2022-12-08 16:23:00.521 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:22:01.0, nextRunTime=2022-12-08 16:23:00.0} 2022-12-08 16:23:00.547 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:23:00.547 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:23:00.547 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:23:00.724 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 701, operation:EXECUTE, state: RUNNING 2022-12-08 16:23:00.724 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:01.0, nextRun=2022-12-08 16:23:00.0, currentDate=Thu Dec 08 16:23:00 CST 2022 2022-12-08 16:23:00.725 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:22:01.0, nextRunTime=2022-12-08 16:23:00.0} 2022-12-08 16:23:00.752 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:23:00.753 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:23:00.753 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:23:00.782 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=701, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:23:00.712+08:00, endTime=null} 2022-12-08 16:23:00.905 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:31.0, nextRun=2022-12-08 16:23:00.0, currentDate=Thu Dec 08 16:23:00 CST 2022 2022-12-08 16:23:00.905 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:22:31.0, nextRunTime=2022-12-08 16:23:00.0} 2022-12-08 16:23:00.927 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:23:00.928 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:23:00.928 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:23:00.956 INFO 42 --- [pool-ocp-schedules-19,,1f1ed92439c0] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:23:00.958 INFO 42 --- [pool-ocp-schedules-11,,ac84ac063b76] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:23:00.958 INFO 42 --- [pool-ocp-schedules-7,,c3ae9f813e4a] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:23:01.016 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:01.0, nextRun=2022-12-08 16:23:00.0, currentDate=Thu Dec 08 16:23:01 CST 2022 2022-12-08 16:23:01.017 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:22:01.0, nextRunTime=2022-12-08 16:23:00.0} 2022-12-08 16:23:01.032 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:01.035 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:23:01.036 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:23:01.036 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:23:01.053 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:01.258 INFO 42 --- [pool-ocp-schedules-18,,9e999801b6af] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:23:01.259 INFO 42 --- [pool-ocp-schedules-18,,9e999801b6af] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:23:01.259 INFO 42 --- [pool-ocp-schedules-18,,9e999801b6af] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:23:01.279 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:23:01.286 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:23:01.807 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:01.832 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:01.861 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 704, operation:EXECUTE, state: RUNNING 2022-12-08 16:23:01.907 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:23:01.971 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=704, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:23:01.850+08:00, endTime=null} 2022-12-08 16:23:02.034 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 705, operation:EXECUTE, state: RUNNING 2022-12-08 16:23:02.073 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=705, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:23:02.019+08:00, endTime=null} 2022-12-08 16:23:02.109 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:698, status:SUCCESS 2022-12-08 16:23:02.115 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:698, status:SUCCESS 2022-12-08 16:23:02.130 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 702, operation:EXECUTE, state: RUNNING 2022-12-08 16:23:02.172 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=702, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:23:02.119+08:00, endTime=null} 2022-12-08 16:23:02.236 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 703, operation:EXECUTE, state: RUNNING 2022-12-08 16:23:02.416 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=703, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:23:02.220+08:00, endTime=null} 2022-12-08 16:23:02.637 INFO 42 --- [pool-prometheus-minute-schedule-2,,a8027c054214] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487840, interval=60 2022-12-08 16:23:03.051 INFO 42 --- [pool-prometheus-minute-schedule-2,,a8027c054214] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487782, count=0, elapsed=1668817295269 2022-12-08 16:23:03.051 INFO 42 --- [pool-prometheus-minute-schedule-2,,857041bb157f] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487840, interval=60 2022-12-08 16:23:03.052 INFO 42 --- [pool-prometheus-minute-schedule-2,,857041bb157f] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487783, count=0, elapsed=1668817295269 2022-12-08 16:23:03.055 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:23:03.527 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:699, status:SUCCESS 2022-12-08 16:23:03.532 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:699, status:SUCCESS 2022-12-08 16:23:03.692 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:700, status:SUCCESS 2022-12-08 16:23:03.698 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:700, status:SUCCESS 2022-12-08 16:23:03.801 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:701, status:SUCCESS 2022-12-08 16:23:03.813 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:701, status:SUCCESS 2022-12-08 16:23:03.911 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:702, status:SUCCESS 2022-12-08 16:23:03.917 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:702, status:SUCCESS 2022-12-08 16:23:04.030 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:04.035 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:23:04.054 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:04.058 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:04.858 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:04.859 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:04.907 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:04.908 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:05.010 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:07.0, nextRun=2022-12-08 16:23:05.0, currentDate=Thu Dec 08 16:23:05 CST 2022 2022-12-08 16:23:05.011 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:22:07.0, nextRunTime=2022-12-08 16:23:05.0} 2022-12-08 16:23:05.030 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:23:05.031 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:23:05.031 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:23:05.467 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:23:05.522 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 706, operation:EXECUTE, state: RUNNING 2022-12-08 16:23:05.546 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:05.568 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=706, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:23:05.509+08:00, endTime=null} 2022-12-08 16:23:06.237 INFO 42 --- [pool-ocp-schedules-4,,37114ee465a2] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:23:06.271 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:703, status:SUCCESS 2022-12-08 16:23:06.278 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:703, status:SUCCESS 2022-12-08 16:23:07.059 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:07.063 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:07.134 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:23:07.140 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:23:07.209 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:23:07.928 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:07.951 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:08.237 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:23:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:23:08.810 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:23:08.810044+08:00, lastProcessTime=2022-12-08T16:22:58.794988+08:00 2022-12-08 16:23:08.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:23:08.810044+08:00, resultsCount=0 2022-12-08 16:23:08.922 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:23:08.810044+08:00, resultsCount=0 2022-12-08 16:23:08.923 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:23:08.810044+08:00 2022-12-08 16:23:09.468 INFO 42 --- [pool-ocp-schedules-7,,5ab239984e28] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:23:09.469 INFO 42 --- [pool-ocp-schedules-7,,5ab239984e28] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:23:10.063 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:10.070 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:10.979 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:10.979 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:11.030 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:11.030 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:13.071 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:13.080 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:13.340 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:23:13.450 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:23:13.456 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:23:14.072 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:14.110 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:23:14.463 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:14.568 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:15.231 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:23:15.502 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:23:15.585 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:16.081 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:16.086 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:16.238 INFO 42 --- [pool-ocp-schedules-4,,e719c83c11a1] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:23:17.717 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:17.718 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:17.719 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:17.720 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:18.102 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:23:18.495 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:19:47+08:00, updateTime=2022-12-08T16:22:47+08:00, expireTime=null, isLeader=false} 2022-12-08 16:23:18.499 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2022-12-08 16:23:18.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:23:18.797 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:23:18.796863+08:00, lastProcessTime=2022-12-08T16:23:08.810044+08:00 2022-12-08 16:23:18.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:23:18.796863+08:00, resultsCount=0 2022-12-08 16:23:18.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:23:18.796863+08:00, resultsCount=0 2022-12-08 16:23:18.893 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:23:18.796863+08:00 2022-12-08 16:23:19.087 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:19.091 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:20.036 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:23:20.087 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=192.168.28.62:8080, expireInSeconds=30, createTime=2022-12-08T16:20:19+08:00, updateTime=2022-12-08T16:22:49+08:00, expireTime=null, isLeader=false} 2022-12-08 16:23:20.093 WARN 42 --- [ocp-updater-0,,] c.a.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2022-12-08 16:23:20.296 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:23:20.489 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:23:20.495 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:23:20.830 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:20.831 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:21.094 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:23:21.140 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:21.0, nextRun=2022-12-08 16:23:20.0, currentDate=Thu Dec 08 16:23:21 CST 2022 2022-12-08 16:23:21.141 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=6, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2022-12-08 16:22:21.0, nextRunTime=2022-12-08 16:23:20.0} 2022-12-08 16:23:21.157 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2022-12-08 16:23:21.158 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:23:21.158 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all cluster compaction info, taskDefinitionId=6, state=RUNNING, operation=EXECUTE} 2022-12-08 16:23:21.841 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 707, operation:EXECUTE, state: RUNNING 2022-12-08 16:23:22.091 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:22.098 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:22.223 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=707, name=Collect compaction for all clusters, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=2022-12-08T16:23:21.830+08:00, endTime=null} 2022-12-08 16:23:22.268 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:23:23.389 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:23:23.696 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:704, status:SUCCESS 2022-12-08 16:23:23.703 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:704, status:SUCCESS 2022-12-08 16:23:23.931 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:23.932 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:23.938 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:23.939 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:24.119 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:24.175 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:23:25.099 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:25.103 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:25.540 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:23:26.189 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:26.240 INFO 42 --- [pool-ocp-schedules-13,,169c29aa49db] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:23:26.597 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:27.0, nextRun=2022-12-08 16:23:25.0, currentDate=Thu Dec 08 16:23:26 CST 2022 2022-12-08 16:23:26.598 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=9, name=Check host status, templateName=HostCheck, scheduleRule=25 * * * * *, lastRunTime=2022-12-08 16:22:27.0, nextRunTime=2022-12-08 16:23:25.0} 2022-12-08 16:23:26.647 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check host status, nodeCount=1, taskCount=1 2022-12-08 16:23:26.648 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:23:26.648 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check host status, taskDefinitionId=9, state=RUNNING, operation=EXECUTE} 2022-12-08 16:23:26.913 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:23:26.922 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:23:27.090 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:27.092 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:27.391 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 708, operation:EXECUTE, state: RUNNING 2022-12-08 16:23:27.516 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:23:28.058 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=708, name=Check host exporter status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.CheckExporterTask, seriesId=0, startTime=2022-12-08T16:23:27.370+08:00, endTime=null} 2022-12-08 16:23:28.104 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:28.108 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:28.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:23:28.790 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:23:28.789281+08:00, lastProcessTime=2022-12-08T16:23:18.796863+08:00 2022-12-08 16:23:28.881 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:23:28.789281+08:00, resultsCount=0 2022-12-08 16:23:28.881 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:23:28.789281+08:00, resultsCount=0 2022-12-08 16:23:28.882 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:23:28.789281+08:00 2022-12-08 16:23:29.347 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:705, status:SUCCESS 2022-12-08 16:23:29.354 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:705, status:SUCCESS 2022-12-08 16:23:29.562 INFO 42 --- [pool-ocp-schedules-2,,846af5582523] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:23:29.563 INFO 42 --- [pool-ocp-schedules-2,,846af5582523] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:23:30.165 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:30.165 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:30.178 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:30.179 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:31.109 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:31.114 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:31.329 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:31.0, nextRun=2022-12-08 16:23:30.0, currentDate=Thu Dec 08 16:23:31 CST 2022 2022-12-08 16:23:31.330 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=16, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2022-12-08 16:22:31.0, nextRunTime=2022-12-08 16:23:30.0} 2022-12-08 16:23:31.360 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync tenant information 2022-12-08 16:23:31.481 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:23:01.0, nextRun=2022-12-08 16:23:30.0, currentDate=Thu Dec 08 16:23:31 CST 2022 2022-12-08 16:23:31.482 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:23:01.0, nextRunTime=2022-12-08 16:23:30.0} 2022-12-08 16:23:31.503 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:23:31.504 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:23:31.504 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:23:32.196 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 709, operation:EXECUTE, state: RUNNING 2022-12-08 16:23:32.549 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=709, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:23:32.183+08:00, endTime=null} 2022-12-08 16:23:33.427 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:23:33.703 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:23:33.711 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:23:33.903 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:33.906 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:34.091 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:706, status:SUCCESS 2022-12-08 16:23:34.097 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:706, status:SUCCESS 2022-12-08 16:23:34.115 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:34.119 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:34.162 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:34.220 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:23:34.422 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:23:36.190 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:23:36.241 INFO 42 --- [pool-ocp-schedules-12,,bef6b3461e07] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:23:36.532 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:36.993 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:36.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:36.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:36.994 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:37.120 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:37.125 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:37.377 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:23:38.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:23:38.800 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:23:38.800343+08:00, lastProcessTime=2022-12-08T16:23:28.789281+08:00 2022-12-08 16:23:38.904 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:23:38.800343+08:00, resultsCount=0 2022-12-08 16:23:38.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:23:38.800343+08:00, resultsCount=0 2022-12-08 16:23:38.905 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:23:38.800343+08:00 2022-12-08 16:23:39.587 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:23:39.593 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:23:40.126 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:40.130 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:40.135 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:40.135 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:40.190 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2022-12-08 16:23:40.209 INFO 42 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=18ms, period=120000ms 2022-12-08 16:23:40.689 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:23:43.131 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:43.136 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:43.188 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:43.189 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:43.259 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:43.260 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:43.816 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:23:44.271 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:44.319 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:23:45.473 INFO 42 --- [pool-ocp-schedules-16,,570beda5e826] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2022-12-08 16:23:45.515 INFO 42 --- [pool-ocp-schedules-16,,570beda5e826] c.a.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2022-12-08 16:23:45.735 INFO 42 --- [pool-ocp-schedules-6,,1992ecffc316] c.a.o.service.monitor.OcpMonitorManager : Resize exporter collector size, second=0, interval=0 2022-12-08 16:23:45.770 INFO 42 --- [pool-ocp-schedules-18,,f0c1fb2e92f7] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:23:45.770 INFO 42 --- [pool-ocp-schedules-18,,f0c1fb2e92f7] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:23:46.136 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:46.141 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:46.189 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:23:46.196 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:23:46.242 INFO 42 --- [pool-ocp-schedules-8,,34e7b4e944d5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:23:46.262 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:23:46.283 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:46.342 INFO 42 --- [pool-ocp-schedules-9,,ee623c694a15] c.a.o.s.m.service.SeriesIdKeyService : Sync series key and id, currentMaxSeriesId=0 2022-12-08 16:23:46.386 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:46.571 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:46.807 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:23:48.570 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_INDEX_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:23:48.767 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:23:48.798 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:23:48.796048+08:00, lastProcessTime=2022-12-08T16:23:38.800343+08:00 2022-12-08 16:23:48.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:23:48.796048+08:00, resultsCount=0 2022-12-08 16:23:48.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:23:48.796048+08:00, resultsCount=0 2022-12-08 16:23:48.901 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:23:48.796048+08:00 2022-12-08 16:23:49.142 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:49.149 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:49.387 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:49.387 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:49.445 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:49.446 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:49.774 INFO 42 --- [pool-ocp-schedules-15,,332d59dfaff1] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:23:49.775 INFO 42 --- [pool-ocp-schedules-15,,332d59dfaff1] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:23:50.289 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PLAN_CHANGE_DETECTOR updating status on 192.168.28.62:8080 2022-12-08 16:23:50.367 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService SQL_PERF_DIAGNOSER updating status on 192.168.28.62:8080 2022-12-08 16:23:51.955 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:23:51.963 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:23:52.150 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:52.155 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:52.502 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:52.699 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:52.822 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:23:53.213 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:23:54.065 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:23:54.386 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:54.390 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:23:55.156 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:55.160 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:55.702 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:55.702 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:55.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:23:55.825 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:23:56.243 INFO 42 --- [pool-ocp-schedules-5,,9cd3ee9124c5] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:23:56.314 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:23:56.608 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:23:58.161 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:23:58.165 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:23:58.507 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:23:58.514 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:23:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,df585ca6d1cc] c.a.o.s.m.s.OcpCacheMonitorService : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2022-12-08 16:23:58.648 INFO 42 --- [pool-prometheus-cache-monitor1,,df585ca6d1cc] c.a.o.s.m.s.OcpCacheMonitorService : MetricSearchStats:{} 2022-12-08 16:23:58.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:23:58.781 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:58.804 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:23:58.803669+08:00, lastProcessTime=2022-12-08T16:23:48.796048+08:00 2022-12-08 16:23:58.877 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:23:58.925 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:23:58.803669+08:00, resultsCount=0 2022-12-08 16:23:58.925 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:23:58.803669+08:00, resultsCount=0 2022-12-08 16:23:58.925 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:23:58.803669+08:00 2022-12-08 16:23:59.097 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:24:00.001 INFO 42 --- [pool-ocp-schedules-8,,] c.a.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2022-12-08 16:24:01.045 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:22:01.0, nextRun=2022-12-08 16:24:00.0, currentDate=Thu Dec 08 16:24:01 CST 2022 2022-12-08 16:24:01.045 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=14, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2022-12-08 16:22:01.0, nextRunTime=2022-12-08 16:24:00.0} 2022-12-08 16:24:01.067 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=Sync root service list 2022-12-08 16:24:01.072 INFO 42 --- [pool-ocp-schedules-14,,7ef90ed7b0b4] c.a.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2022-12-08 16:24:01.074 INFO 42 --- [pool-ocp-schedules-13,,6c8e757bd48b] c.a.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2022-12-08 16:24:01.075 INFO 42 --- [pool-ocp-schedules-2,,4de3475b9c95] c.a.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2022-12-08 16:24:01.146 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:23:00.0, nextRun=2022-12-08 16:24:00.0, currentDate=Thu Dec 08 16:24:01 CST 2022 2022-12-08 16:24:01.147 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=31, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:23:00.0, nextRunTime=2022-12-08 16:24:00.0} 2022-12-08 16:24:01.164 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2022-12-08 16:24:01.164 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:24:01.165 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Get agent alarms, taskDefinitionId=31, state=RUNNING, operation=EXECUTE} 2022-12-08 16:24:01.166 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:24:01.171 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:24:01.264 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:23:01.0, nextRun=2022-12-08 16:24:00.0, currentDate=Thu Dec 08 16:24:01 CST 2022 2022-12-08 16:24:01.265 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=32, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:23:01.0, nextRunTime=2022-12-08 16:24:00.0} 2022-12-08 16:24:01.289 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:24:01.289 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:24:01.290 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, taskDefinitionId=32, state=RUNNING, operation=EXECUTE} 2022-12-08 16:24:01.358 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:23:01.0, nextRun=2022-12-08 16:24:00.0, currentDate=Thu Dec 08 16:24:01 CST 2022 2022-12-08 16:24:01.359 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=33, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:23:01.0, nextRunTime=2022-12-08 16:24:00.0} 2022-12-08 16:24:01.365 INFO 42 --- [pool-ocp-schedules-7,,b71ada3c4f41] c.a.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2022-12-08 16:24:01.365 INFO 42 --- [pool-ocp-schedules-7,,b71ada3c4f41] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:24:01.366 INFO 42 --- [pool-ocp-schedules-7,,b71ada3c4f41] c.a.o.s.t.u.DistributedExclusiveExecutor : Empty item list, taskName=Check host status, skip execute 2022-12-08 16:24:01.389 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2022-12-08 16:24:01.389 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:24:01.389 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, taskDefinitionId=33, state=RUNNING, operation=EXECUTE} 2022-12-08 16:24:01.473 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:23:31.0, nextRun=2022-12-08 16:24:00.0, currentDate=Thu Dec 08 16:24:01 CST 2022 2022-12-08 16:24:01.474 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=34, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=*/30 * * * * ?, lastRunTime=2022-12-08 16:23:31.0, nextRunTime=2022-12-08 16:24:00.0} 2022-12-08 16:24:01.490 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2022-12-08 16:24:01.490 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:24:01.490 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Collect all tenants major compactions, taskDefinitionId=34, state=RUNNING, operation=EXECUTE} 2022-12-08 16:24:01.596 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:23:01.0, nextRun=2022-12-08 16:24:00.0, currentDate=Thu Dec 08 16:24:01 CST 2022 2022-12-08 16:24:01.597 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000002, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2022-12-08 16:23:01.0, nextRunTime=2022-12-08 16:24:00.0} 2022-12-08 16:24:01.613 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2022-12-08 16:24:01.613 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:24:01.613 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Detect alarms, taskDefinitionId=1000002, state=RUNNING, operation=EXECUTE} 2022-12-08 16:24:01.836 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:24:01.836 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:24:01.934 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:24:01.935 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:24:02.054 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 710, operation:EXECUTE, state: RUNNING 2022-12-08 16:24:02.293 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=710, name=Get all agent alarms, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=2022-12-08T16:24:02.042+08:00, endTime=null} 2022-12-08 16:24:02.355 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 711, operation:EXECUTE, state: RUNNING 2022-12-08 16:24:02.448 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=711, name=Collect trans stat to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=2022-12-08T16:24:02.344+08:00, endTime=null} 2022-12-08 16:24:02.527 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 712, operation:EXECUTE, state: RUNNING 2022-12-08 16:24:02.568 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=712, name=Collect SlowSql to SqlAggregateData for alarm, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=2022-12-08T16:24:02.515+08:00, endTime=null} 2022-12-08 16:24:02.633 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 713, operation:EXECUTE, state: RUNNING 2022-12-08 16:24:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,2fe49896e07f] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487900, interval=60 2022-12-08 16:24:02.635 INFO 42 --- [pool-prometheus-minute-schedule-2,,2fe49896e07f] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487842, count=0, elapsed=1668817354793 2022-12-08 16:24:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,8fde73f768ae] c.a.o.service.monitor.OcpMonitorManager : Next exec sec=1670487900, interval=60 2022-12-08 16:24:02.640 INFO 42 --- [pool-prometheus-minute-schedule-1,,8fde73f768ae] c.a.o.service.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1670487842, count=0, elapsed=1668817354798 2022-12-08 16:24:02.701 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=713, name=Collect all tenants mini compactions, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=2022-12-08T16:24:02.618+08:00, endTime=null} 2022-12-08 16:24:02.782 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 714, operation:EXECUTE, state: RUNNING 2022-12-08 16:24:02.912 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=714, name=Detect alarms of backup, state=RUNNING, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=2022-12-08T16:24:02.764+08:00, endTime=null} 2022-12-08 16:24:02.929 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:707, status:SUCCESS 2022-12-08 16:24:02.937 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:707, status:SUCCESS 2022-12-08 16:24:03.220 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:708, status:SUCCESS 2022-12-08 16:24:03.228 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:708, status:SUCCESS 2022-12-08 16:24:03.367 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:709, status:SUCCESS 2022-12-08 16:24:03.373 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:709, status:SUCCESS 2022-12-08 16:24:03.500 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:710, status:SUCCESS 2022-12-08 16:24:03.506 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:710, status:SUCCESS 2022-12-08 16:24:04.111 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:24:04.172 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:24:04.177 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:24:04.443 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:24:04.485 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServerManager : DistributedServer updating status on 192.168.28.62:8080 2022-12-08 16:24:04.494 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:24:04.500 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:24:04.915 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:24:05.004 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:24:05.023 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:711, status:SUCCESS 2022-12-08 16:24:05.029 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:711, status:SUCCESS 2022-12-08 16:24:05.455 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:24:06.010 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2022-12-08 16:23:05.0, nextRun=2022-12-08 16:24:05.0, currentDate=Thu Dec 08 16:24:06 CST 2022 2022-12-08 16:24:06.010 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=4, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=5 * * * * *, lastRunTime=2022-12-08 16:23:05.0, nextRunTime=2022-12-08 16:24:05.0} 2022-12-08 16:24:06.024 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.task.model.TaskInstanceEntity : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2022-12-08 16:24:06.024 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.m.t.model.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2022-12-08 16:24:06.025 INFO 42 --- [pool-task-coordinator2,6d808bd684a44ecd,cf29e010deac] c.a.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name=Check obproxy, taskDefinitionId=4, state=RUNNING, operation=EXECUTE} 2022-12-08 16:24:06.244 INFO 42 --- [pool-ocp-schedules-13,,e68a97c70b3a] c.a.o.service.monitor.OcpMonitorManager : Refresh cached second exporters 2022-12-08 16:24:06.344 INFO 42 --- [pool-ocp-schedules-8,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: classpath:/application.properties 2022-12-08 16:24:06.362 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService CMDB_SYNCER updating status on 192.168.28.62:8080 2022-12-08 16:24:06.684 INFO 42 --- [pool-ocp-schedules-8,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}, BootstrapPropertySource {name='bootstrapProperties-ocp-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-composite'}, BootstrapPropertySource {name='bootstrapProperties-application-default'}] 2022-12-08 16:24:06.763 INFO 42 --- [pool-ocp-schedules-8,,] o.s.boot.SpringApplication : The following profiles are active: composite,default 2022-12-08 16:24:06.868 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService TASK_MANAGER updating status on 192.168.28.62:8080 2022-12-08 16:24:06.970 INFO 42 --- [pool-ocp-schedules-8,,] o.s.boot.SpringApplication : Started application in 6.903 seconds (JVM running for 3843.816) 2022-12-08 16:24:07.042 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.core.metadb.task.SubtaskAccessor : Set state for subtask: 715, operation:EXECUTE, state: RUNNING 2022-12-08 16:24:07.106 INFO 42 --- [pool-subtask-coordinator1,,] c.a.o.c.t.e.c.w.s.ReadySubtaskWorker : Submit ready task, entity=SubtaskInstanceOverview{id=715, name=Check obproxy connection status, state=RUNNING, operation=EXECUTE, className=com.alipay.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=2022-12-08T16:24:07.020+08:00, endTime=null} 2022-12-08 16:24:07.177 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:24:07.181 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:24:07.886 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService PERF_SQL_ROLLUP updating status on 192.168.28.62:8080 2022-12-08 16:24:08.009 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:24:08.009 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:24:08.103 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:24:08.103 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:24:08.484 INFO 42 --- [pool-ocp-schedules-8,,] c.a.o.service.property.PropertyService : Refresh config properties on 127.0.0.1:8080 at 2022-12-08T16:24:08.484+08:00 2022-12-08 16:24:08.516 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : begin update audit event, taskId:712, status:SUCCESS 2022-12-08 16:24:08.522 INFO 42 --- [pool-task-coordinator1,781355287a7246f6,03aabf8f16c8] c.a.ocp.service.audit.AuditEventService : audit event not found, taskId:712, status:SUCCESS 2022-12-08 16:24:08.766 INFO 42 --- [alarm-task-2,,2180e23ac452] c.a.o.s.alarm.core.task.AlarmDetectTask : alarm detect start 2022-12-08 16:24:08.796 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process alarm start, currentTimestamp=2022-12-08T16:24:08.796772+08:00, lastProcessTime=2022-12-08T16:23:58.803669+08:00 2022-12-08 16:24:08.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100000, now=2022-12-08T16:24:08.796772+08:00, resultsCount=0 2022-12-08 16:24:08.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.c.aggregate.ChannelAggregator : aggregate done, channelId=100001, now=2022-12-08T16:24:08.796772+08:00, resultsCount=0 2022-12-08 16:24:08.896 INFO 42 --- [alarm-task-1,,762f82c00a1e] c.a.o.s.a.core.process.AlarmProcessor : process done, currentTimestamp=2022-12-08T16:24:08.796772+08:00 2022-12-08 16:24:10.128 INFO 42 --- [pool-ocp-schedules-17,,3151a2dac52b] c.a.o.s.a.service.TaskRepositoryService : heartbeat done, affectRow=2, taskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:24:10.128 INFO 42 --- [pool-ocp-schedules-17,,3151a2dac52b] c.a.o.s.a.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=2, heartbeatCount=2, currentTaskUuidList=[5d1c7c8a-1780-40fe-8c4f-b46ce797f238, 142cf501-1f3a-4dfd-adba-cf2d83e0b467] 2022-12-08 16:24:10.182 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:24:10.187 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:24:10.963 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingRegistry : Start rebalance, consumerSize=2, sliceEntitySize=0, resourceSize=0 2022-12-08 16:24:10.969 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=PAUSE 2022-12-08 16:24:11.099 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:24:11.185 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-01,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2022-12-08 16:24:11.613 INFO 42 --- [pool-sharding-metric-collect1,,] c.a.o.c.s.registry.ShardingHelper : Mark consumer state, newState=ASSIGNED 2022-12-08 16:24:13.188 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.s.RateLimitFacadeServiceImpl : 192.168.28.62:8080 refreshes policies... 2022-12-08 16:24:13.195 INFO 42 --- [pool-3-thread-1,,] c.a.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2022-12-08 16:24:14.207 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2022-12-08 16:24:14.208 INFO 42 --- [pool-heartbeat-metric-collect-192.168.28.62:8080-11,,] c.a.o.server.config.MetricConfiguration : Consumer had rebalanced. 2022-12-08 16:24:14.379 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService RATE_LIMIT updating status on 192.168.28.62:8080 2022-12-08 16:24:14.526 INFO 42 --- [ocp-updater-0,,] c.a.o.c.d.s.DistributedServiceManager : DistributedService MC_MANAGER updating status on 192.168.28.62:8080